Skip to content

Commit 83f12ee

Browse files
j316chuckChuck Tang
authored andcommitted
Fix llama3 example yamls (#1688)
Co-authored-by: Chuck Tang <[email protected]>
1 parent 84aabc1 commit 83f12ee

File tree

2 files changed

+3
-0
lines changed

2 files changed

+3
-0
lines changed

mcli/mcli-llama2-finetune.yaml

+1
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@ integrations:
88

99
command: |
1010
cd llm-foundry/scripts
11+
export HF_HUB_ENABLE_HF_TRANSFER=1
1112
composer train/train.py /mnt/config/parameters.yaml
1213
image: mosaicml/llm-foundry:2.5.1_cu124-latest
1314
name: llama2-finetune

mcli/mcli-llama3-70b-instruct-finetune.yaml

+2
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@ integrations:
88

99
command: |
1010
cd llm-foundry/scripts
11+
export HF_HUB_ENABLE_HF_TRANSFER=1
1112
composer train/train.py /mnt/config/parameters.yaml
1213
image: mosaicml/llm-foundry:2.5.1_cu124-latest
1314
name: llama3.1-70b-finetune
@@ -31,6 +32,7 @@ parameters:
3132
run_name: # If left blank, will be read from env var $RUN_NAME
3233

3334
max_split_size_mb: 512
35+
dist_timeout: 3600 # set to avoid NCCL timeouts
3436

3537
# Model
3638
model:

0 commit comments

Comments
 (0)