Skip to content

Commit d3e7fd8

Browse files
committed
Update settings yaml to match what passed from Serval during tests
1 parent 6c1406c commit d3e7fd8

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

machine/jobs/settings.yaml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,14 +10,15 @@ default:
1010
do_train: true
1111
optim: adamw_torch
1212
warmup_steps: 1000
13-
per_device_train_batch_size: 16
14-
gradient_accumulation_steps: 4
13+
per_device_train_batch_size: 64
14+
gradient_accumulation_steps: 1
1515
label_smoothing_factor: 0.2
1616
group_by_length: true
1717
gradient_checkpointing: true
1818
lr_scheduler_type: cosine
1919
learning_rate: 0.0002
2020
fp16: true
21+
tf32: true
2122
save_strategy: no
2223
max_steps: 5000
2324
generate_params:

0 commit comments

Comments
 (0)