Skip to content

Commit

Permalink
fix: space missing from data_formatter_template causing mismatch with…
Browse files Browse the repository at this point in the history
… response_template

Signed-off-by: Harikrishnan Balagopal <[email protected]>
  • Loading branch information
HarikrishnanBalagopal committed Feb 5, 2025
1 parent f32ac38 commit 8807dde
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ Example: Train.json
},
...
]`
data_formatter_template: `### Input: {{input}} \n\n##Label: {{output}}`
data_formatter_template: `### Input: {{input}} \n\n## Label: {{output}}`

Formatting will happen on the fly while tuning. The keys in template should match fields in the dataset file. The `response template` corresponding to the above template will need to be supplied. in this case, `response template` = `\n## Label:`.

Expand Down Expand Up @@ -299,7 +299,7 @@ python tuning/sft_trainer.py \
--gradient_accumulation_steps 4 \
--learning_rate 1e-5 \
--response_template "\n## Label:" \
--data_formatter_template: "### Input: {{input}} \n\n##Label: {{output}}"
--data_formatter_template: "### Input: {{input}} \n\n## Label: {{output}}"

```

Expand Down

0 comments on commit 8807dde

Please sign in to comment.