Skip to content

Commit

Permalink
[Usability] dpo v2 example now using accelerate instead of deepspeed
Browse files Browse the repository at this point in the history
  • Loading branch information
wheresmyhair committed Jun 27, 2024
1 parent 1a3e249 commit 052c836
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions scripts/run_dpov2_align.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,6 @@ reference_model_name_or_path=meta-llama/Meta-Llama-3-8B-Instruct
dataset_path=data/iterative-prompt/train
eval_dataset_path=data/iterative-prompt/eval
output_dir=output_models/${run_name}
deepspeed_args="--master_port=11000 --include localhost:4,5,6,7"

while [[ $# -ge 1 ]]; do
key="$1"
Expand Down Expand Up @@ -36,10 +35,6 @@ while [[ $# -ge 1 ]]; do
output_dir="$2"
shift
;;
--deepspeed_args)
deepspeed_args="$2"
shift
;;
*)
echo "error: unknown option \"${key}\"" 1>&2
exit 1
Expand Down

0 comments on commit 052c836

Please sign in to comment.