Your question
Ask a clear and concise question about Megatron-LM.
When I transfer the hf_weights to megatron_weights using "tools/checkpoint/util.py --model-type GPT", I got the output informations as follows, and the "--target-tensor-parallel-size 2 --target-pipeline-parallel-size 2" are not used I think.

Your question

Ask a clear and concise question about Megatron-LM.
When I transfer the hf_weights to megatron_weights using "tools/checkpoint/util.py --model-type GPT", I got the output informations as follows, and the "--target-tensor-parallel-size 2 --target-pipeline-parallel-size 2" are not used I think.