Question about Skywork-OR1-Math-7B

[weizhehua]

Thank you for open sourcing this great project. I have a question about the training script for Skywork-OR1-Math-7B. If I understand correctly, the current training scripts are for Skywork-OR1-7B-Preview and Skywork-OR1-32B-Preview. I was wondering if you could also upload the training scripts for Skywork-OR1-Math-7B? Is it just removing the coding datasets during training?

[hejujie]

Yes, you are correct. The primary difference for training math model is indeed removing the coding datasets from the training mix.