Config for smaller models

[DoubtedSteam]

Thanks for your impressive work.
Would you mind share the official config for training smaller models?

[Muennighoff]

Ofc we uploaded some smaller models here: https://huggingface.co/simplescaling
They were trained with the exact same config as s1.1-32B except using the respective smaller Qwen2.5 Instruct models