Does Megatron has plan to support Gemma？

[anlongfei]

Your question
Does Megatron has plan to support Gemma？

[ethanhe42]

nemo (using megatron-core) supports it https://github.com/NVIDIA/NeMo/blob/f005f1323eaf9a23ad6dc4bc326dc95bf0002e8d/examples/nlp/language_modeling/conf/megatron_gemma_config.yaml#L4

[fwyc0573]

also looking for example of gemma in megatron-lm

[github-actions[bot]]

Marking as stale. No activity in 60 days.