Skip to content

qwen3_5_moe: run lm_head on sampled rows only (fixes 32 GB first-prefill OOM) - #342

Open
chrisqianz wants to merge 1 commit into
FlashML-org:mainfrom
chrisqianz:fix-lm-head-sample-rows
Open

qwen3_5_moe: run lm_head on sampled rows only (fixes 32 GB first-prefill OOM)#342
chrisqianz wants to merge 1 commit into
FlashML-org:mainfrom
chrisqianz:fix-lm-head-sample-rows

Commits

Commits on Sep 2, 2026