Skip to content

feat(qwen35): shard GDR state per TP rank + batched eager/graph decode under TP (+27B benchmark validation) - #946

Open
Ma1oneZhang wants to merge 5 commits into
pegainfer-project:mainfrom
Ma1oneZhang:feat/qwen35-tp2-batched-decode
Open

feat(qwen35): shard GDR state per TP rank + batched eager/graph decode under TP (+27B benchmark validation)#946
Ma1oneZhang wants to merge 5 commits into
pegainfer-project:mainfrom
Ma1oneZhang:feat/qwen35-tp2-batched-decode

feat(qwen35): cuda graph decode under TP

cb4a7a8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Commit attribution notice
succeeded Aug 21, 2026 in 8s