Skip to content

perf: overlap MTP final-draft-to-target graph updates.#1962

Draft
pjgao wants to merge 6 commits into
xLLM-AI:mainfrom
pjgao:perf/npu-mtp-tp2-gapless
Draft

perf: overlap MTP final-draft-to-target graph updates.#1962
pjgao wants to merge 6 commits into
xLLM-AI:mainfrom
pjgao:perf/npu-mtp-tp2-gapless

test: cover speculative verification graph updates.

1a5338a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error
Job log options

This job was cancelled