Skip to content

Add DFlash speculative decoding support to NeMo SpeechLM vLLM plugin - #16129

Closed
Slyne wants to merge 20 commits into
NVIDIA-NeMo:mainfrom
Slyne:slyne/dflash-inference
Closed

Add DFlash speculative decoding support to NeMo SpeechLM vLLM plugin#16129
Slyne wants to merge 20 commits into
NVIDIA-NeMo:mainfrom
Slyne:slyne/dflash-inference

feat(speechlm2): route Automodel DFlash2 through vLLM

e095c3c
Select commit
Loading
Failed to load commit list.