Skip to content

feat(dispatch): add tsingmicro txda backend for vllm 0.24.0 - #421

Open
tengqm wants to merge 7 commits into
flagos-ai:mainfrom
tengqm:port/txda-tsingmicro
Open

feat(dispatch): add tsingmicro txda backend for vllm 0.24.0#421
tengqm wants to merge 7 commits into
flagos-ai:mainfrom
tengqm:port/txda-tsingmicro

fix(attention): set forward_includes_kv_cache_update=False

bd010ce
Select commit
Loading
Failed to load commit list.
Sign in for the full log view