feat(deepseek-v2-lite): add mixed-request serving gate with per-request KV ownership - #441

feat(deepseek-v2-lite): add mixed-request serving gate with per-request KV ownership#441

xiaguan merged 2 commits into

pegainfer-project:mainpegainfer-project/pegainfer:mainfrom

CAICAIIs:feat/dsv2lite-mixed-serving-admissionCAICAIIs/pegainfer:feat/dsv2lite-mixed-serving-admissionCopy head branch name to clipboard