feat: cache aware per request affinity - #238

Open

sdevare-nv wants to merge 5 commits into

vllm-project:mainfrom

sdevare-nv:sdd/cache-aware-per-request-affinity

Commits on Aug 16, 2026

Commits on Sep 4, 2026

fix(cache_aware): apply the load override per request, not fleet-wide
sdevare-nv
committed
84b4425