[Bugfix] Content-aware routing should work with token ids - #237

[Bugfix] Content-aware routing should work with token ids#237

simondanielsson wants to merge 8 commits into

vllm-project:mainvllm-project/router:mainfrom

simondanielsson:bugfix/cache-aware-with-tokenidssimondanielsson/router:bugfix/cache-aware-with-tokenidsCopy head branch name to clipboard