feat(router): add sticky least-loaded session routing - #235

feat(router): add sticky least-loaded session routing#235

bvolpato wants to merge 2 commits into

vllm-project:mainvllm-project/router:mainfrom

bvolpato:bv/sticky-least-loadedbvolpato/router:bv/sticky-least-loadedCopy head branch name to clipboard