fix(router): make load accounting cancellation-safe - #200

fix(router): make load accounting cancellation-safe#200

bvolpato wants to merge 2 commits into

vllm-project:mainvllm-project/router:mainfrom

bvolpato:bvolpato/cancellation-safe-load-accountingbvolpato/router:bvolpato/cancellation-safe-load-accountingCopy head branch name to clipboard