feat(zmq): typed structured outputs for the direct backend, with e2e coverage - #2041

Open

slin1237 wants to merge 16 commits into

mainfrom

feat/zmq-e2e-tests

Commits on Aug 4, 2026

test(e2e): cover the ZMQ direct backend for vLLM and TokenSpeed
slin1237
committed
054ff01
fix(e2e): correct ZMQ router flag and address review feedback
slin1237
committed
4e49efa
fix(e2e): treat blank E2E_CONNECTION_MODE as no override
slin1237
committed
72a287b
feat(router): translate structured-output constraints over the ZMQ backend
slin1237
committed
f62c3e1
fix(e2e): cover model load in the ZMQ gateway readiness gate
slin1237
committed
baf9332
fix(zmq): satisfy fmt/clippy for structured-outputs port
slin1237
committed
17b7bdb
fix(zmq): default unset max_tokens to remaining context
slin1237
committed
0a5de61
fix(zmq): shape top_logprobs to the requested count over the ZMQ path
slin1237
committed
0a4f748
fix(zmq): report finish_reason=stop for stop-string matches
slin1237
committed
ead557e
feat(grpc): unify router-authoritative string-stop resolution
slin1237
committed
c3f0209
fix(zmq): carry the model's EOS ids on EngineCore requests
slin1237
committed
7d19ab7

Commits on Aug 5, 2026