Update vllm.py to support the V1 engine#53

Open

ClementeP wants to merge 14 commits intomainfrom

Commits on Oct 10, 2025

quantization update
ClementeP
committed

Commits on Oct 17, 2025

V1 backend
ClementeP
committed

Commits on Oct 20, 2025

Polishing V1
ClementeP
committed

Commits on Oct 27, 2025

Updates to support V1. updated pyproject.toml to support vllm 10.2, whch is necessary for gpt-oss.
ClementeP
committed

Commits on Nov 2, 2025

added test cases for V1, and modified the vllm class so that we can select either V1 or V0 by passing a flag to the constructor.
ClementeP
committed

Commits on Nov 3, 2025

Commits on Nov 4, 2025

addeds skipo condition in the case that V1 is not supported
ClementeP
committed

Commits on Nov 10, 2025

Commits on Nov 11, 2025

adjusted comments format, removed commented out code, simplified the input to next_token_logprobs in vllm.py (there is no need to consider the case where we pass a string as input)
ClementeP
committed