Skip to content

Pull requests: vllm-project/vllm

New pull request New
474 Open 5,514 Closed
474 Open 5,514 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix: benchmark_prioritization.py has problems constructing requests w…
#12646 opened Feb 1, 2025 by Accelerator1996 Loading…
1
2
[V1][Metrics] Add several request timing histograms v1
#12644 opened Feb 1, 2025 by markmc • Draft
1
doc: fixing minor typo in readme.md documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#12643 opened Feb 1, 2025 by vicenteherrera Loading…
1
[Core] BatchLLM for better shared prefix utilizing in offline scenarios frontend
#12641 opened Feb 1, 2025 by xinji1 Loading…
2
[Hardware][Metal] Apple Metal support ci/build
#12640 opened Feb 1, 2025 by skyzh • Draft
1
1
[WIP][Attention] WIP MLA with chunked prefill
#12639 opened Feb 1, 2025 by LucasWilkinson • Draft
1
Apply torch.compile to fused_moe/grouped_topk ready ONLY add when PR is ready to merge/full CI is needed
#12637 opened Feb 1, 2025 by mgoin Loading…
2
Fix get_device_name for cuda platforms that return bytes
#12636 opened Feb 1, 2025 by mgoin Loading…
5
[Model][Quant] Fix GLM, Fix fused module mappings for quantization needs-rebase
#12634 opened Jan 31, 2025 by kylesayrs Loading…
6
[Core] choice-based structured output with xgrammar ci/build ready ONLY add when PR is ready to merge/full CI is needed structured-output
#12632 opened Jan 31, 2025 by russellb Loading…
5
[Build] update requirements of no-device for plugin usage ci/build
#12630 opened Jan 31, 2025 by sducouedic Loading…
1
[Misc] Add SPDX-License-Identifier headers to python source files ci/build documentation Improvements or additions to documentation frontend
#12628 opened Jan 31, 2025 by russellb Loading…
3
[Core] Add Additional Metrics to vLLM Server
#12627 opened Jan 31, 2025 by sahelib25 Loading…
1
4
[CI] Fix flaky CI test ci/build
#12626 opened Jan 31, 2025 by NickLucche Loading…
1
[ROCm] Using a more precise memory profiling
#12624 opened Jan 31, 2025 by gshtras Loading…
1
[Hardware][TPU] Multi-LoRA implementation for the TPU backend
#12623 opened Jan 31, 2025 by Akshat-Tripathi Loading…
8
Default to generation_config from model frontend
#12622 opened Jan 31, 2025 by hmellor Loading…
1
1
[Core] Improve hash collision avoidance in prefix caching needs-rebase ready ONLY add when PR is ready to merge/full CI is needed v1
#12621 opened Jan 31, 2025 by russellb Loading…
5
[Core] Silence unnecessary deprecation warnings ready ONLY add when PR is ready to merge/full CI is needed
#12620 opened Jan 31, 2025 by russellb Loading…
1
Adding cpu inference with VXE ISA for s390x architecture ci/build
#12613 opened Jan 31, 2025 by dilipgb Loading…
1
Fix quark fp8 format loading
#12612 opened Jan 31, 2025 by fxmarty-amd Loading…
1
From Lora Tensors
#12609 opened Jan 31, 2025 by borisshapa Loading…
1
1
[Core][v1] Unify allocating slots in prefill and decode in KV cache manager v1
#12608 opened Jan 31, 2025 by ShawnD200 Loading…
@comaniac
12
[Draft] Qwen2.5-VL frontend v1
#12604 opened Jan 31, 2025 by ywang96 • Draft
2 of 4 tasks
1
@DarkLight1337
1
Implement MLA for deepseek v3/r1
#12597 opened Jan 31, 2025 by yessenzhar Loading…
1
ProTip! What’s not been updated in a month: updated:<2025-01-01.