Skip to content

Pull requests: vllm-project/vllm

New pull request New
413 Open 4,394 Closed
413 Open 4,394 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix Baichuan BNB online quantization
#10572 opened Nov 22, 2024 by CNTRYROA Loading…
1
[V1] Refactor model executable interface for multimodal models
#10570 opened Nov 22, 2024 by ywang96 • Draft
3 of 13 tasks
1
[Bugfix] 500 Internal Server Error when tool_choice is incorrect. frontend
#10567 opened Nov 22, 2024 by shenoyvvarun Loading…
2
[Hardware][Intel-Gaudi] Enable LoRA support for Intel Gaudi (HPU)
#10565 opened Nov 22, 2024 by SanjuCSudhakaran Loading…
2
[V1] EngineCore supports profiling ready ONLY add when PR is ready to merge/full CI is needed
#10564 opened Nov 22, 2024 by Abatom Loading…
1
[Model] Added GLM-4 series model support vllm==0.6.4
#10561 opened Nov 22, 2024 by sixsixcoder Loading…
4
[torch.compile] support all attention backends
#10558 opened Nov 22, 2024 by youkaichao Loading…
11
[Benchmark] Benchmark structured output with datasets
#10557 opened Nov 22, 2024 by xuechendi Loading…
4
[Docs] Add dedicated tool calling page to docs documentation Improvements or additions to documentation
#10554 opened Nov 21, 2024 by mgoin Loading…
2
support bitsandbytes quantization with qwen model
#10549 opened Nov 21, 2024 by zixuanzhang226 Loading…
1
[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server frontend
#10546 opened Nov 21, 2024 by angkywilliam Loading…
6
Update default max_num_batch_tokens for chunked prefill to 2048 needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#10544 opened Nov 21, 2024 by mgoin Loading…
2
[Distributed] Tensor Parallel RMSNorm
#10542 opened Nov 21, 2024 by tlrmchlsmth • Draft
2
[Bugfix][Hardware][CPU] Fix multi_modal_kwargs broadcast for CPU tensor parallel ready ONLY add when PR is ready to merge/full CI is needed
#10541 opened Nov 21, 2024 by Isotr0py Loading…
2
For ppc64le, disabled tests for now and addressed space issues ci/build
#10538 opened Nov 21, 2024 by npanpaliya Loading…
2
Add Sageattention backend
#10532 opened Nov 21, 2024 by flozi00 Loading…
3
[Model]: Add support for Aria model documentation Improvements or additions to documentation
#10514 opened Nov 21, 2024 by xffxff Loading…
35
[core] overhaul memory profiling and fix backward compatibility
#10511 opened Nov 21, 2024 by youkaichao Loading…
1
7
[v1] Refactor KVCacheManager for more hash input than token ids ready ONLY add when PR is ready to merge/full CI is needed
#10507 opened Nov 21, 2024 by rickyyx Loading…
19
Turn on V1 for H200 build ci/build perf-benchmarks
#10505 opened Nov 21, 2024 by simon-mo Loading…
1
[Model] Add OLMo November 2024 model documentation Improvements or additions to documentation
#10503 opened Nov 20, 2024 by 2015aroras Loading…
7
[Core] Implement disagg prefill by StatelessProcessGroup ci/build needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#10502 opened Nov 20, 2024 by KuntaiDu Loading…
2
Support softcap in ROCm Flash Attention
#10500 opened Nov 20, 2024 by hliuca Loading…
1
[CI/Build] Dockerfile build for ARM64 / GH200 ci/build documentation Improvements or additions to documentation
#10499 opened Nov 20, 2024 by drikster80 Loading…
1
@simon-mo
3
[Bugfix] GPU memory profiling should be per LLM instance
#10498 opened Nov 20, 2024 by tjohnson31415 • Draft
1
5
ProTip! Updated in the last three days: updated:>2024-11-19.