Skip to content

Pull requests: sgl-project/sglang

New pull request New
33 Open 1,763 Closed
33 Open 1,763 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

for test
#2724 opened Jan 3, 2025 by zhyncs • Draft
3 tasks
fix end check
#2723 opened Jan 3, 2025 by jjjjohnson Loading…
3 tasks
1
test: add test_block_fp8 in CI
#2715 opened Jan 2, 2025 by zhyncs • Draft
3 tasks
@zhyncs
chore: bump v0.4.1.post4
#2713 opened Jan 2, 2025 by zhyncs Loading…
3 tasks
@zhyncs
1
WIP: Feature/function calling update
#2700 opened Jan 2, 2025 by YAMY1234 Loading…
4
[Feature] Support regex as a stopping condition
#2699 opened Jan 2, 2025 by MickQian Loading…
3 tasks done
Hierarchical Caching for SGLang enhancement New feature or request
#2693 opened Jan 1, 2025 by xiezhq-hermann Loading…
3 tasks
@Ying1123
2
Support twoshot kernel
#2688 opened Dec 31, 2024 by yizhang2077 Loading…
3 tasks
@zhyncs
Online serving benchmarks [multiturn chat, shared prefix] to multi-tier KV caching
#2665 opened Dec 30, 2024 by PanJason Loading…
5 tasks
@xiezhq-hermann
2
CUDA-graph-compatible releasing and resuming KV cache and model weight memory
#2630 opened Dec 28, 2024 by fzyzcjy Loading…
3 tasks done
3
Support InternVL2 Series
#2629 opened Dec 28, 2024 by amosyou • Draft
3 of 7 tasks
[Feature] support TransformerEngine to enable communication overlap
#2627 opened Dec 28, 2024 by Zhuohao-Li • Draft
2 of 6 tasks
Refactor Scheduler to improve code organization
#2593 opened Dec 26, 2024 by libratiger Loading…
3 tasks done
3
[Feature] Streaming API for Function Calling
#2576 opened Dec 25, 2024 by HaoyuWang4188 • Draft
3 tasks
@Ying1123
5
[Docs] add quantization docs dependencies Pull requests that update a dependency file
#2572 opened Dec 25, 2024 by JamesSand Loading…
3 tasks done
@HandH1998 @zhyncs @zhaochenyang20
42
Refactor SchedulePolicy to improve code organization
#2571 opened Dec 25, 2024 by libratiger Loading…
3 tasks done
@hnyls2002
4
Enable Nvidia's ModelOpt fp8 quantized models high priority quant LLM Quantization
#2535 opened Dec 21, 2024 by Edwardf0t1 Loading…
1 of 3 tasks
@ispobock @zhyncs
12
[Cache Offload] Improve radix cache offload benchmark
#2534 opened Dec 20, 2024 by Edenzzzz • Draft
3 tasks
@xiezhq-hermann
1
[Cache Offload] Remove device sync overhead
#2533 opened Dec 20, 2024 by Edenzzzz Loading…
3 tasks
@xiezhq-hermann
Add generator-style run_batch function await-response
#2513 opened Dec 18, 2024 by xingyaoww Loading…
1
@merrymercy
10
adapt custom allreduce for tensorrt llm high priority
#2511 opened Dec 18, 2024 by yizhang2077 Loading…
3 tasks
@zhyncs
9
fix: add ninja as dependency for flashinfer v0.2 flashinfer high priority
#2501 opened Dec 17, 2024 by zhyncs • Draft
3 tasks
@zhyncs
1
improve performance by removing use_tensor_core dependency await-response
#2496 opened Dec 17, 2024 by bjmsong Loading…
3 tasks
@merrymercy
8
[Experimental] Add a gRPC server for completion request high priority
#2478 opened Dec 13, 2024 by MrAta Loading…
2 of 3 tasks
@Ying1123
21
Add InfiniteBench for long context benchmarking high priority
#2421 opened Dec 9, 2024 by iankur Loading…
2 of 3 tasks
@zhyncs
9
ProTip! Adding no:label will show everything without a label.