-
Notifications
You must be signed in to change notification settings - Fork 523
Issues: sgl-project/sglang
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] Unable to load GPTQ Mixtral 8x7 v0.1 with SGLang
#2117
opened Nov 22, 2024 by
DhruvaBansal00
5 tasks done
[Bug] Qwen2-VL-7B with sglang Performance Degradation on MME benchmark
#2112
opened Nov 21, 2024 by
Mr-Loevan
5 tasks done
[Bug] RuntimeError: Failed to allocate memory for batch_prefill_tmp_v with size 435814400 and alignment 16 in AlignedAllocator
#2102
opened Nov 20, 2024 by
yuki252111
1 of 5 tasks
[Bug] big TPOT and ITL when running the offline benchmark
#2097
opened Nov 20, 2024 by
TraceIvan
5 tasks done
[Bug] disk cache io error when simultaneously loading lots of sglang offline engine
#2090
opened Nov 19, 2024 by
LeeSureman
5 tasks done
[Feature, Performance] kv cache performance improvement
#2087
opened Nov 19, 2024 by
HaiShaw
2 tasks done
[Bug] Qwen-2.5-Math-7B-Instruct and Llama-3.1-8B-Instruct Produce Nonsensical Results
#2084
opened Nov 18, 2024 by
Broyojo
5 tasks done
[Performance] why so many bubbles between steps when running llava-one-vision?
#2076
opened Nov 18, 2024 by
sleepwalker2017
[Feature] Add Dockerfile.dev for development purposes
backlog
#2060
opened Nov 17, 2024 by
zhyncs
2 tasks
[Bug] lmms-lab/llava-onevision-qwen2-7b-ov-chat. Missing file dependencies, no preprocessor_config.json processor_config.json
#2057
opened Nov 17, 2024 by
zhangucan
5 tasks done
[BUG] Jump forward w/ outlines backend slightly changes the decoding results
grammar-backend
#2025
opened Nov 13, 2024 by
merrymercy
[BUG] xgrammar does not follow the constraint
grammar-backend
#2017
opened Nov 12, 2024 by
merrymercy
[Feature] Regex stop condition
good first issue
Good for newcomers
#2007
opened Nov 11, 2024 by
SinanAkkoyun
2 tasks done
[Feature] Are there plans to support AWQ and torch compile?
#1991
opened Nov 11, 2024 by
sitabulaixizawaluduo
2 tasks done
[Bug] amdgpu,tp-size=2,Detected errors during sampling! NaN in the logits.
amd
#1953
opened Nov 8, 2024 by
linqingxu
5 tasks done
[Feature] Add LoRA Support for Chat Completion in SGLang
good first issue
Good for newcomers
#1936
opened Nov 6, 2024 by
mssongit
2 tasks done
Previous Next
ProTip!
Mix and match filters to narrow down what you’re looking for.