Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 5
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

365 Open 4,297 Closed
365 Open 4,297 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Misc. bug: Misc. bug: cannot convert GLM-4v-9B- (glm-4v-9b) to GGUF format #11263 bug-unconfirmed
#12266 opened Mar 8, 2025 by bestlee666
1
Eval bug: server API endpoint not respecting n_predict with -2 (until context filled) bug-unconfirmed
#12264 opened Mar 8, 2025 by henryclw
1
Eval bug: Segfault at the end of the cache (cache defragmentation?) bug-unconfirmed
#12259 opened Mar 7, 2025 by cpg314
Eval bug: Llama server <tool_call> is occasionally not parsed as json, and is in content rather than tool_calls bug-unconfirmed
#12256 opened Mar 7, 2025 by jasonmcaffee
1
Misc. bug: convert_hf_to_gguf failing for deepseek-r1 full bug-unconfirmed
#12255 opened Mar 7, 2025 by memory-thrasher
1
Eval bug: garbage output right after kv-cache defragmentation for CPU backend bug-unconfirmed
#12253 opened Mar 7, 2025 by aviallon
17
Misc. bug: llama-server: SegFault with json_schema containing unsupported pattern bug-unconfirmed
#12252 opened Mar 7, 2025 by FWao
Eval bug: QWQ generates repeated text when running with reduced context length bug-unconfirmed
#12251 opened Mar 7, 2025 by remixer-dec
8
Misc. bug: bug-unconfirmed
#12249 opened Mar 7, 2025 by QuickHare
1
Feature Request: Convert deepseek-v3's mtp module to gguf and quantize to q4km enhancement New feature or request
#12242 opened Mar 7, 2025 by qiyuxinlin
4 tasks done
Issues while enabling MMA support on AIX machines
#12240 opened Mar 7, 2025 by mehendarkarprajwal
1
FA bug causes Memory access fault by GPU bug-unconfirmed
#12238 opened Mar 7, 2025 by cb88
3
Prompt eval is 5x slower than in Ollama and maxes out the CPU
#12237 opened Mar 6, 2025 by cpg314
3
Eval bug: Excessive stack usage during tool calling bug-unconfirmed
#12234 opened Mar 6, 2025 by edmcman
9
Eval bug: Phi-4 mini in iOS with xcframework bug-unconfirmed
#12232 opened Mar 6, 2025 by Animaxx
Eval bug: Failed to Load Granite Vision on s390x (llama-llava-cli) bug-unconfirmed
#12225 opened Mar 6, 2025 by taronaeo
2
Misc. bug: ALL gguf models fail to run (no log, docker exit code 139), bug-unconfirmed
#12205 opened Mar 5, 2025 by orchidObsessed
Misc. bug: llama-rpc crashes when deciding memory on CPU with CUDA_VISIBLE_DEVICES="" bug-unconfirmed
#12203 opened Mar 5, 2025 by woof-dog
[Metal] Context init optimization opportunity: metal library is compiled for every llama context Apple Metal https://en.wikipedia.org/wiki/Metal_(API) good first issue Good for newcomers
#12199 opened Mar 5, 2025 by iboB
1
2
Eval bug: Crash on lazy grammar bug-unconfirmed
#12196 opened Mar 5, 2025 by leon-herbrik
1
CUDA: Improve flash decoding kernel occupancy for BS=1 case
#12182 opened Mar 4, 2025 by gaugarg-nv
Misc. bug: [Server] Crashes with a coredump during termination bug-unconfirmed
#12180 opened Mar 4, 2025 by qnixsynapse
Misc. bug: Denial of Service (crash) when using verbose output with input tokens that are not in printable range. bug Something isn't working good first issue Good for newcomers
#12178 opened Mar 4, 2025 by avioligo
1
Eval bug: Server returns 500 error on /api/generate and /api/chat requests bug-unconfirmed
#12176 opened Mar 4, 2025 by blues-alex
1
Misc. bug: HIP compilation together with -DGGML_CPU_ALL_VARIANTS=ON does not load the model or detects the GPU bug-unconfirmed
#12175 opened Mar 4, 2025 by luiznpi
1
ProTip! Add no:assignee to see everything that’s not assigned.