Skip to content

Issues: substratusai/kubeai

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

74 Open 100 Closed
74 Open 100 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Consistent Hashing Routing Issue
#447 opened Mar 5, 2025 by liaddrori1
1
Bug in rollout process: duplicate new Pods are created before being removed bug Something isn't working
#442 opened Mar 4, 2025 by nstogner
Question: Can I use Prefix-aware load balancing strategy when model engine is Ollama? question Further information is requested
#441 opened Mar 4, 2025 by leoho0722
3
Update e2e tests to be applicable to any Kubernetes distro - not just kind
#438 opened Mar 3, 2025 by nstogner
Add doc that explains how rollouts are handled
#435 opened Mar 2, 2025 by samos123
Consider supporting individual deployments of the model-proxy and model-operator
#430 opened Mar 1, 2025 by nstogner
Single Model multiple resource profiles
#428 opened Feb 28, 2025 by samos123
Persistent volumes are deleted after shutting down skaffold deployment
#423 opened Feb 26, 2025 by OriaLogic
2
Allow Updating Model URL for Seamless Model Replacement
#422 opened Feb 25, 2025 by liaddrori1
4
Fix CPU vLLM image
#418 opened Feb 20, 2025 by nstogner
1
2
Add support for the SGLang inference engine
#413 opened Feb 16, 2025 by nstogner
Document url / model engine / cache profile compatibility matrix & update validation rules
#411 opened Feb 15, 2025 by nstogner
facebook opt-125m model no longer works with chat completion
#404 opened Feb 13, 2025 by samos123
Specifying TextEmbedding feature should automatically configure vLLM to support embeddings
#400 opened Feb 12, 2025 by nstogner
2
Add PVC support for Infinity engine and ollama engine
#392 opened Feb 10, 2025 by MRColorR
Ollama provide ability to set context length
#385 opened Feb 7, 2025 by samos123
Add doc on using KubeAI with Kafka integration
#381 opened Feb 5, 2025 by samos123
Built-in Ollama example: pulling error from ollama: "stalled; retrying. If this persists"
#378 opened Feb 2, 2025 by gusseppe
2
Support auto configuration based on the Model url
#365 opened Jan 16, 2025 by nstogner
feature: Support self-hosted s3 compatible storage
#361 opened Jan 3, 2025 by erhwenkuo
1
Ensuring Label Propagation to Pods in Helm Chart
#358 opened Dec 23, 2024 by nestoras
2
After additional benchmarking, set PrefixHash as default load balancing strategy
#354 opened Dec 18, 2024 by nstogner
Add KubeAI to Llama Stack Providers
#348 opened Dec 12, 2024 by nstogner
Issue in Lora Adapter Test
#347 opened Dec 11, 2024 by shawnho1018
6
Support using bucket URLs without using a cache profile
#343 opened Dec 7, 2024 by nstogner
2
ProTip! Find all open issues with in progress development work with linked:pr.