Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

180 Open 1,347 Closed
180 Open 1,347 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

sensevoice的timestamp功能 feature
#2688 opened Dec 18, 2024 by leslie2046 v1.x
1
启动报错
#2687 opened Dec 18, 2024 by feifei05
3 tasks
v1.x
1
期待集成DeepSeek-VL2 feature
#2686 opened Dec 18, 2024 by moshilangzi v1.x
Xin cannot perceive whether the service is running normally. gpu
#2685 opened Dec 18, 2024 by liuzhenghua
1 of 3 tasks
v1.x
1
报错Segmentation fault (core dumped) gpu
#2682 opened Dec 17, 2024 by SKKKKYLAR
1 of 3 tasks
v1.x
1
GOT-OCR2.0模型运行出现问题 gpu
#2679 opened Dec 16, 2024 by zjx140
1 of 3 tasks
v1.x
1
对于系统上的一些参数，文档上描述不是很全面，麻烦解答一下
#2676 opened Dec 16, 2024 by nopipifish
1 of 3 tasks
v1.x
1
xinference模型每次重启完可以正常回答，过一段时间对话一直转圈 gpu
#2674 opened Dec 16, 2024 by jiusi9
1 of 3 tasks
v1.x
2
请求增加优先级参数，优先调度高优先级的请求 feature pr welcome
#2669 opened Dec 13, 2024 by 781574155 v1.x
4
qwen2.5-7B-instruct-AWQ 推理报错 __pydantic_core_schema__ gpu
#2666 opened Dec 13, 2024 by hqm19
1 of 3 tasks
v1.x
1
平台对接stable-diffusion-3.5-large 建议 feature
#2664 opened Dec 13, 2024 by zhangjianquan v1.x
1
期待集成InternVL2.5-78B feature
#2662 opened Dec 13, 2024 by watch-Ultra v1.x
1
Supporting Cline requests style. feature help wanted Extra attention is needed pr welcome
#2659 opened Dec 12, 2024 by gahoo v1.x
9
当上下文过长时会出现model not found报错在模型名称自动添加后缀“-1-0” gpu
#2653 opened Dec 11, 2024 by zmalqp189
1 of 3 tasks
v1.x
3
ffmpeg was not found but is required to load audio files from filename
#2652 opened Dec 10, 2024 by zjxxsr
1 of 3 tasks
v1.x
2
Xinference 基于vLLM并不支持多卡推理 gpu
#2651 opened Dec 10, 2024 by LRCgtp
3 tasks
v1.x
2
whisper的推理api报错
#2650 opened Dec 10, 2024 by closer-finger
1 of 3 tasks
v1.x
1
xinference显存溢出后llm还在运行状态但api不可用 gpu help wanted Extra attention is needed pr welcome
#2648 opened Dec 10, 2024 by YiLin198
1 of 3 tasks
v1.x
1
集群模式下注册自定义模型启动时会提示not found的问题 gpu
#2645 opened Dec 10, 2024 by DawnOf1996
1 of 3 tasks
v1.x
2
在系统上部署bge-reranker-v2-m3一类的rerank模型，有的时候会报错server close gpu stale
#2644 opened Dec 9, 2024 by nopipifish
1 of 3 tasks
v1.x
4
报错 : 'NoneType' object is not iterable stale
#2643 opened Dec 9, 2024 by hsoftxl
1 of 3 tasks
v1.x
2
在版本1.0.1中，无法运行qwen2_vl大模型，报告xinference.core.worker Leave launch_builtin_model, error: [address=0.0.0.0:42695, pid=88] cannot import name 'Qwen2VLForConditionalGeneration' from 'transformers' (/opt/conda/lib/python3.11/site-packages/transformers/__init__.py),
#2642 opened Dec 9, 2024 by zhudemiao
1 of 3 tasks
v1.x
8
大模型（vllm引擎推理）运行时间久了显存会增加且无法下降 gpu
#2639 opened Dec 9, 2024 by turndown
1 of 3 tasks
v1.x
2
launch失败 gpu
#2633 opened Dec 6, 2024 by Readyou123
1 of 3 tasks
v1.x
1
建议增加xgrammar结构化输出支持 feature
#2620 opened Dec 2, 2024 by ZanePoe v1.x
4
ProTip! Mix and match filters to narrow down what you’re looking for.