Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

162 Open 813 Closed
162 Open 813 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] qwen 2 issue when transformers>4.41.2 for PyTorch Engine
#1885 opened Jun 29, 2024 by zhyncs
2 tasks done
1
1
[Feature] blazing great work about KV Cache: Mooncake
#1884 opened Jun 28, 2024 by zhyncs
2
[Bug] 量化时候采取默认参数能够正常推理量化，设置了--search-scale True --batch-size 8，量化后无法推理
#1883 opened Jun 28, 2024 by AIFFFENG
2 tasks
@AllentDan
[Feature] long context inference optimization
#1879 opened Jun 27, 2024 by zhyncs
2
[Feature] support Gemma 2
#1878 opened Jun 27, 2024 by zhyncs
@grimoire
2
[Docs] TurboMind推理引擎与PyTorch推理引擎速度对比
#1872 opened Jun 27, 2024 by LRHstudy
1
[Bug] 不支持qwen0.5b的加速？以及qwen0.5b的awq量化？
#1870 opened Jun 27, 2024 by qism
2 tasks
[Bug] AttributeError: 'LlavaNextConfig' object has no attribute 'hidden_size'
#1868 opened Jun 27, 2024 by zhaozeno
1 of 2 tasks
2
[Bug] internvl 模型被推理后，针对图片内容回答的答案不正确
#1866 opened Jun 27, 2024 by seven1122
1 of 2 tasks
@irexyc
6
使用pipeline加载Qwen1.5-32B-Chat，tp=4，使用openai prompt格式提示其清洗中文但生成回复都是英文
#1864 opened Jun 26, 2024 by Yang-bug-star
使用OpenAI format的输入得到的response要如何提取出回复文本，返回的response好像是分段的
#1863 opened Jun 26, 2024 by Yang-bug-star
2
[Bug] 单轮的图文交错对话的实现原理
#1862 opened Jun 26, 2024 by stay-leave
2 tasks done
1
[Feature] update the range of torch versions
#1857 opened Jun 26, 2024 by zhyncs
1
4
[Bug] Segmentation fault: address not mapped to object at address 0x2058
#1849 opened Jun 25, 2024 by austingg
2 tasks done
@irexyc
4
[Bug] InternLM2MLP.forward() missing 1 required positional argument: 'im_mask'
#1847 opened Jun 25, 2024 by jiangjingz
2 tasks done
@AllentDan
1
如何指定模型的数据类型为f16
#1846 opened Jun 25, 2024 by Yang-bug-star
@lvhan028
1
[Bug] lmdeploy - [31mERROR[0m - Truncate max_new_tokens to 221
#1841 opened Jun 24, 2024 by tairen99
1 of 2 tasks
@lvhan028
7
[Docs] 多模态模型的api_server应该如何多卡部署？
#1840 opened Jun 24, 2024 by red-fox-yj
@irexyc
5
[Feature] How to support bf16 when inferencing Internvl-chat
#1839 opened Jun 24, 2024 by Leo-yang-1020
@irexyc
1
[Bug] qwen2 awq量化微调后的模型报错
#1836 opened Jun 24, 2024 by qiuxuezhe123
2 tasks
@AllentDan
8
使用TurboMind 推理 + Python 代码集成的方式报错
#1835 opened Jun 24, 2024 by zhanghanweii
1 of 2 tasks
5
[Feature] How to support do_sample config just like Automodel 能否像Automodel推理中的do_sample参数支持，支持使用确定性生成方法，而不是随机采样
#1833 opened Jun 23, 2024 by Leo-yang-1020
@irexyc
5
[Bug] smoothquant量化Bacihuan2-7B-Chat模型，无法正常量化
#1831 opened Jun 23, 2024 by CodexDive
2 tasks
@AllentDan
6
[Bug] Qwen-7B-Chat 量化报错 AttributeError: 'RMSNorm' object has no attribute 'variance_epsilon'
#1830 opened Jun 23, 2024 by CodexDive
2 tasks
@AllentDan
1
Nightly Build for LMDeploy
#1828 opened Jun 22, 2024 by zhyncs
4
ProTip! no:milestone will show everything without a milestone.