Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

361 Open 1,354 Closed
361 Open 1,354 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

enable_prefix_caching LMDeploy vs vLLM
#3182 opened Feb 24, 2025 by radna0
[Bug] chat with deepseek v2 lite, response cannot be stopped
#3179 opened Feb 24, 2025 by zhulinJulia24
3 tasks
@lvhan028
1
[Bug] InternVL2_5-26B在使用lmdeploy的pytorch引擎部署的时候，部分图片无法识别，直接报错，有些可以，请问是有尺寸的要求吗？
#3170 opened Feb 21, 2025 by Gierry
3 tasks done
@RunningLeon
2
[Bug] 将InternVL2_5-26B-AWQ转换成turbomind之后使用turbomind引擎 部署 api请求图片解析，参数传递url与base64均报错-无法进行图片识别
#3169 opened Feb 21, 2025 by Gierry
@lvhan028
lmdeploy Internvl2.5-2B 偶尔出现cuDNN error
#3168 opened Feb 21, 2025 by nzomi
1
[Bug] serve does nothing when launching Mistral Small 3 AWQ
#3167 opened Feb 20, 2025 by anunknowperson
3 tasks done
[Bug] non-async call in async fn
#3160 opened Feb 19, 2025 by lz1998
3 tasks done
@grimoire
1
lmdeploy对DeepSeek-R1-Distill-Llama-70B进行api推理时，使用H100的两张显卡，共160G，会出现out of memory
#3154 opened Feb 19, 2025 by winni0
3 tasks done
@lvhan028
2
[Bug] Encountering torch.OutOfMemoryError During int8 Quantization
#3145 opened Feb 16, 2025 by SolomonLeon
3 tasks done
@AllentDan
1
[Bug] api 流式批处理bug 只能得到一个结果，然后卡死。不得不超时强制取消
#3144 opened Feb 15, 2025 by xiezhipeng-git
3 tasks done
@grimoire
8
OOM when use InternVL2_5-1B-MPO
#3143 opened Feb 14, 2025 by BobHo5474
@lvhan028
10
[Feature] old version of outlines 0.0.46, break other packages awaiting response Stale
#3141 opened Feb 13, 2025 by devops724
@AllentDan
2
[Bug] Dockerfile_aarch64_ascend cannot work for docker 18.09 awaiting response Stale
#3140 opened Feb 13, 2025 by bingps
3 tasks done
@jinminxi104
2
[Bug] ERROR - engine.py:904 - Task <MainLoopBackground> failed
#3138 opened Feb 12, 2025 by xiezhipeng-git
3 tasks done
@grimoire
4
Qwen2.5-VL-72B-Instruct can be supported now?
#3132 opened Feb 12, 2025 by lijingcheng2021
@CUHKSZzxy
7
[Feature] 目前无法有效的获得停止词的stop_reason，需要获得停止词stop_reason功能
#3131 opened Feb 11, 2025 by xiezhipeng-git
2
[Bug] lmdeploy Turbomind 推理导致jupyter 崩溃
#3128 opened Feb 10, 2025 by xiezhipeng-git
3 tasks done
@lzhangzz
4
LMDeploy目前支持MiniCPM-o模型吗
#3127 opened Feb 10, 2025 by daihuidai
1
[Bug] 在昇腾310P上加载Qwen AWQ模型时出现参数传递错误
#3124 opened Feb 9, 2025 by cccccya
3 tasks
@jinminxi104
1
[Bug] structed_output cannot be used in cu118 with the lated docker images
#3120 opened Feb 8, 2025 by zhulinJulia24
3 tasks
@CUHKSZzxy
[Feature] ascend 310p上执行图模式
#3119 opened Feb 7, 2025 by yezekun
@jinminxi104 @yao-fengchen
8
310P疑似不支持dist.broadcast操作，如何支持多卡
#3118 opened Feb 7, 2025 by yezekun
@jinminxi104 @yao-fengchen
2
关于InternVL TurbomindEngine 的疑惑
#3111 opened Feb 6, 2025 by chenzhengda
@lvhan028
1
[Bug] pipeline 加载模型时无限期挂起 而命令行部署正常
#3107 opened Jan 31, 2025 by NB-Group
3 tasks done
4
[Bug] CUDA error with Qwen/Qwen2-VL-7B-Instruct
#3101 opened Jan 29, 2025 by andoorve
3 tasks done
1
ProTip! Updated in the last three days: updated:>2025-02-21.