Search results

[Bug] inference using local ckpts with pipeline always generation from input instead of chat

Status: Open.

#4213 In InternLM/lmdeploy;

· Ying-Kang opened on Dec 15, 2025

[Feature] LLaDA 2.0 support

Status: Open.

#4211 In InternLM/lmdeploy;

· BigWhitePolarBear opened on Dec 14, 2025

[Bug] lmdeploy_dlinfer/ascend API Server流式输出问题

Status: Open.

#4209 In InternLM/lmdeploy;

· pengjiang80 opened on Dec 12, 2025

[Bug] SDAR模型logprob

Status: Open.

#4206 In InternLM/lmdeploy;

· Auraithm opened on Dec 11, 2025

[Feature] 请求在 TurboMind 引擎中实现 InternVL3 和 Qwen2.5VL 的前缀缓存 (Prefix Caching) 功能

Status: Open.

#4205 In InternLM/lmdeploy;

· mokieli opened on Dec 11, 2025

[Bug]

awaiting response

Status: Open.

#4198 In InternLM/lmdeploy;

· AUTOMATIC2222 opened on Dec 10, 2025

[Bug] torbomind和pytorch 推理qwen2.5 vl 7b 差距较大？

Status: Open.

#4195 In InternLM/lmdeploy;

· AatroxZhou opened on Dec 10, 2025

[Feature]

awaiting response

Status: Open.

#4189 In InternLM/lmdeploy;

· Kai-dev7 opened on Dec 9, 2025

[Feature] Support List[int] (Token IDs) as 'prompt' in OpenAI-compatible '/v1/completions' API

awaiting response

Status: Open.

#4186 In InternLM/lmdeploy;

· shelterwff-byte opened on Dec 8, 2025

[Bug] crash when sleep but not wakeup in version 0.11.0

Status: Open.

#4182 In InternLM/lmdeploy;

· torinchen opened on Dec 4, 2025

[Feature] 使用v0.10.2版本和vllmv0.10.2镜像部署Llama2-7b|13B,tp=1对比差距很大,是应为是啥原因

Status: Open.

#4174 In InternLM/lmdeploy;

· polanpan opened on Dec 1, 2025

[Bug] 如何在910B4 A2 NPU 显卡上基于lmdeploy 部署 INTERNVL-38B, 量化模型,尝试很多方式，都是失败告终

Status: Open.

#4169 In InternLM/lmdeploy;

· mppsk0 opened on Nov 28, 2025