MiniCPM icon indicating copy to clipboard operation
MiniCPM copied to clipboard
verified publisher icon OpenBMB

[Feature Request]: InfLLM v2特性是否与主流推理框架（如vLLM或SGLang）适配？

Open 2018112767 opened this issue 4 months ago • 1 comments

Feature request / 功能建议

使用vLLM或SGLang运行MiniCPM4模型时，能否开启InfLLM v2特性。如果目前不能，后续是否会发布适配MiniCPM4的vLLM或SGLang项目？

2018112767 avatar Jul 27 '25 15:07 2018112767

sglang 的适配在我们的计划当中了，敬请期待

suhmily10 avatar Aug 04 '25 05:08 suhmily10