InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard
Published 3 months ago • verified publisher icon OpenGVLab

[Feature] InternVL2_5-38B可以用vllm部署吗？

Open xyfZzz opened this issue 1 year ago • 4 comments

Motivation

请问InternVL2_5-38B可以用vllm部署吗？

Related resources

No response

Additional context

No response

xyfZzz avatar Dec 07 '24 09:12 xyfZzz

同问

paulcx avatar Dec 09 '24 07:12 paulcx

+1, waiting

peiliu0408 avatar Dec 10 '24 03:12 peiliu0408

可以临时用 lmdeploy 部署，vllm要等后续的更新

zhouxihong1 avatar Dec 10 '24 09:12 zhouxihong1

可以临时用 lmdeploy 部署，vllm要等后续的更新

您好，请问有计划支持vllm推理吗，目前使用lmdeploy和vllm推理和transformer的结果都有很大的gap，一致性无法解决

Wangman1 avatar Apr 01 '25 08:04 Wangman1

目前vLLM已经支持InternVL的部署了

Weiyun1025 avatar Aug 30 '25 03:08 Weiyun1025