CogVLM2 icon indicating copy to clipboard operation
CogVLM2 copied to clipboard
verified publisher icon THUDM

支持 VLLM 推理加速

Open justStarG opened this issue 1 year ago • 0 comments

Feature request / 功能建议

希望 CogVLM2 能够支持 vllm 推理加速

Motivation / 动机

推理速度更快

Your contribution / 您的贡献

https://github.com/vllm-project/vllm

justStarG avatar May 22 '24 10:05 justStarG