CogAgent icon indicating copy to clipboard operation
CogAgent copied to clipboard
Published 9 months ago • verified publisher icon zai-org

vllm_openai_server.py crash

Open azuredsky opened this issue 9 months ago • 2 comments

运行vllm_openai_server.py： Image 我的环境： Image

azuredsky avatar Apr 02 '25 02:04 azuredsky

我在使用vllm启动cogagent时遇到了同样的问题: "ValueError: ChatGLMForConditionalGeneration has no vLLM implementation and the Transformers implementation is not compatible with vLLM." 我的环境是： python3.10.12 vllm0.7.3+empty torch2.5.1 transformers4.50.1

yujin2021 avatar Apr 02 '25 03:04 yujin2021

这个project 有人维护吗?

azuredsky avatar Apr 15 '25 07:04 azuredsky