FastGPT icon indicating copy to clipboard operation
FastGPT copied to clipboard

When fastchat+vllm starts the model, the dialogue appears: Chat API is error or undefined

Open leoterry-ulrica opened this issue 1 year ago • 2 comments

fastchat+vllm启动模型的时候,对话出现:Chat API is error or undefined

leoterry-ulrica avatar Dec 04 '23 05:12 leoterry-ulrica

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


When fastchat+vllm starts the model, the dialogue appears: Chat API is error or undefined

c121914yu avatar Dec 04 '23 05:12 c121914yu

没有试过这个组合。可能得更多日志和debug信息。

c121914yu avatar Dec 12 '23 14:12 c121914yu

长时间未响应,暂时关闭。

c121914yu avatar Jan 01 '24 06:01 c121914yu