LongBench icon indicating copy to clipboard operation
LongBench copied to clipboard

Error code: 404 - {'object': 'error', 'message': 'The model `/dev/shm/glm-4-9b-chat/` does not exist.', 'type': 'NotFoundError', 'param': None, 'code': 404}

Open guanzy2012 opened this issue 11 months ago • 1 comments

按照教程改了路径和config,但是啊起vllm服务报错

guanzy2012 avatar Jan 18 '25 01:01 guanzy2012

请参考这个文档:https://docs.vllm.ai/en/latest/getting_started/quickstart.html 确保部署服务时的模型路径和调用时的模型名称一致。

bys0318 avatar Jan 23 '25 05:01 bys0318