Ovis icon indicating copy to clipboard operation
Ovis copied to clipboard

cannot use vllm to infer ovis2.5

Open elisaife opened this issue 8 months ago • 5 comments

Dear author, I use your code providing in readme but always repor t problems like python ovis_test/response.py

Error: HTTP 400

Response: {"error":{"message":"Invalid content type. Supported types for system and user are text, image, video. Invalid content type. Supported types for system and user are text, image, video.","type":"BadRequestError","param":null,"code":400}}

Do you know how to fix it? My model can infernece with transformer method.

elisaife avatar Sep 02 '25 07:09 elisaife

+1

TragedyN avatar Sep 03 '25 03:09 TragedyN

@JumpingRain

TragedyN avatar Sep 03 '25 03:09 TragedyN

@elisaife 我重新从modelscope上下载了权重,就可以了

TragedyN avatar Sep 03 '25 06:09 TragedyN

@elisaife 我重新从modelscope上下载了权重,就可以了

oh thankyou! I solve it but i encounter a new problem, do you know how to forbid enable_thinking?你知道怎么去掉思考过程吗?

elisaife avatar Sep 03 '25 06:09 elisaife

@elisaife 我重新从modelscope上下载了权重,就可以了

I change it in the vllm code providing in reame, but the response still have think.

elisaife avatar Sep 03 '25 06:09 elisaife