Bunny

Results 7 comments of Bunny

I have also met this question, have you ever fixed it?

> Hmmm, 这就很奇怪了。我还是复现不出来这个报错。~能否提供一下复现用的请求?~ (看漏了,我再试试) > > 我启动服务的命令: > > ``` > vllm serve OpenGVLab/InternVL3-8B-Instruct --limit-mm-per-prompt.image 2 --tensor-parallel-size 2 --trust-remote-code > ``` > > Request: > > ``` > from openai...

> ### Checklist > * [x] 1. I have searched related issues but cannot get the expected help.[x] 2. The bug has not been fixed in the latest version.[x] 3....

> Openai 格式下 vLLM 输进去 chat template 的 messsage 大概长这样: > > ``` > [{'role': 'system', 'content': [{'type': 'text', 'text': 'You are good at reasoning and problem solving.'}]}, {'role': 'user',...

Have you ever fixed it. I tried to modify the const TEAMLEADER_NAME but it didn't work.