Xiangyu Pan

为什么我在npu上输出的结果不对，请问你是怎么转换成功并进行推理的？

thank you for your work. I successfully installed vllm using your branch. When I start `openai.api_server` and call it, the error AttributeError: `'ActorHandle' object has no attribute 'tokenizer'` occurs, #3301...

When I use a Python script to make a function call, it succeeds regardless of whether the stream is set to true or false. However, when I integrate with the...

同问？

我也出现了和你一样的问题3，请问你解决了吗