ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

The current vLLM docker image can't support the Qwen 1.5 7B model because of transformer version

Open darshanhuang1 opened this issue 10 months ago • 1 comments

Error message as the screenshot attached. Transformer version is lower than required, but failed after upgraded manually. a6c6e0e7ffc4ddf7447be6f5e70ef8a

darshanhuang1 avatar Apr 08 '24 00:04 darshanhuang1

We have updated image intelanalytics/ipex-llm-serving-vllm-cpu:2.1.0-SNAPSHOT to support model Qwen1.5-7B-Chat with a proper transformers version. You could have a try with this new image.

xiangyuT avatar Apr 08 '24 01:04 xiangyuT

new image is fine, thanks!

darshanhuang1 avatar Apr 12 '24 05:04 darshanhuang1