lmdeploy
lmdeploy copied to clipboard
[Bug] model '/data/InternVL-Chat-V1-5' requires transformers version None but found transformers 4.36.2 installed.
Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
Describe the bug
使用lmdeploy尝试部署InternVL-Chat-V1-5遇到的bug
Reproduction
git clone https://github.com/InternLM/lmdeploy.git cd lmdeploy pip install -e . lmdeploy serve api_server /data/InternVL-Chat-V1-5 --server-port 23333
Environment
python 3.10
transformers 4.36.2
pytorch 2.2.1
cuda 12.2
Error traceback
2024-04-30 07:37:06,501 - lmdeploy - ERROR - TypeError: expected string or bytes-like object
2024-04-30 07:37:06,501 - lmdeploy - ERROR - <transformers> test failed!
model `/data/InternVL-Chat-V1-5` requires transformers version None but transformers 4.36.2 is installed.
We don't support install by pip install .
, please refer to installation guide https://github.com/InternLM/lmdeploy/blob/main/docs/en/build.md
InternVL-Chat-V1-5 is supported in the latest version v0.4.1. Enjoy 😃