lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard

[Bug] model '/data/InternVL-Chat-V1-5' requires transformers version None but found transformers 4.36.2 installed.

Open ruifengma opened this issue 9 months ago • 1 comments

Checklist

  • [X] 1. I have searched related issues but cannot get the expected help.
  • [X] 2. The bug has not been fixed in the latest version.

Describe the bug

使用lmdeploy尝试部署InternVL-Chat-V1-5遇到的bug

Reproduction

git clone https://github.com/InternLM/lmdeploy.git cd lmdeploy pip install -e . lmdeploy serve api_server /data/InternVL-Chat-V1-5 --server-port 23333

Environment

python 3.10
transformers 4.36.2
pytorch 2.2.1
cuda 12.2

Error traceback

2024-04-30 07:37:06,501 - lmdeploy - ERROR - TypeError: expected string or bytes-like object
2024-04-30 07:37:06,501 - lmdeploy - ERROR - <transformers> test failed!
model `/data/InternVL-Chat-V1-5` requires transformers version None but transformers 4.36.2 is installed.

ruifengma avatar Apr 30 '24 08:04 ruifengma

We don't support install by pip install ., please refer to installation guide https://github.com/InternLM/lmdeploy/blob/main/docs/en/build.md

irexyc avatar Apr 30 '24 08:04 irexyc

InternVL-Chat-V1-5 is supported in the latest version v0.4.1. Enjoy 😃

lvhan028 avatar May 07 '24 11:05 lvhan028