InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard
Published 3 months ago • verified publisher icon OpenGVLab

I do all thing to deploy a demo on radio, but the server can not load the model

Open chengfengke opened this issue 1 year ago • 4 comments

image image

chengfengke avatar May 16 '24 10:05 chengfengke

Is there any error message when starting the model worker?

czczup avatar May 16 '24 12:05 czczup

2024-05-17 15:30:19 | ERROR | stderr | Traceback (most recent call last): 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/runpy.py", line 196, in _run_module_as_main 2024-05-17 15:30:19 | ERROR | stderr | return _run_code(code, main_globals, None, 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/runpy.py", line 86, in _run_code 2024-05-17 15:30:19 | ERROR | stderr | exec(code, run_globals) 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/Documents/zxh/InternVL/internvl_chat/internvl/serve/model_worker.py", line 307, in 2024-05-17 15:30:19 | ERROR | stderr | worker = ModelWorker(args.controller_address, 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/Documents/zxh/InternVL/internvl_chat/internvl/serve/model_worker.py", line 75, in init 2024-05-17 15:30:19 | ERROR | stderr | self.model = InternVLChatModel.from_pretrained( 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3075, in from_pretrained 2024-05-17 15:30:19 | ERROR | stderr | config, model_kwargs = cls.config_class.from_pretrained( 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/site-packages/transformers/configuration_utils.py", line 612, in from_pretrained 2024-05-17 15:30:19 | ERROR | stderr | return cls.from_dict(config_dict, **kwargs) 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/site-packages/transformers/configuration_utils.py", line 764, in from_dict 2024-05-17 15:30:19 | ERROR | stderr | config = cls(**config_dict) 2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/Documents/zxh/InternVL/internvl_chat/internvl/model/internvl_chat/configuration_internvl_chat.py", line 51, in init 2024-05-17 15:30:19 | ERROR | stderr | if llm_config['architectures'][0] == 'LlamaForCausalLM': 2024-05-17 15:30:19 | ERROR | stderr | KeyError: 'architectures'。Now I got this.

chengfengke avatar May 17 '24 07:05 chengfengke

image is this the architectures?

chengfengke avatar May 17 '24 07:05 chengfengke

image now I got this when I use lmdeploy

chengfengke avatar May 17 '24 09:05 chengfengke

Hello, thank you for your attention. You can now deploy the InternVL2 model following this document: https://internvl.readthedocs.io/en/latest/internvl2.0/deployment.html

czczup avatar Jul 31 '24 08:07 czczup