kagentlms_baichuan2_13b_mat无法用fastchat部署

[FanWan]

hello，我下载了kagentlms_baichuan2_13b_mat模型，但是没办法通过fastchat部署，，以下是报错：

2024-03-11 22:02:00 | INFO | model_worker | args: Namespace(host='192.168.80.2', port=9015, worker_address='http://192.168.80.2:9015', controller_address='http://192.168.80.2:9083', model_path='/home/ssd1/record/llm_models/kagentlms_baichuan2_13b_mat/', revision='main', device='cuda', gpus=None, num_gpus=1, max_gpu_memory=None, dtype=None, load_8bit=False, cpu_offloading=False, gptq_ckpt=None, gptq_wbits=16, gptq_groupsize=-1, gptq_act_order=False, awq_ckpt=None, awq_wbits=16, awq_groupsize=-1, model_names=['kwai_agent_baichuan'], conv_template=None, embed_in_truncate=False, limit_worker_concurrency=5, stream_interval=2, no_register=False, seed=None) 2024-03-11 22:02:00 | INFO | model_worker | Loading the model ['kwai_agent_baichuan'] on worker a59d1063 ... Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat. 2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last): 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 203, in _new_conn 2024-03-11 22:02:03 | ERROR | stderr | sock = connection.create_connection( 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection 2024-03-11 22:02:03 | ERROR | stderr | raise err 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 73, in create_connection 2024-03-11 22:02:03 | ERROR | stderr | sock.connect(sa) 2024-03-11 22:02:03 | ERROR | stderr | OSError: [Errno 101] Network is unreachable 2024-03-11 22:02:03 | ERROR | stderr | 2024-03-11 22:02:03 | ERROR | stderr | The above exception was the direct cause of the following exception: 2024-03-11 22:02:03 | ERROR | stderr | 2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last): 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 790, in urlopen 2024-03-11 22:02:03 | ERROR | stderr | response = self._make_request( 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 491, in _make_request 2024-03-11 22:02:03 | ERROR | stderr | raise new_e 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 467, in _make_request 2024-03-11 22:02:03 | ERROR | stderr | self._validate_conn(conn) 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1092, in _validate_conn 2024-03-11 22:02:03 | ERROR | stderr | conn.connect() 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 611, in connect 2024-03-11 22:02:03 | ERROR | stderr | self.sock = sock = self._new_conn() 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 218, in _new_conn 2024-03-11 22:02:03 | ERROR | stderr | raise NewConnectionError( 2024-03-11 22:02:03 | ERROR | stderr | urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f9aaccac430>: Failed to establish a new connection: [Errno 101] Network is unreachable

Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat. 我已经在下好模型文件了啊