[BUG] 简洁阐述问题 / Concise description of the issue

[Yogier]

server_config.py文件中此处改为CPU后加载不出来： "chatglm3-6b": { "device": "cuda", },

以下为加载内容：

(langchain) [root@localhost Langchain-Chatchat]# python startup.py -a

==============================Langchain-Chatchat Configuration============================== 操作系统：Linux-3.10.0-1160.102.1.el7.x86_64-x86_64-with-glibc2.17. python版本：3.11.8 (main, Feb 26 2024, 21:39:34) [GCC 11.2.0] 项目版本：v0.2.10 langchain版本：0.0.354. fastchat版本：0.2.35

当前使用的分词器：ChineseRecursiveTextSplitter 当前启动的LLM模型：['chatglm3-6b', 'zhipu-api', 'openai-api'] @ cpu {'device': 'cpu', 'host': '0.0.0.0', 'infer_turbo': False, 'model_path': 'chatglm3-6b', 'model_path_exists': True, 'port': 20002} {'api_key': '', 'device': 'cpu', 'host': '0.0.0.0', 'infer_turbo': False, 'online_api': True, 'port': 21001, 'provider': 'ChatGLMWorker', 'version': 'glm-4', 'worker_class': <class 'server.model_workers.zhipu.ChatGLMWorker'>} {'api_base_url': 'https://api.openai.com/v1', 'api_key': '', 'device': 'cpu', 'host': '0.0.0.0', 'infer_turbo': False, 'model_name': 'gpt-4', 'online_api': True, 'openai_proxy': '', 'port': 20002} 当前Embbedings模型： bge-large-zh @ cpu ==============================Langchain-Chatchat Configuration==============================

2024-03-18 08:39:34,778 - startup.py[line:655] - INFO: 正在启动服务： 2024-03-18 08:39:34,778 - startup.py[line:656] - INFO: 如需查看 llm_api 日志，请前往 /root/Langchain-Chatchat/logs /root/anaconda3/envs/langchain/lib/python3.11/site-packages/langchain_core/_api/deprecation.py:117: LangChainDeprecationWarning: 模型启动功能将于 Langchain-Chatchat 0.3.x重写,支持更多模式和加速启动，0.2.x中相关功能将废弃 warn_deprecated( 2024-03-18 08:39:42 | INFO | model_worker | Register to controller 2024-03-18 08:39:43 | ERROR | stderr | INFO: Started server process [3321] 2024-03-18 08:39:43 | ERROR | stderr | INFO: Waiting for application startup. 2024-03-18 08:39:43 | ERROR | stderr | INFO: Application startup complete. 2024-03-18 08:39:43 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:20000 (Press CTRL+C to quit) 2024-03-18 08:39:44 | INFO | model_worker | Loading the model ['chatglm3-6b'] on worker 657c3552 ... 2024-03-18 08:39:45 | WARNING | transformers_modules.THUDM.chatglm3-6b.9addbe01105ca1939dd60a0e5866a1812be9daea.tokenization_chatglm | Setting eos_token is not supported, use the default one. 2024-03-18 08:39:45 | WARNING | transformers_modules.THUDM.chatglm3-6b.9addbe01105ca1939dd60a0e5866a1812be9daea.tokenization_chatglm | Setting pad_token is not supported, use the default one. 2024-03-18 08:39:45 | WARNING | transformers_modules.THUDM.chatglm3-6b.9addbe01105ca1939dd60a0e5866a1812be9daea.tokenization_chatglm | Setting unk_token is not supported, use the default one. Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s] Loading checkpoint shards: 14%|██▌ | 1/7 [00:16<01:40, 16.80s/it] Loading checkpoint shards: 29%|█████▏ | 2/7 [00:46<02:03, 24.66s/it] Loading checkpoint shards: 43%|███████▋ | 3/7 [00:55<01:09, 17.45s/it]

//后续加载不出来了。