leechao1981

the consel： 2023-11-21 13:52:57,022 xinference.core.supervisor 50309 INFO Xinference supervisor 127.0.0.1:23432 started 2023-11-21 13:52:57,023 xinference.core.supervisor 50309 DEBUG Enter add_worker, args: (, '127.0.0.1:23432'), kwargs: {} 2023-11-21 13:52:57,023 xinference.core.supervisor 50309 DEBUG Worker 127.0.0.1:23432...

Name: xinference Version: 0.6.1 Summary: Model Serving Made Easy Home-page: https://github.com/xorbitsai/inference Author: Qin Xuye Author-email: [email protected] License: Apache License 2.0 Location: /Users/lichao/opt/anaconda3/envs/AICHAT/lib/python3.8/site-packages Requires: click, fastapi, fsspec, gradio, huggingface-hub, modelscope, pydantic,...

how to uninstall chatglm_cpp？

我重装了chatglm_cpp，但是，仍然是这样 2023-11-21 17:11:27,384 xinference.model.llm.llm_family 8847 INFO Caching from Hugging Face: Xorbits/chatglm2-6B-GGML 2023-11-21 17:11:27,385 xinference.model.llm.core 8847 DEBUG Launching f3773800-884d-11ee-a2e5-6145fbabc579-1-0 with ChatglmCppChatModel 2023-11-21 17:11:30,979 xinference.core.worker 8847 ERROR Failed to load model f3773800-884d-11ee-a2e5-6145fbabc579-1-0...

额 一样 2023-11-22 09:53:50,097 xinference.core.worker 17816 ERROR Failed to load model 5de77f30-88d8-11ee-b7f9-81d878488341-1-0 Traceback (most recent call last): File "/Users/lichao/opt/anaconda3/envs/AICHAT/lib/python3.8/site-packages/xinference/core/worker.py", line 251, in launch_builtin_model await model_ref.load() File "/Users/lichao/opt/anaconda3/envs/AICHAT/lib/python3.8/site-packages/xoscar/backends/context.py", line 226, in...

>>> import chatglm_cpp >>> pipeline = chatglm_cpp.Pipeline("~/.xinference/cache/chatglm3-ggmlv3-6b/chatglm3-ggml-q4_0.bin") pipeline.chat(["你好"]) Traceback (most recent call last): File "", line 1, in File "/Users/lichao/opt/anaconda3/envs/AICHAT/lib/python3.8/site-packages/chatglm_cpp/__init__.py", line 24, in __init__ convert(f, model_path, dtype=dtype) File "/Users/lichao/opt/anaconda3/envs/AICHAT/lib/python3.8/site-packages/chatglm_cpp/convert.py", line...