allwefantasy
Ubuntu下安装时候报错
auto-coder.chat
🚀 正在初始化系统... ✓ 项目初始化完成。 正在检查Ray状态... ✓ Ray已经在运行。 正在检查deepseek_chat模型可用性... ! deepseek_chat模型不可用。请选择一个提供商： 请输入您的API密钥： sk-by****************************************** 正在使用硅基流动部署deepseek_chat模型... Command Line Arguments:
command : deploy ray_address : auto num_workers : 1 worker_concurrency : 1000 gpus_per_worker : 0.0 cpus_per_worker : 0.001 model_path : pretrained_model_type: saas/openai model : deepseek_chat infer_backend : infer_params : {'saas.base_url': 'https://api.siliconflow.cn/v1', 'saas.api_key': '******', 'saas.model': 'deepseek-ai/deepseek-v2-chat'} file : None
✓ Ray is already running 2024-11-27 23:07:14,509 INFO worker.py:1634 -- Connecting to existing Ray cluster at address: 192.168.1.103:6379... 2024-11-27 23:07:14,516 INFO worker.py:1810 -- Connected to Ray cluster. View the dashboard at 127.0.0.1:8265 模型 deepseek_chat 已经部署过了 正在使用硅基流动部署deepseek_chat模型... Command Line Arguments:
command : deploy ray_address : auto num_workers : 1 worker_concurrency : 1000 gpus_per_worker : 0.0 cpus_per_worker : 0.001 model_path : pretrained_model_type: saas/openai model : deepseek_chat infer_backend : infer_params : {'saas.base_url': 'https://api.siliconflow.cn/v1', 'saas.api_key': '******', 'saas.model': 'deepseek-ai/deepseek-v2-chat'} file : None
✓ Ray is already running 2024-11-27 23:07:14,509 INFO worker.py:1634 -- Connecting to existing Ray cluster at address: 192.168.1.103:6379... 2024-11-27 23:07:14,516 INFO worker.py:1810 -- Connected to Ray cluster. View the dashboard at 127.0.0.1:8265 模型 deepseek_chat 已经部署过了 ✓ 部署完成。 正在验证部署... ✗ 验证失败。模型可能未正确部署。 ! 请尝试使用以下命令手动启动模型： easy-byzerllm chat deepseek_chat 你好 ✓ 初始化完成。
easy-byzerllm chat deepseek_chat 你好
Command Line Arguments:
command : query ray_address : auto model : deepseek_chat query : 你好 template : auto file : None output_file :
✓ Ray is already running 2024-11-27 23:13:52,988 INFO worker.py:1634 -- Connecting to existing Ray cluster at address: 192.168.1.103:6379... 2024-11-27 23:13:52,996 INFO worker.py:1810 -- Connected to Ray cluster. View the dashboard at 127.0.0.1:8265 2024-11-27 23:13:53,665 ERROR serialization.py:462 -- Failed to unpickle serialized exception Traceback (most recent call last): File "/home/dell/.local/lib/python3.10/site-packages/ray/exceptions.py", line 51, in from_ray_exception return pickle.loads(ray_exception.serialized_exception) TypeError: APIStatusError.init() missing 2 required keyword-only arguments: 'response' and 'body'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/dell/.local/lib/python3.10/site-packages/ray/_private/serialization.py", line 460, in deserialize_objects
obj = self._deserialize_object(data, metadata, object_ref)
File "/home/dell/.local/lib/python3.10/site-packages/ray/_private/serialization.py", line 342, in _deserialize_object
return RayError.from_bytes(obj)
File "/home/dell/.local/lib/python3.10/site-packages/ray/exceptions.py", line 45, in from_bytes
return RayError.from_ray_exception(ray_exception)
File "/home/dell/.local/lib/python3.10/site-packages/ray/exceptions.py", line 54, in from_ray_exception
raise RuntimeError(msg) from e
RuntimeError: Failed to unpickle serialized exception
Traceback (most recent call last):
File "/home/dell/.local/bin/easy-byzerllm", line 8, in
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/home/dell/.local/lib/python3.10/site-packages/ray/_private/serialization.py", line 460, in deserialize_objects obj = self._deserialize_object(data, metadata, object_ref) File "/home/dell/.local/lib/python3.10/site-packages/ray/_private/serialization.py", line 342, in _deserialize_object return RayError.from_bytes(obj) File "/home/dell/.local/lib/python3.10/site-packages/ray/exceptions.py", line 45, in from_bytes return RayError.from_ray_exception(ray_exception) File "/home/dell/.local/lib/python3.10/site-packages/ray/exceptions.py", line 54, in from_ray_exception raise RuntimeError(msg) from e RuntimeError: Failed to unpickle serialized exception
参看这篇来排查：https://uelng8wukz.feishu.cn/wiki/CcAgwtL9TiuMEOkGoXbcKE3Gnfb?fromScene=spaceOverview
