System Info / 系統信息

python-3.11.1

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？

[ ] docker / docker
[x] pip install / 通过 pip install 安装
[ ] installation from source / 从源码安装

Version info / 版本信息

xinference, version 1.4.1

The command used to start Xinference / 用以启动 xinference 的命令

可以直接安装

Reproduction / 复现过程

^^^^^^^^^^^^^^^^^

File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/ruamel/yaml/constructor.py", line 183, in construct_non_recursive_object data = constructor(self, tag_suffix, node) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/hyperpyyaml/core.py", line 472, in _construct_object raise ImportError("There is no such class as %s" % callable_string) ^^^^^^^^^^^^^^^^^ ImportError: [address=0.0.0.0:41645, pid=2553233] There is no such class as cosyvoice.flow.decoder.CausalConditionalDecoder 2025-04-09 10:52:42,104 uvicorn.access 2417451 INFO 14.23.51.58:55585 - "POST /v1/models HTTP/1.1" 500 2025-04-09 10:55:39,221 xinference.core.worker 2417588 INFO [request 1e562210-14ee-11f0-859d-bcfce7637c8f] Enter launch_builtin_model, args: <xinference.core.worker.WorkerActor object at 0x7fe165b38350>, kwargs: model_uid=CosyVoice2-0.5B-0,model_name=CosyVoice2-0.5B,model_size_in_billions=None,model_format=None,quantization=None,model_engine=None,model_type=audio,n_gpu=auto,request_limits=None,peft_model_config=None,gpu_idx=None,download_hub=modelscope,model_path=None,xavier_config=None 2025-04-09 11:08:48,926 xinference.core.model 2553471 INFO Start requests handler. 2025-04-09 11:08:49,121 xinference.model.audio.cosyvoice 2553471 INFO Loading CosyVoice model, compile=False... 2025-04-09 11:08:49,122 xinference.core.worker 2417588 ERROR Failed to load model CosyVoice2-0.5B-0 Traceback (most recent call last): File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/worker.py", line 926, in launch_builtin_model await model_ref.load() File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 231, in send return self._process_result_message(result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message raise message.as_instanceof_cause() File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 667, in send result = await self._run_coro(message.message_id, coro) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro return await coro File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/api.py", line 384, in on_receive return await super().on_receive(message) # type: ignore ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 558, in on_receive raise ex File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.on_receive async with self._lock: ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.on_receive with debug_async_timeout('actor_lock_timeout', ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.on_receive result = await result ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/model.py", line 466, in load self._model.load() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/model/audio/cosyvoice.py", line 72, in load self._model = CosyVoice(self._model_path, load_jit=load_jit) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/model/audio/../../thirdparty/cosyvoice/cli/cosyvoice.py", line 144, in init with open('{}/cosyvoice.yaml'.format(model_dir), 'r') as f: ^^^^^^^^^^^^^^^^^ FileNotFoundError: [address=0.0.0.0:36819, pid=2553471] [Errno 2] No such file or directory: '/home/tank/xinference/cache/CosyVoice2-0.5B/cosyvoice.yaml' 2025-04-09 11:08:49,150 xinference.core.worker 2417588 ERROR [request 1e562210-14ee-11f0-859d-bcfce7637c8f] Leave launch_builtin_model, error: [address=0.0.0.0:36819, pid=2553471] [Errno 2] No such file or directory: '/home/tank/xinference/cache/CosyVoice2-0.5B/cosyvoice.yaml', elapsed time: 789 s Traceback (most recent call last): File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/utils.py", line 93, in wrapped ret = await func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/worker.py", line 926, in launch_builtin_model await model_ref.load() File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 231, in send return self._process_result_message(result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message raise message.as_instanceof_cause() File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 667, in send result = await self._run_coro(message.message_id, coro) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro return await coro File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/api.py", line 384, in on_receive return await super().on_receive(message) # type: ignore ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 558, in on_receive raise ex File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.on_receive async with self._lock: ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.on_receive with debug_async_timeout('actor_lock_timeout', ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.on_receive result = await result ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/model.py", line 466, in load self._model.load() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/model/audio/cosyvoice.py", line 72, in load self._model = CosyVoice(self._model_path, load_jit=load_jit) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/model/audio/../../thirdparty/cosyvoice/cli/cosyvoice.py", line 144, in init with open('{}/cosyvoice.yaml'.format(model_dir), 'r') as f: ^^^^^^^^^^^^^^^^^ FileNotFoundError: [address=0.0.0.0:36819, pid=2553471] [Errno 2] No such file or directory: '/home/tank/xinference/cache/CosyVoice2-0.5B/cosyvoice.yaml' 2025-04-09 11:08:49,152 xinference.api.restful_api 2417451 ERROR [address=0.0.0.0:36819, pid=2553471] [Errno 2] No such file or directory: '/home/tank/xinference/cache/CosyVoice2-0.5B/cosyvoice.yaml' Traceback (most recent call last): File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/api/restful_api.py", line 1002, in launch_model model_uid = await (await self._get_supervisor_ref()).launch_builtin_model( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 231, in send return self._process_result_message(result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message raise message.as_instanceof_cause() File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 667, in send result = await self._run_coro(message.message_id, coro) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro return await coro File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/api.py", line 384, in on_receive return await super().on_receive(message) # type: ignore ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 558, in on_receive raise ex File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.on_receive async with self._lock: ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.on_receive with debug_async_timeout('actor_lock_timeout', ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.on_receive result = await result ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/supervisor.py", line 1190, in launch_builtin_model await _launch_model() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/supervisor.py", line 1125, in _launch_model subpool_address = await _launch_one_model( ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/supervisor.py", line 1083, in _launch_one_model subpool_address = await worker_ref.launch_builtin_model( ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 231, in send return self._process_result_message(result) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message raise message.as_instanceof_cause() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 667, in send result = await self._run_coro(message.message_id, coro) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro return await coro File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/api.py", line 384, in on_receive return await super().on_receive(message) # type: ignore ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 558, in on_receive raise ex File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.on_receive async with self._lock: ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.on_receive with debug_async_timeout('actor_lock_timeout', ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.on_receive result = await result ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/utils.py", line 93, in wrapped ret = await func(*args, **kwargs) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/worker.py", line 926, in launch_builtin_model await model_ref.load() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 231, in send return self._process_result_message(result) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message raise message.as_instanceof_cause() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 667, in send result = await self._run_coro(message.message_id, coro) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro return await coro File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xoscar/api.py", line 384, in on_receive return await super().on_receive(message) # type: ignore ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 558, in on_receive raise ex File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.on_receive async with self._lock: ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.on_receive with debug_async_timeout('actor_lock_timeout', ^^^^^^^^^^^^^^^^^ File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.on_receive result = await result ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/core/model.py", line 466, in load self._model.load() ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/model/audio/cosyvoice.py", line 72, in load self._model = CosyVoice(self._model_path, load_jit=load_jit) ^^^^^^^^^^^^^^^^^ File "/home/tank/miniconda3/envs/xinference/lib/python3.11/site-packages/xinference/model/audio/../../thirdparty/cosyvoice/cli/cosyvoice.py", line 144, in init with open('{}/cosyvoice.yaml'.format(model_dir), 'r') as f: ^^^^^^^^^^^^^^^^^ FileNotFoundError: [address=0.0.0.0:36819, pid=2553471] [Errno 2] No such file or directory: '/home/tank/xinference/cache/CosyVoice2-0.5B/cosyvoice.yaml' 2025-04-09 11:08:49,152 uvicorn.access 2417451 INFO 14.23.51.58:55697 - "POST /v1/models HTTP/1.1" 500