paddlecor-vl vllm 推理报错 Connection error
🔎 Search before asking
- [x] I have searched the PaddleOCR Docs and found no similar bug report.
- [x] I have searched the PaddleOCR Issues and found no similar bug report.
- [x] I have searched the PaddleOCR Discussions and found no similar bug report.
🐛 Bug (问题描述)
from paddleocr import PaddleOCRVL pipeline = PaddleOCRVL(vl_rec_backend="vllm-server", vl_rec_server_url="http://127.0.0.1:8080/v1", vl_rec_model_dir="/xxx/PaddleOCR-VL-0.9B", layout_detection_model_dir ="xxx//PP-DocLayoutV2" ) image_path = "./xxx.png" output = pipeline.predict(image_path) RuntimeError: Exception from the 'vlm' worker: Connection error.
🏃♂️ Environment (运行环境)
paddleocr 3.2 vllm 0.9.2
🌰 Minimal Reproducible Example (最小可复现问题的Demo)
from paddleocr import PaddleOCRVL pipeline = PaddleOCRVL(vl_rec_backend="vllm-server", vl_rec_server_url="http://127.0.0.1:8080/v1", vl_rec_model_dir="/xxx/PaddleOCR-VL-0.9B", layout_detection_model_dir ="xxx//PP-DocLayoutV2" ) image_path = "./xxx.png" output = pipeline.predict(image_path)
请问你启动VLM推理服务了吗?
请问你启动VLM推理服务了吗?
有启动脚本吗
可以参考文档中的说明
@Bobholamovic 你好,上面的客户端请求脚本能之间在windows开发环境使用吗?(相关依赖paddleocr、paddlepaddle已装)
@Bobholamovic 你好,上面的客户端请求脚本能之间在windows开发环境使用吗?(相关依赖paddleocr、paddlepaddle已装)
在Windows上建议使用WSL或者Docker,我们也在高优适配Windows原生推理中。
使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.
使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.
可以确认一下vlm的服务是否启动起来了
使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.
可以确认一下vlm的服务是否启动起来了
如何确认vlm有没有起来?我用docker-compose也是这个错误,两个容器显示正常
使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.
可以确认一下vlm的服务是否启动起来了
我用的最新镜像,也是报这个错,vlm服务正常
我在刚才使用最新的Docker镜像+Docker Compose启动服务,未能复现VLM服务连接异常的错误。请大家尝试如下方式更新镜像:
# 以SM120以下GPU镜像为例,其他环境可根据需要修改tag suffix
docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-vllm-server:latest-offline
docker pull docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-vl:latest-offline
参考文档,下载最新的compose文件以及.env文件:https://www.paddleocr.ai/latest/version3.x/pipeline_usage/PaddleOCR-VL.html#41-docker-compose 。