PaddleOCR icon indicating copy to clipboard operation
PaddleOCR copied to clipboard

paddlecor-vl vllm 推理报错 Connection error

Open wade0604 opened this issue 2 months ago • 10 comments

🔎 Search before asking

  • [x] I have searched the PaddleOCR Docs and found no similar bug report.
  • [x] I have searched the PaddleOCR Issues and found no similar bug report.
  • [x] I have searched the PaddleOCR Discussions and found no similar bug report.

🐛 Bug (问题描述)

from paddleocr import PaddleOCRVL pipeline = PaddleOCRVL(vl_rec_backend="vllm-server", vl_rec_server_url="http://127.0.0.1:8080/v1", vl_rec_model_dir="/xxx/PaddleOCR-VL-0.9B", layout_detection_model_dir ="xxx//PP-DocLayoutV2" ) image_path = "./xxx.png" output = pipeline.predict(image_path) RuntimeError: Exception from the 'vlm' worker: Connection error.

🏃‍♂️ Environment (运行环境)

paddleocr 3.2 vllm 0.9.2

🌰 Minimal Reproducible Example (最小可复现问题的Demo)

from paddleocr import PaddleOCRVL pipeline = PaddleOCRVL(vl_rec_backend="vllm-server", vl_rec_server_url="http://127.0.0.1:8080/v1", vl_rec_model_dir="/xxx/PaddleOCR-VL-0.9B", layout_detection_model_dir ="xxx//PP-DocLayoutV2" ) image_path = "./xxx.png" output = pipeline.predict(image_path)

wade0604 avatar Oct 20 '25 08:10 wade0604

请问你启动VLM推理服务了吗?

Bobholamovic avatar Oct 20 '25 11:10 Bobholamovic

请问你启动VLM推理服务了吗?

有启动脚本吗

wade0604 avatar Oct 20 '25 11:10 wade0604

可以参考文档中的说明

Bobholamovic avatar Oct 20 '25 11:10 Bobholamovic

@Bobholamovic 你好,上面的客户端请求脚本能之间在windows开发环境使用吗?(相关依赖paddleocr、paddlepaddle已装)

Essence9999 avatar Oct 23 '25 10:10 Essence9999

@Bobholamovic 你好,上面的客户端请求脚本能之间在windows开发环境使用吗?(相关依赖paddleocr、paddlepaddle已装)

在Windows上建议使用WSL或者Docker,我们也在高优适配Windows原生推理中。

Bobholamovic avatar Oct 23 '25 14:10 Bobholamovic

使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.

marslion avatar Nov 01 '25 08:11 marslion

使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.

可以确认一下vlm的服务是否启动起来了

Bobholamovic avatar Nov 03 '25 10:11 Bobholamovic

使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.

可以确认一下vlm的服务是否启动起来了

如何确认vlm有没有起来?我用docker-compose也是这个错误,两个容器显示正常

myholiday avatar Nov 07 '25 14:11 myholiday

使用docker compose 部署,容器已经启动,但是通过访问http://127.0.0.1:8080/layout-parsing接口后,后台api服务报错如下: ERROR: Exception in ASGI application 2025-11-01 16:00:29 Traceback (most recent call last): 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi 2025-11-01 16:00:29 result = await app( # type: ignore[func-returns-value] 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call 2025-11-01 16:00:29 return await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1134, in call 2025-11-01 16:00:29 await super().call(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call 2025-11-01 16:00:29 await self.app(scope, receive, _send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 63, in call 2025-11-01 16:00:29 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 716, in call 2025-11-01 16:00:29 await self.middleware_stack(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 736, in app 2025-11-01 16:00:29 await route.handle(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 290, in handle 2025-11-01 16:00:29 await self.app(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 124, in app 2025-11-01 16:00:29 await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app 2025-11-01 16:00:29 raise exc 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app 2025-11-01 16:00:29 await app(scope, receive, sender) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 110, in app 2025-11-01 16:00:29 response = await f(request) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 390, in app 2025-11-01 16:00:29 raw_response = await run_endpoint_function( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 289, in run_endpoint_function 2025-11-01 16:00:29 return await dependant.call(**values) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_pipeline_apps/paddleocr_vl.py", line 54, in _infer 2025-11-01 16:00:29 result = await pipeline.infer( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 104, in infer 2025-11-01 16:00:29 return await self.call(_infer, *args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 111, in call 2025-11-01 16:00:29 return await fut 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 126, in _worker 2025-11-01 16:00:29 result = func(*args, **kwargs) 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/serving/basic_serving/_app.py", line 95, in _infer 2025-11-01 16:00:29 for item in it: 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/_parallel.py", line 129, in predict 2025-11-01 16:00:29 yield from self._pipeline.predict( 2025-11-01 16:00:29 File "/usr/local/lib/python3.10/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 673, in predict 2025-11-01 16:00:29 raise RuntimeError( 2025-11-01 16:00:29 RuntimeError: Exception from the 'vlm' worker: Connection error.

可以确认一下vlm的服务是否启动起来了

我用的最新镜像,也是报这个错,vlm服务正常

jnn23 avatar Nov 27 '25 01:11 jnn23

我在刚才使用最新的Docker镜像+Docker Compose启动服务,未能复现VLM服务连接异常的错误。请大家尝试如下方式更新镜像:

# 以SM120以下GPU镜像为例,其他环境可根据需要修改tag suffix
docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-vllm-server:latest-offline
docker pull docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-vl:latest-offline

参考文档,下载最新的compose文件以及.env文件:https://www.paddleocr.ai/latest/version3.x/pipeline_usage/PaddleOCR-VL.html#41-docker-compose 。

Bobholamovic avatar Nov 27 '25 03:11 Bobholamovic