docker compose 部署 修改 pipeline_config_vllm.yaml 不生效
🔎 Search before asking
- [x] I have searched the PaddleOCR Docs and found no similar bug report.
- [x] I have searched the PaddleOCR Issues and found no similar bug report.
- [x] I have searched the PaddleOCR Discussions and found no similar bug report.
🐛 Bug (问题描述)
把 pipeline_config_vllm.yaml 映射到 volumes了 加上 Serving: visualize: False extra: max_num_input_imgs: null 但是没有生效 还是返回 pdf还是只返回十页 并且 每次返回图片
pipelin_config_vllm.yaml:
pipeline_name: PaddleOCR-VL
batch_size: 64
use_queues: True
use_doc_preprocessor: False use_layout_detection: True use_chart_recognition: False format_block_content: False
SubModules: LayoutDetection: module_name: layout_detection model_name: PP-DocLayoutV2 model_dir: null batch_size: 8 threshold: 0: 0.5 # abstract 1: 0.5 # algorithm 2: 0.5 # aside_text 3: 0.5 # chart 4: 0.5 # content 5: 0.4 # formula 6: 0.4 # doc_title 7: 0.5 # figure_title 8: 0.5 # footer 9: 0.5 # footer 10: 0.5 # footnote 11: 0.5 # formula_number 12: 0.5 # header 13: 0.5 # header 14: 0.5 # image 15: 0.4 # formula 16: 0.5 # number 17: 0.4 # paragraph_title 18: 0.5 # reference 19: 0.5 # reference_content 20: 0.45 # seal 21: 0.5 # table 22: 0.4 # text 23: 0.4 # text 24: 0.5 # vision_footnote layout_nms: True layout_unclip_ratio: [1.0, 1.0] layout_merge_bboxes_mode: 0: "union" # abstract 1: "union" # algorithm 2: "union" # aside_text 3: "large" # chart 4: "union" # content 5: "large" # display_formula 6: "large" # doc_title 7: "union" # figure_title 8: "union" # footer 9: "union" # footer 10: "union" # footnote 11: "union" # formula_number 12: "union" # header 13: "union" # header 14: "union" # image 15: "large" # inline_formula 16: "union" # number 17: "large" # paragraph_title 18: "union" # reference 19: "union" # reference_content 20: "union" # seal 21: "union" # table 22: "union" # text 23: "union" # text 24: "union" # vision_footnote VLRecognition: module_name: vl_recognition model_name: PaddleOCR-VL-0.9B model_dir: null batch_size: 4096 genai_config: backend: vllm-server server_url: http://paddleocr-genai-vllm-server:8080/v1 Serving: visualize: False extra: max_num_input_imgs: null SubPipelines: DocPreprocessor: pipeline_name: doc_preprocessor batch_size: 8 use_doc_orientation_classify: True use_doc_unwarping: True SubModules: DocOrientationClassify: module_name: doc_text_orientation model_name: PP-LCNet_x1_0_doc_ori model_dir: null batch_size: 8 DocUnwarping: module_name: image_unwarping model_name: UVDoc model_dir: null
🏃♂️ Environment (运行环境)
docker compose: services: paddleocr-vl-api: image: paddleocr-vl-api:latest container_name: paddleocr-vl-api ports: - 8118:8080 depends_on: paddleocr-genai-vllm-server: condition: service_healthy volumes: - /data/paddleocr/volumes/pipeline_config_vllm.yaml:/home/paddleocr/pipeline_config_vllm.yaml deploy: resources: reservations: devices: - driver: nvidia device_ids: ["0"] capabilities: [gpu] restart: unless-stopped healthcheck: test: ["CMD-SHELL", "curl -f http://localhost:8080/health || exit 1"]
paddleocr-genai-vllm-server: image: ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-vllm-server:latest-offline container_name: paddleocr-genai-vllm-server deploy: resources: reservations: devices: - driver: nvidia device_ids: ["0"] capabilities: [gpu] restart: unless-stopped healthcheck: test: ["CMD-SHELL", "curl -f http://localhost:8080/health || exit 1"] start_period: 300s
🌰 Minimal Reproducible Example (最小可复现问题的Demo)
使用大于10页的PDF调用接口
是不是配置错位置了,参考:https://github.com/PaddlePaddle/PaddleOCR/pull/16955
配置完重启了吗?
您好,我也遇到这个问题了,确认重启了,但是还是只处理了pdf的前10张图
我也遇到了同样的问题,确认重启了,进入容器内部看确实也改了,但是没生效
我的解决了,看源码就是读的serving,所以在这几个位置都加上了,不确定是哪个生效了
找到问题了,他不支持null 支持数字。改成100000000
这是截图, 我也是参照你的pr配置的,但是没有生效。