PaddleX
PaddleX copied to clipboard
PaddlePaddle End-to-End Development Toolkit(『飞桨』深度学习全流程开发工具)
在高性能推理中,新增 npu om 后端
## Checklist: - [✔ ] 查找[历史相关issue](https://github.com/PaddlePaddle/PaddleX/issues)寻求解答 - [✔ ] 翻阅[FAQ](https://paddlepaddle.github.io/PaddleX/main/FAQ.html) - [ ✔] 翻阅[PaddleX 文档](https://paddlepaddle.github.io/PaddleX/main/index.html) - [ ✔] 确认bug是否在新版本里还未修复 ## 描述问题 how to pass distributed train config from paddlex cli...
reduce mem
当我paddlex部署在了cuda12.2的版本上时候,运行模型进行预测,连续调用的时候就会报错 `File "/mnt/afs/poc/leadigital_inference_service/services/paddlex_service.py", line 37, in predict for res in output: File "/mnt/afs/miniconda3/envs/paddlex/lib/python3.10/site-packages/paddlex/inference/pipelines/ocr.py", line 69, in predict for det_res in self.text_det_model(input): File "/mnt/afs/miniconda3/envs/paddlex/lib/python3.10/site-packages/paddlex/inference/models/base/basic_predictor.py", line 74, in __call__ yield from super().__call__(input)...
我已经成功PP-ChatOCRv3-doc产线,使用python调用示例,执行第三个api接口时,提示422参数错误,提交参数:{"keys": ["姓名"],"vectorStore": {"vector": [{"words in text block": "常住人口登记卡号\\n ?\\n ?"}]},"llmName": "ernie-3.5","llmParams": {"apiType": "qianfan","apiKey": "ALT*************E380wgu","secretKey": "a523********d2b0"}}