E1203 08:43:48.414558 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version.
出现这个提示,我不确定出现这个提示是会真正运行在了NPU上,是否有影响。
期待解答
会连续出现三个: E1203 08:43:48.096444 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version. E1203 08:43:48.414558 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version. E1203 08:43:48.896029 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version.
安装了pip list | grep paddle paddle-custom-npu 0.0.0 paddle2onnx 1.3.1 paddleocr 2.9.1 paddlepaddle 3.0.0.dev20241130 rapidocr-paddle 1.4.0
能介绍一下你是按照哪个文档进行安装的吗?就是具体用的哪个镜像&安装指令
我们文档中有一些问题(部分文档的内容过时)了,建议使用这个文档安装镜像:https://github.com/PaddlePaddle/PaddleX/blob/release/3.0-beta/docs/tutorials/INSTALL_OTHER_DEVICES.md
然后使用官网首页的安装命令:https://www.paddlepaddle.org.cn/
您好,我用的编译安装npu插件。但没有用官方镜像,我的镜像不方便更换。 https://www.paddlepaddle.org.cn/documentation/docs/zh/guides/hardware_support/npu/install_cn.html
同时:使用健康检查命令,如果是一张卡能成功,如果是8张卡会卡着,或者直接报错
python -c "import paddle; paddle.utils.run_check()"
python -c "import paddle; paddle.utils.run_check()"
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
I1204 01:01:52.890079 49291 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:01:52.890146 49291 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:01:53.574843 49291 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:01:53.580070 49291 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:01:53.580289 49291 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:01:53.580330 49291 init.cc:242] CustomDevice: npu, visible devices count: 8
Running verify PaddlePaddle program ...
I1204 01:01:54.393211 49291 pir_interpreter.cc:1508] New Executor is Running ...
I1204 01:01:54.397958 49291 pir_interpreter.cc:1531] pir interpreter is running by multi-thread mode ...
PaddlePaddle works well on 1 npu.
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
I1204 01:02:04.883134 50327 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:04.883193 50327 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:04.952832 50326 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:04.952888 50326 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:04.970635 50325 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:04.970678 50325 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.007840 50323 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.007879 50323 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.078065 50321 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.078107 50321 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.078111 50322 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.078145 50322 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.113888 50328 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.113945 50328 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.175523 50324 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.175580 50324 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.547490 50327 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.552218 50327 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.552425 50327 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.552465 50327 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.598837 50326 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.598837 50325 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.603399 50326 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.603423 50325 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.603617 50326 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.603637 50325 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.603654 50326 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.603668 50325 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.606782 50323 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.609606 50323 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.609797 50323 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.609830 50323 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.643714 50322 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.646311 50322 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.646483 50322 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.646512 50322 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.657361 50321 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.659858 50321 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.660022 50321 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.660049 50321 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.764190 50328 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.768668 50328 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.768872 50328 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.768909 50328 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.816929 50324 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.821298 50324 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.821498 50324 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.821539 50324 init.cc:242] CustomDevice: npu, visible devices count: 8
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
我测试下来,虽然出现E1203 08:43:48.096444 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version. 但速度也确实提升了的,但在一个地方,NPU比CPU还慢,执行Paddle类text_detector。
您那边方便看下吗,最终目的是要执行text_detector时要快一些。非常感谢!
我知道这个日志的原因了,不在您这,在rapid_table那里。现在的问题是text_detector速度慢有解决方法吗
我知道这个日志的原因了,不在您这,在rapid_table那里。现在的问题是text_detector速度慢有解决方法吗
具体用的是哪个模型呢? 有没有配置过如下环境变量?
export FLAGS_npu_storage_format=0
export FLAGS_use_stride_kernel=0
export FLAGS_allocator_strategy=auto_growth
export FLAGS_npu_scale_aclnn=True
export FLAGS_npu_split_aclnn=True
export FLAGS_npu_jit_compile=false
您好,用的是:ch_PP-OCRv4_det_infer、ch_PP-OCRv4_rec_infer
之前只有了一个环境变量:export FLAGS_npu_jit_compile=false。 又用您提供的环境变量测试了下,速度没有变化
麻烦再问一下具体的使用场景,都使用的是推理是吗?另外是使用ppocr拉起的吗?
都是推理 在ARM架构,910B的环境下。 使用PaddleOCR类初始化模型,然后 执行PaddleOCR.text_detector(),速度比CPU还慢。text_recognizer很快。 CPU一张图片大概0.5s NPU一张图片,2s-1s左右
已经使用环境变量: export FLAGS_npu_jit_compile=0
NPU上kernel第一次运行就是很慢,测速的话建议先warmup再循环多次测平均速度,环境变量加这2个就够了export FLAGS_npu_jit_compile=0 export FLAGS_use_stride_kernel=0
已经计算了平均的时间,确实2s-1s不等,而CPU平均0.8s。 请问您那测试过text_detector嘛,确实有些慢
CANN:8.0.RC2
对同一张图像进行循环测速,速度会正常起来,多张图像循环还是会变慢 参考相关issue https://github.com/PaddlePaddle/Paddle/issues/68107、https://github.com/PaddlePaddle/PaddleX/issues/1929
对同一张图像进行循环测速,速度会正常起来,多张图像循环还是会变慢 参考相关issue https://github.com/PaddlePaddle/Paddle/issues/68107、https://github.com/PaddlePaddle/PaddleX/issues/1929
你好,404