openvino icon indicating copy to clipboard operation
openvino copied to clipboard

[NPU] Change NPUbackends log

Open DanLiu2Intel opened this issue 1 year ago • 3 comments

Details:

  • Update the confusing log in NPUbackends. OpenVINO compilation steps need to use NPU Plugin, NPUbackends and other components. Hope to remove NPUbackends initialization to get a dry execution, but NPUbackends can not be removed or moved. NPUbackends must be used to handle property.
    • Change _logger.error to _logger.warning in NPUBackends constructor
    • Add judgment about available backends in CompiledModel.create_infer_requesrt()

Tickets:

  • E-83001

DanLiu2Intel avatar May 28 '24 07:05 DanLiu2Intel

compilation plugin does not need to initialize level zero backend.

From the log of compile_tool, it seems that compilation does not require initializing zero backend and it can still work. However, from the perspective of the complete compilation process of the code, the constructor of the NPU Plugin needs to initialize the backend , and use the backend to handle properties of plugin and device. If the backend is not initialized in the NPU Plugin, an error will be reported before the Plugin.compile_model() ( the part of the plugin that actually completes the compilation) is called, and the compilation will be return failure. So the initialization of the backend cannot be removed.

Currently, the backend need to be initialized at compilation time, but the executor in the CompiledModel it is not mandatory, and the initialize of executor can be skipped by passing NPU_CREATE_EXECUTOR 0 in configuration or set 'NPU_CREATE_EXECUTOR' environment variable to 0 ( env setting need build openvino with -D ENABLE_DEBUG_CAPS=ON -D ENABLE_NPU_DEBUG_CAPS=ON).

Therefore, there is nothing can be removed components and in the backend constructor, when the Zerobackend initialization fails, the old log is unreasonable, so the log is adjusted. Could you please review it again?

DanLiu2Intel avatar Jun 06 '24 06:06 DanLiu2Intel

build_jenkins

XinWangIntel avatar Jun 07 '24 02:06 XinWangIntel

Test results has attached to here

DanLiu2Intel avatar Jun 14 '24 05:06 DanLiu2Intel

This PR will be closed in a week because of 2 weeks of no activity.

github-actions[bot] avatar Jul 17 '24 00:07 github-actions[bot]

This PR was closed because it has been stalled for 2 week with no activity.

github-actions[bot] avatar Jul 24 '24 00:07 github-actions[bot]