openvino
openvino copied to clipboard
Fix performance regression of conformance tests
Details:
-
fix performance regression of conformance tests
Root cause is
make_default_multi_threaded()
API which was refactored in PR22414. This API is used to calculate the number of threads. Master version: When the test machine has both Pcore and Ecore, it recognized the machine type and will select proper cores (Pcores are selected in general machine which pcores >Ecores / 2) to create executor. Old version: the input parameter_threadBindingType
of config was used to judge the type of current machine, and_threadBindingType
is always set to default valueNone
in template plugin. So hybrid core machine is regarded to core machine and physical cores (include Pcores and Ecores) are used._threadBindingType
is deprecated in master now. For example: ADL i9-12900K, 8 Pcore, 8Ecore. Old version: threads=16 in any cores. Master: threads=8 in Pcores. Actually, the threads calculated frommake_default_multi_threaded
of master version is the best option in normal situation which not create multi threads in app side. But in conformance test, 24 threads are created to seize CPU resource. Of cause, all cores are must be used to achieved the best performance. -
fix compile model time slow down when user set streams to
AUTO
Tickets:
- 131820
should we also revert https://github.com/openvinotoolkit/openvino/pull/22735 ?
@sunxiaoxia2022 Please provide details in description regarding root-cause of the issue and how exactly this PR helps to fix it
@sunxiaoxia2022 Please provide details in description regarding root-cause of the issue and how exactly this PR helps to fix it
@dmitry-gorokhov updated in details, please take a look, thank you.
should we also revert #22735 ?
Yes, we can revert it after this PR.
@sunxiaoxia2022 Please add revert of https://github.com/openvinotoolkit/openvino/pull/22735 into this PR