openvino
openvino copied to clipboard
[AUTO] Update logic of setting TPUT by default for MULTI and AUTO.
Signed-off-by: Wang, Yang [email protected]
Details:
- set TPUT by default for MULTI when user doesn't specify any below properties
ov::inference_num_threads
ov::num_streams
ov::affintity
ov::hint::performance_mode
- Update logic of the TPUT default setting for AUTO
Tickets:
- CVS-87444
Please double check if we need additional change in benchmark_app when benchmark use MULTI:GPU,CPU with Latency hint.