openvino icon indicating copy to clipboard operation
openvino copied to clipboard

[AUTO] Update logic of setting TPUT by default for MULTI and AUTO.

Open yangwang201911 opened this issue 2 years ago • 1 comments

Signed-off-by: Wang, Yang [email protected]

Details:

  • set TPUT by default for MULTI when user doesn't specify any below properties
ov::inference_num_threads
ov::num_streams
ov::affintity
ov::hint::performance_mode
  • Update logic of the TPUT default setting for AUTO

Tickets:

  • CVS-87444

yangwang201911 avatar Jul 25 '22 09:07 yangwang201911

Please double check if we need additional change in benchmark_app when benchmark use MULTI:GPU,CPU with Latency hint.

wangleis avatar Jul 26 '22 02:07 wangleis