openvino icon indicating copy to clipboard operation
openvino copied to clipboard

[BENCHMARK_APP/PYTHON/CPP] Align benchmark_app output across languages

Open PiotrKrzem opened this issue 3 years ago • 0 comments

Details:

  • Console output now almost identical throughout both applications
    • Missing error description now shows correctly in C++ (caused by re-throw of the copy of the error instead of the original error)
  • Fixed latency bug which printed '0.00' for each data shape in Python benchmark version

Alignment results:

  • ~512 most common use cases were tested, and the output across both platforms is 85% exactly the same on average
  • Differences mostly come from in-built python print of common types different from C++'s, and image processing methods in step 9 of the application
  • Above analysis returned that python benchmark_app is missing some exceptions thrown during runtime - for example, dynamic shape testing for synchronous API - not sure whether to align these, because of the differences of both languages

Tickets:

  • 86132
  • 89366

PiotrKrzem avatar Aug 30 '22 05:08 PiotrKrzem