nvbench icon indicating copy to clipboard operation
nvbench copied to clipboard

Show batch time comparisons in `nvbench_compare.py`

Open bernhardmgruber opened this issue 5 months ago • 1 comments

When comparing benchmark results with nvbench_compare.py, currently, the cold measurements are compared and shown. If a JSON file also contains batch measurements, those should be shown in addition.

bernhardmgruber avatar Jul 17 '25 21:07 bernhardmgruber

The batch timings are often ignored, see also #194 . Perhaps it is possible to introduce an abstraction that makes it easy to always grab the "best" timing, depending on whether batch or non-batch timing is available.

ahendriksen avatar Jul 18 '25 08:07 ahendriksen