simdutf icon indicating copy to clipboard operation
simdutf copied to clipboard

Benchmarks without tests

Open WojciechMula opened this issue 9 months ago • 2 comments

CMakeLists.txt has the condition disallowing benchmarks without test:

message(STATUS "You have enabled the benchmarks, but not the tests. We don't allow running the benchmarks without the tests.")

What is the rationale? TBH, this seems to be an artificial restriction.

WojciechMula avatar Apr 01 '25 10:04 WojciechMula

@WojciechMula We can lift it but the idea is that you shouldn’t benchmark incorrect code.

lemire avatar Apr 01 '25 20:04 lemire

Think about scenario, when you already validated the given backend, and want to benchmark it on multiple different machines.

WojciechMula avatar Apr 05 '25 09:04 WojciechMula