moonshot icon indicating copy to clipboard operation
moonshot copied to clipboard

[Feature Request] "No-cache" option

Open imda-lseokmin opened this issue 8 months ago • 0 comments

When we run benchmarks on the same endpoint repeatedly in the same runner, the results will be cached. All the tests will receive the same score since they are cached. In some cases where we want to check the consistency of the scoring across different tests, we need to run them in separate runner.

See below: image

Is it possible to add an option to allow no-cache?

imda-lseokmin avatar Jul 01 '24 03:07 imda-lseokmin