ArcticDB
ArcticDB copied to clipboard
CI verification of ASV benchmarks
Is your feature request related to a problem? Please describe. Running ASV benchmarks locally is time consuming and it's difficult to notice whether one has a bug in them.
Describe the solution you'd like A CI check which blocks merge if ASV is misconfigured in some way:
- A benchmark is failing (e.g. #1544 had to do such a fix)
-
benchmarks.json
is not up to date (e.g. #1547 had to do such a fix)