glum
glum copied to clipboard
Automatic performance benchmarks
Over at quantcore.learn, we use asv to perform automatic performance benchmarks as part of our CI pipeline. We have a dedicated machine at kimsufi so that we're running these tests on the same physical machine each time.
I think it would be very helpful to set the same thing up for quantcore.glm (and probably also quantcore.matrix) to avoid (un)pleasant surprises.
This is what our setup looks like:
- ci.yml that defines the CI job
- run_benchmarks.sh shell script that executes the benchmark
- ASV infrastructure
Yeah, this sounds great. I don't think we should prioritize this before our 2.0 release. Does that sound reasonable?