iris
iris copied to clipboard
Holding space for memory benchmarking issues
Since #5960, #5959 , #5950 and especially #5948 We are likely to get a few change warnings from memory benchmarks.
Doubtless some sensitivity changes may be needed, perhaps we'll have to turn off most of the memory benchmarking again. But possibly also, it will need to "settle down" after recent changes ? I think we should just routinely close these for a while, and later review as a set.
Issues referencing this one will be visible below ...
If we feel we might benefit from repetitions, we could try writing our own benchmark class - ASV is designed for this and they are not as complex as I feared.
- Developing benchmarks - asv_runner 0.2.0 documentation
asv_bench_memray- an example of a custom benchmark plugin.asv_runner.benchmarks.time.TimeBenchmark- an example of how repeats could be implemented.
- https://github.com/SciTools/iris/pull/5981