asv icon indicating copy to clipboard operation
asv copied to clipboard

Make it easy to do multiple measurements on a given benchmark

Open cdeil opened this issue 10 years ago • 2 comments

I've started to write benchmarks for Gammapy and decided that mostly high-level benchmarks running compute-heavy end-user analysis tasks are of interest and for each of those I'm interested in:

  • CPU time
  • Wall clock time
  • Memory use

@mdboom Would it make sense to implement a mechanism that makes it easy to do several benchmarks (namely the three I mentioned) without having to write boilerplate code? Maybe via a decorator listing which measurements I want?

cdeil avatar Jan 07 '15 12:01 cdeil

This is a good idea. I'll self-assign if I find some free time to work on it, otherwise all patches welcome!

mdboom avatar Jan 07 '15 14:01 mdboom

I have a similar need : a single benchmark for the spectroscopy RADIS code can take up to 250s ; and computing it twice for PeakMemory and CPU-wall-time takes a lot of time.

Would it be possible and still accurate to measure both the PeakMemory and the CPU-wall-time on a single run ?

erwanp avatar Jun 16 '21 13:06 erwanp