Compare Benchmarks over Versions

Open SoftHai opened this issue 12 years ago • 0 comments

I want to execute a benchmark with different Versions of a lib to compare / see if the performance is going better or worse.

I want to see a result like that:

Benchmark	v0.1-beta	v0.2-beta	v0.3-beta
Benchmark 1
- Run 1	10ms	11ms	9ms
- Run 2	100ms	80ms	250ms
- Run 2	20ms	21ms	22ms

There I can see that e.g. run 2 going worse and I can check whats the reason (a new feature which needs the time e.g. security checks or a failure in the code?!?!?)

Feb 02 '14 11:02 SoftHai