timefold-solver icon indicating copy to clipboard operation
timefold-solver copied to clipboard

Published 20 hours ago • verified publisher icon TimefoldAI

Benchmark report perf summary: go to zero

Open ge0ffrey opened this issue 2 years ago • 3 comments

image the Y axis should go to zero

ge0ffrey avatar Oct 10 '23 15:10 ge0ffrey

I experimented with that when I was creating this report. In this case, it looks like a good idea. In many other cases, "go to zero" creates an empty chart with a flat line at the top, because the difference is very small and/or very far away from zero.

triceo avatar Oct 10 '23 15:10 triceo

Yes, I would compare with the old benchmark report - when to include 0 depends on the statistic.

ge0ffrey avatar Oct 11 '23 06:10 ge0ffrey

When it's a flat line on the top, that's what I want to see: it shows the differences don't really matter. Currently the new perf graph is misleading because it's not zero based.

ge0ffrey avatar Feb 14 '24 09:02 ge0ffrey