Report hypothesis tests in batch mode

Open snim2 opened this issue 10 years ago • 3 comments

In batch mode multitime can produce timing measurements for a number of different commands. One obvious use of this is to compare the performance of two similar commands. In this situation, it would be useful to report the result of a Student t-test (or similar hypothesis test) which compares the sample means of the different commands.

Mar 20 '15 15:03 snim2

I must admit to not really understanding the student t-test off hand, but something like this sounds sensible.

Apr 05 '15 15:04 ltratt

OK, I'll work out the statistics and come up with a more detailed proposal.

Apr 06 '15 10:04 snim2

DECISION: Do this anyhow (!) but put the code in extras/

Jun 05 '15 13:06 snim2