FSharp.Stats icon indicating copy to clipboard operation
FSharp.Stats copied to clipboard

[Feature Request] Dunnett's test

Open bvenn opened this issue 4 years ago • 3 comments

Is your feature request related to a problem? Please describe. Post hoc tests are used to inspect a multipe-group-comparison (e.g. ANOVA) for individual significant group mean differences. While Tukey's HSD aims to perform all comparisons k((k-1)/2), it often is desired to test all groups against a single control or standard.

Describe the solution you'd like Dunnett's test allows this multiple-to-one comparison with higher power than Tukeys HSD.

Additional information/References https://www.researchgate.net/post/What_is_the_difference_between_Tukeys_Post_Hoc_Test_and_Students_t-test

bvenn avatar Jul 01 '20 08:07 bvenn

Dunnetts q distribution is necessary for implementation. Since this is not trivial it may be sufficient to cover distinct alpha levels and use q-value tables for analysis, instead of implementing the distribution

  • Suggestion: alpha levels 0.05 and 0.01

bvenn avatar Jul 04 '20 16:07 bvenn

Additional references for exact p value calculation:

  • New Tables for Multiple Comparisons with a Control, C. W. Dunnett, Biometrics , Sep., 1964, Vol. 20, No. 3 (Sep., 1964), pp. 482-491 Chapter 3

  • On a statistic which arises in selection and ranking problems, Gupta, Ann. Math. Statist. 28, 957-67, 1957, Formula 7.2

bvenn avatar Oct 10 '20 09:10 bvenn

Dunnetts test was implemented with unit tests and documentation. A table for two sided tests with a significance threshold of 0.05 is provided and should be extended for a higher sample count and various significance thresholds.

bvenn avatar Jan 25 '22 20:01 bvenn