jasp-issues icon indicating copy to clipboard operation
jasp-issues copied to clipboard

[Feature Request]: Robust t-test and ANOVA

Open JaspBoy opened this issue 1 year ago • 8 comments

Description

Robust t-test and ANOVA for violation of assumptions of general linear model

Purpose

To conduct sensitivity analysis which most on statistics literature now recommend

Use-case

No response

Is your feature request related to a problem?

No response

Is your feature request related to a JASP module?

Robust T-Tests, T-Tests

Describe the solution you would like

Would like implementation of robust t-tests and ANOVA in JASP

Describe alternatives that you have considered

JAMOVI program

Additional context

Images from JAMOVI

slika slika slika

JaspBoy avatar Jun 09 '24 10:06 JaspBoy

I think this functionality would in general be great to have. Andy Field is also a fan. And these methods are in general the bread and butter of the empirical sciences. I believe @JohnnyDoorn had an interest to look at this...

EJWagenmakers avatar Jun 09 '24 11:06 EJWagenmakers

I think this functionality would in general be great to have. Andy Field is also a fan. And these methods are in general the bread and butter of the empirical sciences. I believe @JohnnyDoorn had an interest to look at this...

Sounds great! Also a fan of Andy Fields books. Can't wait for the book "Discovering statistics using JASP". I was so thrilled to see this collaboration.

Any predictions when could robust modules be introduced to JASP? :)

JaspBoy avatar Jun 09 '24 11:06 JaspBoy

Hi all I would have to agree that robust testing would be an important addition! Regarding t-tests this would be a useful read, I think:

Karch, J. D. (2021). Choosing Between the Two-sample T Test and its Alternatives: A Practical Guideline. OSF. https://doi.org/10.31234/osf.io/ye2d4

and as for range of other robust tests, this i could be useful? #2305

In particular when it comes to Brunner Munzel as an alternative to the Mann-Whitney U.

Patrick Mair has a set of functions for other robust procedures:

https://link.springer.com/article/10.3758/s13428-019-01246-w

So this might indeed be your preferred "one-stop shop"?

There is however, reason to go beyond robust testing to permutation-based tests as suggested #454 #2305 Best,

Tarandeep

TarandeepKang avatar Jun 09 '24 17:06 TarandeepKang

I am indeed planning to implement Rand Wilcox' WRS package in JASP - it will not be in the upcoming release, but hopefully the one after (so probably spring 2025).

JohnnyDoorn avatar Jun 10 '24 09:06 JohnnyDoorn

I am indeed planning to implement Rand Wilcox' WRS package in JASP - it will not be in the upcoming release, but hopefully the one after (so probably spring 2025).

Looking forward to it and thank you for your hard work!

Kind regards Ivan

JaspBoy avatar Jun 10 '24 11:06 JaspBoy

Hi @JohnnyDoorn I just want to clarify did you mean that you wanted to consider using the WRS package https://github.com/nicebread/WRS or WRS2 which is the one you have linked to above? Although they have similar names, it looks as if WRS actually has a wider variety of features and is more up-to-date. See for example this paper:

Wilcox, R. R., & Rousselet, G. A. (2023). An Updated Guide to Robust Statistical Methods in Neuroscience. Current Protocols, 3(3), e719. https://doi.org/10.1002/cpz1.719

Best,

Tarandeep

TarandeepKang avatar Jun 14 '24 20:06 TarandeepKang

Hi @TarandeepKang,

Thanks for the suggestion - the WRS package indeed seems more accessible/open, also because I cannot seem to find the WRS2 Github repository.

JohnnyDoorn avatar Jun 17 '24 09:06 JohnnyDoorn

I'd also like to join the request with underlining the aspect of adding even the simple bootstrap to standard t-tests and Fisher's ANOVA. And maybe the Brunner-Munzel test as more robust alternative for U Mann-Whitney test?

Thanks a lot in advance for any solution (as I read above Johnnys post on adding WRS package)!

EternalChris avatar Oct 23 '25 18:10 EternalChris