redflag icon indicating copy to clipboard operation
redflag copied to clipboard

Warn about low precision on accuracy metrics based on test size

Open kwinkunks opened this issue 2 years ago • 0 comments

Can estimate precision using beta distribution: https://www.rikvoorhaar.com/validation-size/

Perhaps could also model the uncertainty on the accuracy estimate for the user, but that seems maybe off-topic.

kwinkunks avatar Jan 29 '23 08:01 kwinkunks