examples icon indicating copy to clipboard operation
examples copied to clipboard

Examples: can remove cross-validation from outlier detection

Open jwmueller opened this issue 3 years ago • 0 comments

This example: https://github.com/cleanlab/examples/tree/master/outlier_detection_cifar10 could become much more straightforward without cross-validation now that we've seen it doesn't help too much in the train/test OOD settings.

But to truly assess the utility of cross-validation, we should first include an additional benchmark setting where we evaluate OOD detection on a training dataset with some outliers included (during training not just during testing). Cross-validation may still help in this setting.

jwmueller avatar Sep 16 '22 23:09 jwmueller