healthcareai-py icon indicating copy to clipboard operation
healthcareai-py copied to clipboard

Warn user if it looks like they chose the wrong positive class (roc_auc < 0.5)

Open Aylr opened this issue 7 years ago • 0 comments

With the advent of guess_positive_label(), and the ability for a user to specify binary_positive_label when instantiating TrainedSupervisedModel, it's possible that they selected the incorrect class. This manifests as an inverted ROC cure and a ROC AUC < 0.5.

This should be easily detectable and we could warn the user on the plot and anytime metrics are accessed.

Aylr avatar Sep 27 '17 14:09 Aylr