aequitas icon indicating copy to clipboard operation
aequitas copied to clipboard

[COMPAS Example] Inconsistency in "Visualizing default absolute group metrics across all population groups"

Open LiFaytheGoblin opened this issue 4 years ago • 0 comments

In https://github.com/dssg/aequitas/blob/master/docs/source/examples/compas_demo.ipynb Under "Visualizing default absolute group metrics across all population groups" Under "Default absolute group metrics"

You say "We can also see that the model is equally likely to predict a woman as 'high' risk as it is for a man (false positive rate FPR of 0.32 for both Male and Female)."

image

As far as I understood the rate that measures the likelyhood to predict someone as 'high' risk is the PPR (Predicted Positive Rate) and the FPR measures how likely it is that someone was incorrectly predicted as 'high' risk. Did you mean to say "equally likely to incorrectly predict"?

LiFaytheGoblin avatar Jun 16 '20 17:06 LiFaytheGoblin