aequitas icon indicating copy to clipboard operation
aequitas copied to clipboard

[COMPAS Example] Inconsistency in "Visualizing a single absolute group metric across all population groups"

Open LiFaytheGoblin opened this issue 4 years ago • 0 comments

About https://github.com/dssg/aequitas/blob/master/docs/source/examples/compas_demo.ipynb

In the part "Visualizing a single absolute group metric across all population groups" you say "We can see from the longer bars that across 'age_cat', 'sex', and 'race' attributes, the groups COMPAS incorrectly predicts as 'low' or 'medium' risk most often are 25-45, Male, and African American.".

image

You display the FNR, which evaluates which groups have incorrectly been assigned 'low' or 'medium' scores as you say - but what you say about the bar length doesn't add up. Are you talking about the absolute numbers instead of the bar lengths? Or am I missing something?

LiFaytheGoblin avatar Jun 16 '20 16:06 LiFaytheGoblin