responsible-ai-toolbox icon indicating copy to clipboard operation
responsible-ai-toolbox copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

AUC chart

Open hawestra opened this issue 2 years ago • 6 comments
trafficstars

Description

first draft to add AUC chart to model overview; still needs PM input

Checklist

image
  • [x] I have added screenshots above for all UI changes.
  • [ ] TODO: I have added e2e tests for all UI changes.
  • [ ] TODO: Documentation was updated if it was needed.

hawestra avatar Jul 07 '23 20:07 hawestra

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/hawestra/AUCChart/dashboard/index.html

github-actions[bot] avatar Aug 01 '23 23:08 github-actions[bot]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/hawestra/AUCChart/dashboard/index.html

github-actions[bot] avatar Aug 02 '23 01:08 github-actions[bot]

Perhaps on the wrong track here, but it seems like we might miss something by just looking at 100 thresholds vs all possible thresholds between values (after sorting).

originally, i was looking at 100 thresholds because this is how the metrics package does it but i changed that to look at the y probabilities themselves and go through each of these as the threshold

hawestra avatar Aug 03 '23 00:08 hawestra

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/hawestra/AUCChart/dashboard/index.html

github-actions[bot] avatar Aug 03 '23 00:08 github-actions[bot]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/hawestra/AUCChart/dashboard/index.html

github-actions[bot] avatar Aug 03 '23 01:08 github-actions[bot]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/hawestra/AUCChart/dashboard/index.html

github-actions[bot] avatar Aug 03 '23 22:08 github-actions[bot]