responsible-ai-toolbox icon indicating copy to clipboard operation
responsible-ai-toolbox copied to clipboard

Handle 'Classification outcome' cohort filter for multiclass scenario in SDK

Open gaugup opened this issue 3 years ago • 2 comments

Description

It looks like we have "Classification Error" (aka "Classification outcome") filter supported for multiclass scenario. This was added as a part of the PR https://github.com/microsoft/responsible-ai-toolbox/pull/1371. Hence, supporting the "Classification outcome" filter for multiclass case.

Checklist

  • [ ] I have added screenshots above for all UI changes.
  • [ ] I have added e2e tests for all UI changes.
  • [ ] Documentation was updated if it was needed.

gaugup avatar Aug 09 '22 23:08 gaugup

Codecov Report

Merging #1623 (0ea7c09) into main (c16a093) will decrease coverage by 0.02%. The diff coverage is 80.00%.

@@            Coverage Diff             @@
##             main    #1623      +/-   ##
==========================================
- Coverage   89.03%   89.00%   -0.03%     
==========================================
  Files         105      105              
  Lines        5489     5502      +13     
==========================================
+ Hits         4887     4897      +10     
- Misses        602      605       +3     
Flag Coverage Δ
unittests 89.00% <80.00%> (-0.03%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ranalysis/erroranalysis/_internal/cohort_filter.py 86.74% <80.00%> (-0.84%) :arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

codecov-commenter avatar Aug 09 '22 23:08 codecov-commenter

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/gaugup/HandleClassificationOutcomeMulticlass/dashboard/index.html

github-actions[bot] avatar Aug 10 '22 00:08 github-actions[bot]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/gaugup/HandleClassificationOutcomeMulticlass/dashboard/index.html

github-actions[bot] avatar Aug 16 '22 20:08 github-actions[bot]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/gaugup/HandleClassificationOutcomeMulticlass/dashboard/index.html

github-actions[bot] avatar Aug 17 '22 00:08 github-actions[bot]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/gaugup/HandleClassificationOutcomeMulticlass/dashboard/index.html

github-actions[bot] avatar Aug 17 '22 05:08 github-actions[bot]