giskard icon indicating copy to clipboard operation
giskard copied to clipboard

Scan: Add a robustness detector to the scan that perturbs numerical values

Open kevinmessiaen opened this issue 11 months ago • 6 comments

🚀 Feature Request

Add a robustness detector to the scan that perturbs numerical values.

The scan should be able to a set of issues that capture the minimum amount of perturbation (lying in the bounds of the feature distribution) needed on a single numerical feature to:

  • (a) change the predicted label (classification)
  • (b) change the prediction by an amount that exceeds a certain threshold (regression)

🔈 Motivation

Currently the scan does not have any numerical perturbation.

kevinmessiaen avatar Mar 14 '24 07:03 kevinmessiaen

Hey @kevinmessiaen! This seems to be a duplicate of #1847 PS: I'd love to contribute to the tool! I'll be on the lookout for new issues/improvements :)

pranavm7 avatar Jul 11 '24 03:07 pranavm7

@pranavm7 Hey, it's not exactly the same. One is for numerical values and the other is for categorical ones which differs a bit.

We would be happy to have you contribute on this tool, do you have any improvement ideas in mind?

kevinmessiaen avatar Jul 12 '24 08:07 kevinmessiaen