giskard
giskard copied to clipboard
Scan: Add a robustness detector to the scan that perturbs numerical values
🚀 Feature Request
Add a robustness detector to the scan that perturbs numerical values.
The scan should be able to a set of issues that capture the minimum amount of perturbation (lying in the bounds of the feature distribution) needed on a single numerical feature to:
- (a) change the predicted label (classification)
- (b) change the prediction by an amount that exceeds a certain threshold (regression)
🔈 Motivation
Currently the scan does not have any numerical perturbation.
Hey @kevinmessiaen! This seems to be a duplicate of #1847 PS: I'd love to contribute to the tool! I'll be on the lookout for new issues/improvements :)
@pranavm7 Hey, it's not exactly the same. One is for numerical values and the other is for categorical ones which differs a bit.
We would be happy to have you contribute on this tool, do you have any improvement ideas in mind?