langtest icon indicating copy to clipboard operation
langtest copied to clipboard

Implement Accuracy Drop for Robustness and Bias Tests

Open chakravarthik27 opened this issue 5 months ago • 0 comments

This implementation involves comparing the ground truth vs. expected result and the ground truth vs. actual result, where the actual result is derived from a perturbed version of the original text. The goal is to measure the accuracy drop that occurs due to robustness and bias. For more information, refer to the LangTest robustness tests.

chakravarthik27 avatar Sep 23 '24 13:09 chakravarthik27