An iterative version of Introspective Active Sampling.

[copybara-service[bot]]

An iterative version of Introspective Active Sampling.

• Implements function that calculates bias values for examples and generates a lookup table from example_id to bias value/label. Label is determined using value from threshold flag.
• Implements iterative loop for active sampling. For each round of active sampling, train models on different combinations of data splits, calculate bias values, and train a model jointly on the main task and bias classification.

[google-cla[bot]]

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.