New data domain: Quantus + NLP = True

[annahedstroem]

Goal: make Quantus source code compatible with NLP tasks, including the addition of a tutorial to showcase how Quantus can help quantify the goodness of NLP explanation

• [ ] Determine toy dataset: - Suggestively use the following library https://pytorch.org/text/ -- with a tutorial: https://pytorch.org/text/stable/tutorials/sst2_classification_non_distributed.html and off-the-shelf model
• [ ] Go over Quantus source code to determine the scope of this PR

Updates are expected:

• source code
• tutorial
• pytests

[aaarrti]

Hi, so, here is a notebook demonstrating how NLP explanation evaluation with Quantus could look like in (near) future.

[aaarrti]

In the first iteration, the goal is to support models from Hugging face Hub with scope limited to text-classification tasks.

[abarbosa94]

Hi @aaarrti , are there any updates about this?

I presented myself in this thread #217, please let me know if I can help