TextFooler
TextFooler copied to clipboard
Number of queries in attack_classification.py etc.
Thank you for open-sourcing the code! I would like to double-check the following concerns
-
Does
num_queriesinattack_classification.pyreflect how many queries were made to the classifier for each input text? -
Is the similarity threshold issue reported in the text-attack library already fixed in the current text-fooler implementation?
Another comment is that in the prerequisites part of README, the -r flag is missing in pip install requirements.txt. It should be pip install -r requirements.txt. Hope it helps :-0
- number of queries is the number of times that the classifier is queried for obtaining the output probability vectors
- In order to replicate the numbers in our paper, you should set the similarity threshold to 0.5 Thanks for the comment. I will correct it soon!