TextFooler icon indicating copy to clipboard operation
TextFooler copied to clipboard

Number of queries in attack_classification.py etc.

Open superctj opened this issue 4 years ago • 1 comments

Thank you for open-sourcing the code! I would like to double-check the following concerns

  1. Does num_queries in attack_classification.py reflect how many queries were made to the classifier for each input text?

  2. Is the similarity threshold issue reported in the text-attack library already fixed in the current text-fooler implementation?

Another comment is that in the prerequisites part of README, the -r flag is missing in pip install requirements.txt. It should be pip install -r requirements.txt. Hope it helps :-0

superctj avatar Jun 06 '21 21:06 superctj

  1. number of queries is the number of times that the classifier is queried for obtaining the output probability vectors
  2. In order to replicate the numbers in our paper, you should set the similarity threshold to 0.5 Thanks for the comment. I will correct it soon!

jind11 avatar Jun 07 '21 18:06 jind11