TextAttack
TextAttack copied to clipboard
Extra quality metrics
Add extra quality metrics: BERTScore, Sentence BERT and Meteor.
A better default model has been setted for BERTScore (as described in this sheet) How to use them?
attack_results = attacker.attack_dataset()
sbert_stats = SBERTMetric().calculate(attack_results)
bert_score_stats = BERTScoreMetric().calculate(attack_results)
meteor_stats = MeteorMetric().calculate(attack_results)