TextAttack icon indicating copy to clipboard operation
TextAttack copied to clipboard

Extra quality metrics

Open gmurro opened this issue 2 years ago • 0 comments

Add extra quality metrics: BERTScore, Sentence BERT and Meteor.

A better default model has been setted for BERTScore (as described in this sheet) How to use them?

attack_results = attacker.attack_dataset()

sbert_stats = SBERTMetric().calculate(attack_results)
bert_score_stats = BERTScoreMetric().calculate(attack_results)
meteor_stats = MeteorMetric().calculate(attack_results)

gmurro avatar Oct 03 '22 13:10 gmurro