BARTScore icon indicating copy to clipboard operation
BARTScore copied to clipboard

Using BARTScore to Compare 2 summaries without Human Evaluation

Open pranamyapatil opened this issue 1 year ago • 2 comments

I went through the analysis script for comparing 2 evaluation metric wrt human evaluation (meta evaluating evaluation metric).

I wanted to know if there is some way to compare 2 summaries with help of standalone BARTscore.

Eg:- Higher Rouge Score then better the summary. Similarly can we calculate BARTScore for 2 summaries and then conclude that higher BARTScore better it is

pranamyapatil avatar Jul 28 '23 08:07 pranamyapatil