Why dureader testSet Use Acc metric instead of Rouge

Open jarheadjoe opened this issue 2 years ago • 2 comments

Nov 15 '23 09:11 jarheadjoe

When using Acc in dureader, gpt-3.5-16k's score is very low, this is my self test. This is inconsistent with the results in the appendix of your paper

Nov 20 '23 03:11 jarheadjoe

Thank you for your suggestion. We have changed the metric to rouge instead in the updated version.

Jul 22 '24 10:07 KwanWaiChung