Oscar icon indicating copy to clipboard operation
Oscar copied to clipboard

Can you share the full NoCaps results on the test data?

Open YovaKem opened this issue 3 years ago • 1 comments

The OSCAR paper reports a CIDEr score of 78.8 and 80.9 for OSCAR base and large, resp. Since it's not clarified, I assume these are scores on the NoCaps test split, for NoCaps-entire. Can you share the scores for the in-, near- and out-domain subsplits? And can you confirm if the 78.8/80.9 scores are on the test data? Thanks!

YovaKem avatar Aug 10 '22 09:08 YovaKem

Congrats for your amazing work on OSCAR.

I was wondering the same

RitaRamo avatar Sep 29 '22 12:09 RitaRamo