fewglue icon indicating copy to clipboard operation
fewglue copied to clipboard

the label of WSC task is all true?

Open suolyer opened this issue 3 years ago • 1 comments

the label of WSC task is all true,no false

suolyer avatar Mar 30 '22 07:03 suolyer

Hi @suolyer, this is because in prompting work, WSC is typically framed as a generative task. That is, instead of classifying whether a (pronoun, entity) pair is correct, the entity a pronoun is referring to has to be generated. You can find more information about that on page 5 of our paper (the section about WSC). Therefore, it only makes sense to use examples where the label is true.

timoschick avatar Mar 30 '22 19:03 timoschick