elk icon indicating copy to clipboard operation
elk copied to clipboard

Can this code suppot free-form QA task?

Open Tan-Hexiang opened this issue 8 months ago • 2 comments

I noticed that the datasets supported in the code are all multiple-choice and classification types, such as IMDB, QNLI, and BoolQ. Can the code in this repository support free-form types of tasks, such as TriviaQA and NQ? For free-form QA tasks, the possible answer space is infinite. How should the CCS method allocate X+ and X- labels for such tasks?

Tan-Hexiang avatar Jul 04 '24 03:07 Tan-Hexiang