elk
elk copied to clipboard
Can this code suppot free-form QA task?
I noticed that the datasets supported in the code are all multiple-choice and classification types, such as IMDB, QNLI, and BoolQ. Can the code in this repository support free-form types of tasks, such as TriviaQA and NQ? For free-form QA tasks, the possible answer space is infinite. How should the CCS method allocate X+ and X- labels for such tasks?