The QRel file rank for BioASQ

[ari9dam]

How would you assign numbers in the QRel file for BioASQ? Could you please provide an example. Let's say for a question Q with id ID the ideal documents are [D1,D2,D3]. How would the QRel entries look like?

Thank you

[thakur-nandan]

Hi @ari9dam,

For BioASQ, we have relevant documents which are binary i.e. relevant or not relevant. So for your example your qrels would look something like below for (qrels/test.tsv)

qid   cid     score
ID    D1      1
ID    D2      1
ID    D3      1

Hope it helps!