ColBERT icon indicating copy to clipboard operation
ColBERT copied to clipboard

colbertv1 validation

Open Lim-Sung-Jun opened this issue 2 years ago • 2 comments

Hello,

I am trying to follow the instructions that you posted on colbertv1 branch read.me file. when I use the top1000.dev file for validation, load_topK_pids function needs label (line 111).

But, top1000.dev file has a format <qid, pid, query, passage> like described in "https://msmarco.blob.core.windows.net/msmarcoranking/top1000.dev.tar.gz"

Do I miss something?

Thank you

Lim-Sung-Jun avatar Feb 02 '23 07:02 Lim-Sung-Jun