OpenNIR icon indicating copy to clipboard operation
OpenNIR copied to clipboard

Published 20 hours ago • verified publisher icon Georgetown-IR-Lab

MSMARCO no matching qids found

Open aminbigdeli opened this issue 4 years ago • 1 comments

I tried to train conv_knrm on the MSMARCO dataset by running the following command: scripts/pipeline.sh config/conv_knrm config/msmarco However I faced "No matching QIDs found. Are you sure you are scoring the evaluation set?" error.

Would you please help me with that? It seems to me that there should be a problem with OpeNIR because it downloads the entire dataset itself.

aminbigdeli avatar Dec 02 '20 20:12 aminbigdeli

From correspondence with @aminbigdeli -- it seems the minidev.qrels file was empty. I need to look into why this happened + correct the bug.

seanmacavaney avatar Dec 03 '20 19:12 seanmacavaney