treccastweb
treccastweb copied to clipboard
daltonj
I spotted one case where there is an MS MARCO id broken into two within an array. I did not perform further checks, but it seems likely to me that...
Hi, I want to ask does the 2021 qrels file is available now?
It seems that the 6th query "Which is the better type?" from topic 81, CAsT-20 is mistakenly put in `automatic_evaluation_topics_annotated_v1.1.json` since the query doesn't exist in either `2020_automatic_evaluation_topics_v1.0.json` or `2020_manual_evaluation_topics_v1.0.json`.
Hi, I see 2019 folder has a data folder with training and evaluation but 2020 does not have one. Also, can you please point me to the a description of...
Hello - I was going through the trec cast 2022 overview https://trec.nist.gov/pubs/trec31/papers/Overview_cast.pdf and looked through the released data. In the overview, each conversation/topic has a title and description associated with...
the 2022 judgment file url (https://trec.nist.gov/data/cast/qrels-2022.txt) from TREC is unavailable. Whether there are other paths that can be obtained?
I noticed that two of the links to runfiles were broken. I found the originals and put them on huggingface. I updated the links here.
