anserini
anserini copied to clipboard
Align RunMsMarco with Fatjar regression instructions
Today, you can run regressions with the fatjar directly: https://github.com/castorini/anserini/blob/master/docs/fatjar-regressions-v0.35.1.md
Today, you can also do this:
java -cp `ls target/*-fatjar.jar` io.anserini.reproduce.RunMsMarco
These aren't aligned. RunMsMarco only runs a subset of the cases in the fatjar instructions. We should bring the two into alignment - i.e., add the missing cases into RunMsMarco. It probably makes sense to run have then generate the same output to be consistent.
Separately:
- we have fatjar instructions for BEIR, but no
io.anserini.reproduce.RunBeiror something similar. - we have no repro for V2.1 runs, e.g., add option to
io.anserini.reproduce.RunMsMarco.
Initial commit #2477 - some errors noted #2480
I believe this issue has been resolved.