Stéphane Gazaille

Hello Sean, Thank you for the quick answer! Here's my current setup: - OS: Ubuntu 19.10 Eoan Ermine - GPU: GeForce RTX 2080 SUPER - NVIDIA Driver Version: 440.33.01 -...

Executing the following commands: ``` scripts/pipeline.sh config/grid_search config/antique scripts/pipeline.sh config/grid_search config/antique pipeline.test=True ``` I obtain the following results: `test bm25_k1-1.4_b-0.40 judged@10=0.5960 map_rel-3=0.1945 [mrr_rel-3=0.5793] p_rel-3@1=0.4550 p_rel-3@3=0.3650` Published results for BM25 are...

Hello Sean, Today I cleaned up my `~/data/onir` directory, pulled the [initial commit](https://github.com/Georgetown-IR-Lab/OpenNIR/tree/ca14dfa5e7cfef3fbbb35efbb4e7df0f1fbde590) and re-ran the experiments. The BM25 baseline produced the following results: `test bm25_k1-1.4_b-0.40 judged@10=0.5960 map_rel-3=0.1945 [mrr_rel-3=0.5797] p_rel-3@1=0.4550...

Reconstruction loss (labelled "autoenc_loss" in the code) and similarity loss (labelled "cycle_loss") are defined in summarization.py. From my understanding, 'enc' and 'rec' are two versions of similarity loss (also defined...