cedr

cedr copied to clipboard

Question about running extract_docs_from_index.py

7

I try to run the extract_docs_from_index.py with this command and the index is pre-index provided by Pyserini: awk '{print $3}' data/robust/*.run | python extract_docs_from_index.py lucene index-robust04-20191213/ > data/robust/documents.tsv but I...

yiyaxiaozhi

Hi， I use indri, run ``` awk '{print $3}' /data1/liushu/cedr-master/data/robust/*.run | python /data1/liushu/cedr-master/cedr/extract_docs_from_index.py indri /data1/liushu/cedr-master/index-robust04-20220531/ > /data1/liushu/cedr-master/data/robust/documents.tsv ``` But an error was reported ``` Traceback (most recent call last): File...

yysirs

CEDR for MARCO document ranking

1

Hello, have you ever run CEDR_KNRM on MSMARCO document ranking task? I encountered some problems when I trained CEDR_KNRM initialized with the fine-tuned BERT (the performance almost no longer increases...

caiyinqiong

data

6

Because I want to run this code with other data sets, how can I get .run and .pair files similar to those in /data?

wangxinzhe123

Train cedrpacrr using 5 folds BERT checkpoint, train_pairs and valid_run

4

Hi Sean, I want to train cedrpacrr using BERT checkpoint by the following command: ``` python train.py \ --model cedr_pacrr \ # or cedr_knrm / cedr_drmm --datafiles data/queries.tsv data/documents.tsv \...

Pourbahman

Thanks your wonderful work CEDR, it helps to understand the document ranking task a lot! I tried to use this repo and followed the instruction to train a vanilla_bert with...

yiyaxiaozhi

tqdm

3

Sean, there is some peculiar tqdm setups in CEDR. Could we remove the leave=false and the ncols; perhaps set the units and some descriptions? If you agree, I can submit...

cmacdonald

How to get WebTrack 2012-2014 datasets.

1

Hi, I'm confused about how to get WebTrack 2012-2014 datasets. I would appreciate it if you could provide me with the specific process. Thanks a lot.

haiahaiah

Difficulties to reproduce results on Robust 04

11

This is a follow-up on #21. I tried to reproduce the results on Robust 04 but failed to do so using the code in this repository. In the following I...

krasserm

transformers rather than pytorch_pretrained_bert

1

We'd like to make use of the more generic transformers library. There is some migration information at https://huggingface.co/transformers/migration.html We're trying to upgrade a BertRanker: ```python class VanillaBertTransformerRanker(BertRanker): def __init__(self): super().__init__()...

cmacdonald