codecodebear

different seed not changing outputs

1

Hi, I set different ```seed``` values in config, but this doesn't change results' metric scores. I also looked at the intermediate data, retrieved passages, pred answers, etc remain the same...

Spring EM issue

2

Hi, I get extremely low EM for ```Spring```. I set up ```Spring``` following configurations in reproduction guideline. for Spring, the metrics when evaluated with NQ are: ``` em: 0.00443213296398892 f1:...

how to change Bfloat16 to float16 (I can only use a GPU with compute capacity >= 8.0 to run this repo?)

5

when I run the pipeline ``` python run_exp.py --method_name 'naive' \ --split 'test' \ --dataset_name 'nq' \ --gpu_id '0,1,2,3' ``` I get this error: in the last line, I need...