stephaniewhoo

That's weird. Just rerun this test on orca and it passed ``` Done! 5191286it [00:07, 688446.36it/s] 100%|███████████████████████████████████████████████████████████████████| 5193/5193 [00:01

``` score_tie occurs 208854 times in 5188 queries recall@10:0.0 recall@20:0.0 recall@50:0.0 recall@100:0.0 recall@200:0.0 recall@250:0.0 recall@300:0.0 recall@333:0.0 recall@400:0.0 recall@500:0.0 recall@1000:0.0 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5193/5193 [00:16

> Update: I tried reproducing on Colab again with some changes, and the monoBERT ranking task works properly, but now I have the exact error on monoT5 as originally described...