beir icon indicating copy to clipboard operation
beir copied to clipboard
verified publisher icon beir-cellar

Support Multi-node evaluation

Open NouamaneTazi opened this issue 2 years ago • 0 comments

You can try this PR using:

torchrun --nproc_per_node=2 examples/retrieval/evaluation/dense/evaluate_sbert_multi_gpu.py

Using e5-large model I got

  • MSMARCO (8.84M documents) took 1h03min to encode (on 16 GPUs) -> evaluation took 1h04min
  • NQ (2.68M documents) took 22min to encode (on 16 GPUs) -> evaluation took 25min

cc @thakur-nandan

Fixes https://github.com/beir-cellar/beir/issues/134

NouamaneTazi avatar Aug 12 '23 17:08 NouamaneTazi