OLMo icon indicating copy to clipboard operation
OLMo copied to clipboard

Run Stas' bandwidth testing code on LUMI

Open dirkgr opened this issue 2 years ago • 1 comments

Stas' code is here: https://github.com/stas00/toolbox/blob/master/pytorch/all_reduce_bench.py

We should run this on a single node, and multiple nodes.

dirkgr avatar Mar 10 '23 19:03 dirkgr

I gave this "medium" difficulty because you have to figure out how to run in LUMI for this.

dirkgr avatar Mar 10 '23 19:03 dirkgr

Marking the items prior to Feb 29th as "closed".

dumitrac avatar Apr 30 '24 20:04 dumitrac