OLMo
OLMo copied to clipboard
Run Stas' bandwidth testing code on LUMI
Stas' code is here: https://github.com/stas00/toolbox/blob/master/pytorch/all_reduce_bench.py
We should run this on a single node, and multiple nodes.
I gave this "medium" difficulty because you have to figure out how to run in LUMI for this.
Marking the items prior to Feb 29th as "closed".