ocannl
ocannl copied to clipboard
Example training loop using DisTrO low-communication distributed data parallelism
https://github.com/NousResearch/DisTrO