DeepSpeed
DeepSpeed copied to clipboard
Refactor remaining distributed tests
Continuing refactor of distributed unit tests started in #2141 and #2180. Also includes a fix for the broken nightly test (lm-eval)