DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

Add MPICH Multinode Runner

Open inkcherry opened this issue 2 years ago • 0 comments

Add MPICHRunner class. This PR is allow user to run deepspeed with mpich launcher. We verified it works with Megatron-Deepspeed in multi-node training.

inkcherry avatar Feb 16 '23 06:02 inkcherry