FedML
FedML copied to clipboard
improve the low-level communication backend with RPC + GPU Direct
We will implement this feature with PyTorch Distributed Team, researcher Li Shen (https://mrshenli.github.io/))
@Amir-zsh please have a test of this and report the result here.