torchrl
torchrl copied to clipboard
Support distributed training Out-of-the-Box
This can be achieved with Horovod. As long as we respect the MPI environment variables, it should be fairly simple (hopefully!) to port existing code to support distributed training.