How to setup in my own cluster instead of AWS?

[yanring]

Hi wang, I want to setup ps-pytorch in my own cluster, but the guide only mentioned how to setup it in AWS. Can you give me some guidance about this? Thanks!

[hwang595]

Hi @yanring, all the AWS stuff I mentioned in the guide is to help with getting private ips addresses of the instances (machines over a distributed cluster).

Things work even easier on your own cluster once you have a file contains the private ips of machines in your own cluster. For instance, you can create a file and write all private ips manually, and ultimately it looks like:

172.31.16.226
172.31.27.245
172.31.29.131
172.31.18.108
172.31.18.174
172.31.17.228
172.31.16.25
172.31.30.61
172.31.29.30

Then the scripts e.g. local_script.sh, remote_script.sh should work with slight modifications e.g. change this line to the address of your own key file.

We can follow up on this. I'm happy to help more.