PatrickStar
PatrickStar copied to clipboard
Support communication config before training
Currently, the training will start whether the config of 2 nodes are the same or not. This may cause some weird result during benchmarking. We should consider communicate the config among nodes to make sure they are running the same program...