The speed of saving models during multi machine and multi card training is very slow

[JarvisFei]

Have you tried training this model on multiple machines?

If you have tried, is there anything special to pay attention to in terms of environment settings and parameters？

[Guangxuan-Xiao]

Yes, we have. It's important to ensure a good inter-node connection to prevent communication bottlenecks during training.