Support multiple nodes deployment?

[pohunghuang-nctu]

As subject, If I have to deploy one model into more than 1 machines, any kind of configuration could I make?

[mrwyattii]

Hi @pohunghuang-nctu we currently do not support multi-node deployments, but this feature is on our radar as we continue development of MII.

[A-ML-ER]

any update for multi node deployment ?

[mrwyattii]

@pohunghuang-nctu @A-ML-ER sorry for the delayed response here. I believe this feature is now enabled through the DeepSpeed launcher after #147 was merged. If you are able to test this, please report back. I will also investigate adding unit tests for this feature. Thanks!