ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[FEATURE]: How to use multiple nodes for training examples/images/diffusion

Open summerwuxia opened this issue 3 years ago • 6 comments

Describe the feature

How to use multiple nodes for training examples/images/diffusion

summerwuxia avatar Nov 18 '22 07:11 summerwuxia

https://pytorch-lightning.readthedocs.io/en/latest/api/pytorch_lightning.trainer.trainer.Trainer.html#pytorch_lightning.trainer.trainer.Trainer

Fazziekey avatar Nov 25 '22 07:11 Fazziekey

这是来自QQ邮箱的假期自动回复邮件。   您好,夏武已经收到你的来信,祝你生活愉快

summerwuxia avatar Nov 25 '22 07:11 summerwuxia

image

Fazziekey avatar Nov 25 '22 07:11 Fazziekey

image

Fazziekey avatar Nov 25 '22 07:11 Fazziekey

you can add num_nodes in your yaml

Fazziekey avatar Nov 25 '22 07:11 Fazziekey

image

Fazziekey avatar Nov 25 '22 07:11 Fazziekey

We have updated a lot. This issue was closed due to inactivity. Thanks.

binmakeswell avatar Apr 13 '23 10:04 binmakeswell

这是来自QQ邮箱的假期自动回复邮件。   您好,夏武已经收到你的来信,祝你生活愉快

summerwuxia avatar Apr 13 '23 10:04 summerwuxia

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


This is a vacation auto-reply email from QQ mailbox. the Hello, Xia Wu has received your letter, I wish you a happy life

Issues-translate-bot avatar Apr 13 '23 10:04 Issues-translate-bot