ColossalAI
ColossalAI copied to clipboard
[BUG]: Have stable diffifusion model train support tensor or pipeline parallel?
🐛 Describe the bug
when I read colosalAI parallel doc,it say:
we need modify torch.nn.Linear to col_nn.Linear. But In stable diffusion model code, I found model use torch.nn.Linear now

So have stable diffusion model train supported tensor or pipeline parallel now?
Environment
No response
No, our implementation now only supports ZeROs & GeminiDDP.