ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[BUG]: some param and grad of critic_optim are not in the same device after backward

Open TyrionZK opened this issue 1 year ago • 1 comments

🐛 Describe the bug

After self.strategy.backward(critic_loss, self.critic, self.critic_optim), some param and grad of critic_optim are not in the same device . I don't know what happen

Environment

device: 8A80080G

TyrionZK avatar Oct 14 '23 14:10 TyrionZK

May I take a look at the traceback?

flybird11111 avatar Oct 24 '23 03:10 flybird11111