ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

[BUG]: chat optimizer.backward(loss)

Open James6Chou opened this issue 2 years ago • 4 comments

🐛 Describe the bug

ColossalAI/applications/Chat/coati/trainer/strategies/colossalai.py file 150 line optimizer.backward(loss) should be a code error

Environment

No response

James6Chou avatar Apr 06 '23 13:04 James6Chou

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Title: [BUG]:

Issues-translate-bot avatar Apr 06 '23 13:04 Issues-translate-bot

Does it fail anyway?

JThh avatar Apr 06 '23 18:04 JThh

Does it fail anyway?

I'm not sure, but I didn't find the definition of the optimizer.backward(loss) function, and there is no such usage in the original pytorch

James6Chou avatar Apr 07 '23 02:04 James6Chou

Hi, we have adapted the optimizer API for this use!

JThh avatar Apr 17 '23 10:04 JThh