MOSS icon indicating copy to clipboard operation
MOSS copied to clipboard
verified publisher icon OpenMOSS

AttributeError: 'DeepSpeedZeRoOffload' object has no attribute 'backward'

Open lizhidomg opened this issue 2 years ago • 2 comments

File "finetune_moss.py", line 241, in train accelerator.backward(loss) 代码运行到这一行报错， AttributeError: 'DeepSpeedZeRoOffload' object has no attribute 'backward'

lizhidomg avatar May 11 '23 12:05 lizhidomg

这个是微调时候的报错

lizhidomg avatar May 11 '23 12:05 lizhidomg

兄弟解决了吗，我使用moss-moon-003-sft的jupyter测试样例时也有类似错误

YoloZyk avatar Jan 31 '24 08:01 YoloZyk