ChatGLM-Finetuning icon indicating copy to clipboard operation
ChatGLM-Finetuning copied to clipboard
verified publisher icon liucongg

Exception: Current loss scale already at minimum - cannot decrease scale anymore. Exiting run.

Open yyy900 opened this issue 2 years ago • 5 comments

作者您好，微调的时候一直遇到这个报错是什么原因 Exception: Current loss scale already at minimum - cannot decrease scale anymore. Exiting run.

yyy900 avatar Apr 24 '23 08:04 yyy900

混精训练 梯度消失

janelu9 avatar Jun 30 '23 07:06 janelu9

解决了嘛？我也遇到了这个问题，请问是怎么解决的

smile-II avatar Aug 28 '23 16:08 smile-II

混精训练 梯度消失

请问怎么解决这个问题呀

smile-II avatar Aug 28 '23 16:08 smile-II

你好，请问解决了吗

origi6615 avatar Mar 22 '24 08:03 origi6615

try bfloat16

janelu9 avatar Mar 22 '24 09:03 janelu9