CogVideo icon indicating copy to clipboard operation
CogVideo copied to clipboard

finetune时grad_norm非常小

Open sigma-alpha-beta opened this issue 6 months ago • 0 comments

您好,在训练时grad_norm的值非常小,大约在0.0003这个量级,请问这个是正常的吗,是不是需要修改learning rate,谢谢

sigma-alpha-beta avatar Jul 04 '25 03:07 sigma-alpha-beta