ansen zhang comments

Results 6 comments of


                                            ansen zhang

While training GRPO, I noticed that my model crashes. Its loss is 0, its grad_norm and kl are both Nan, and it completes as “!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!””

我把我的temperature设为0，一开始就出现!!!!!!

While training GRPO, I noticed that my model crashes. Its loss is 0, its grad_norm and kl are both Nan, and it completes as “!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!””

温度设为其他就没事了

transformer_engine 安装失败

@zhangtianhong-1998 我也安装失败了，请问这里的镜像指的是

用grpo训练qwen2.5-7b-instruct出现!!!!

温度设为0就会出现这种情况，改为其他的温度就没事了

请问如何在grpo中配置自定义的数据集路径，并进行数据格式转换？

请问你知道了吗

grpo训练卡住，一直显示一下问题。

@1245244103 能跑了但是爆了这些问题，有影响吗 deprecated, as it handled by the parser now equations is deprecated, as it handled by the parser now equations is deprecated, as it handled by the parser now...