stainless-steel-rat
stainless-steel-rat
@luohongcheng hello, I also tried to train the network, but got a blurry depth map too, Do you find some reasons causing it? thank you.
遇到了同样的问题,请问找到解决方法了吗?
> [@hiyouga](https://github.com/hiyouga) 我尝试过使用zero++,设置了zero_hpz_partition_size为8,确实加速了训练,但是训练过程中loss一直固定为11,grad_norm一直为0,训练失败,请问是llamafactory还没适配zero++吗,我该怎样才能正确使用zero++? 我在进行dpo训练的时候也遇到了这个问题。
I meet the same problem. Is there any solution for this?