stainless-steel-rat

Results 4 comments of stainless-steel-rat

@luohongcheng hello, I also tried to train the network, but got a blurry depth map too, Do you find some reasons causing it? thank you.

遇到了同样的问题,请问找到解决方法了吗?

> [@hiyouga](https://github.com/hiyouga) 我尝试过使用zero++,设置了zero_hpz_partition_size为8,确实加速了训练,但是训练过程中loss一直固定为11,grad_norm一直为0,训练失败,请问是llamafactory还没适配zero++吗,我该怎样才能正确使用zero++? 我在进行dpo训练的时候也遇到了这个问题。