S-NeRF icon indicating copy to clipboard operation
S-NeRF copied to clipboard

Nan in loss

Open zyzwhdx opened this issue 1 year ago • 2 comments

Hi, many thanks for the great work.

But when I was training this model, the training log showed Nan in loss, and this happened even in your uploaded exp folder. I guess maybe it is caused by the smooth loss calculation (pred_distance).

pred_distance = pred_distance[:args.N_rgb], pred_distance_coarse = pred_distance_coarse[:args.N_rgb], pred_distance_smooth = pred_distance[args.N_rgb:]

Do you have any suggestion for this problem? Thank you!

zyzwhdx avatar Aug 29 '23 15:08 zyzwhdx

I also encountered the same problem, args.N_rgb = 4096, and len(pred_distance) = 4096, hence pred_distance_smooth = [], and ultimately caused NAN loss.

booker-max avatar Sep 03 '23 14:09 booker-max

I don't know how to solve it, Do you have any advice?

booker-max avatar Sep 03 '23 14:09 booker-max