Producing Empty Images Issue during Training.

[Dipankar1997161]

@taoranyi Hello,

I am actually facing the issue during training - Producing Empty Images. It's a new dataset . Do you potentially know the cause for this? It seems a value mismatch between the camera rays on the image, BUT how can I debug this step-wise?

Thank you in advanced !!

[Dataset Path] dataset/genebody/barry
 -- Total Frames: 16
************************************
genebody_barry_train
core.data.human_nerf.train
[Dataset Path] dataset/genebody/barry
 -- Total Frames: 600
Epoch: 1 [Iter 20, 19/600 (3%), 10.47 sec] Loss: 0.8744 [lpips: 0.8236 mse: 0.0508 ]
Epoch: 1 [Iter 40, 39/600 (6%), 8.81 sec] Loss: 0.2724 [lpips: 0.2506 mse: 0.0218 ]
Epoch: 1 [Iter 60, 59/600 (10%), 8.90 sec] Loss: 0.4936 [lpips: 0.4518 mse: 0.0418 ]
Epoch: 1 [Iter 80, 79/600 (13%), 8.84 sec] Loss: 0.5618 [lpips: 0.5370 mse: 0.0248 ]
Epoch: 1 [Iter 100, 99/600 (16%), 8.84 sec] Loss: 0.2704 [lpips: 0.2668 mse: 0.0036 ]
Evaluate Progress Images ...
  0%|                                                                                                                                                                                          | 0/16 [00:50<?, ?it/s]
Produce empty images; reload the init model.
Load checkpoint from experiments/human_nerf/genebody/barry/single_gpu/init.tar ...
Epoch: 1 [Iter 20, 119/600 (20%), 59.33 sec] Loss: 0.3576 [lpips: 0.3395 mse: 0.0180 ]

[taoranyi]

Hello, you can try to load the pre-trained model to give it a human body prior.