NeROIC icon indicating copy to clipboard operation
NeROIC copied to clipboard

Perform baddly on validation set

Open Choconuts opened this issue 3 years ago • 6 comments

I use the milkbox dataset to train the model and the training PSNR is about 29. However, the images synthesis in validation are nearly blank with a little noise, and the PSNR is extremely low. Is it overfitting?

I just run like this for the geometry model:

python train.py
--config
configs/milkbox_geometry.yaml
--datadir
data\milkbox_dataset

Choconuts avatar Aug 13 '22 07:08 Choconuts

It might be overfitting. can you send me your log file?

Also, did you try the other two datasets?

zfkuang avatar Aug 13 '22 07:08 zfkuang

version_2.zip not yet.

Choconuts avatar Aug 13 '22 08:08 Choconuts

It looks like your initialization is a bit different from my side, what's your ubuntu version and did you use the conda command in the guide to install all the packages?

Screen Shot 2022-08-13 at 1 44 57 AM My initialization

Screen Shot 2022-08-13 at 1 43 15 AM Yours

zfkuang avatar Aug 13 '22 08:08 zfkuang

I use windows. Does it matter so much? I mean initialization, since it can converge on training-set easily after all. How can I correct the initialization?

Choconuts avatar Aug 13 '22 09:08 Choconuts

It might be, but there're some other things that looks odd: for example your camera loss is extremely high, indicating that the system didn't find a good camera pose either. So my guess is that there're some nuances between the packages on different platforms causing all the trouble. I would suggest using ubuntu, because all experiments are conducted on it. I can also test the model on windows later to see how to fix that.

zfkuang avatar Aug 13 '22 09:08 zfkuang

OK, thank you.

Choconuts avatar Aug 13 '22 09:08 Choconuts