kaolin-wisp icon indicating copy to clipboard operation
kaolin-wisp copied to clipboard

How to reproduce the results in the paper (instant-ngp)?

Open Pamimi opened this issue 2 years ago • 8 comments

I train the ngp-nerf with conmand python3 app/main.py --config configs/ngp_nerf.yaml --multiview-dataset-format standard --mip 0 --dataset-path data/lego I only changed epochs to 100 The PSNR of result is only 24.52 in the lego dataset. How can i reproduce the results in the paper (instant-ngp) image

Pamimi avatar Sep 13 '22 11:09 Pamimi

Same question here! I trained on the lego scene with the provided configuration file configs/ngp_nerf_interactive.yaml, but the results look a bit blurry and not as good as what I got from instant-ngp. Screenshot from 2022-11-08 21-07-19

c-he avatar Nov 09 '22 02:11 c-he

I still cannot reproduce results using the latent version of the wisp. Does anyone know the correct hyper parameters?

Hippogriff avatar Feb 12 '23 18:02 Hippogriff

@orperel has there been any update on how to reproduce the results from the original instant-NGP paper? The current version of wisp doesn't match the performance.

Hippogriff avatar Feb 21 '23 20:02 Hippogriff

Hi! We worked around this issue, but we need to further clean this MR before we can merge it. Are you blocked for ICCV? If so, we can post the dirty MR until this effort is done.

Otherwise, the metrics in the NeRF table should be up to date. (after we merge PSNR on lego should go above > 35.0)

orperel avatar Feb 22 '23 00:02 orperel

@orperel Yes, please post/share the required changes needed. I do indeed need it for ICCV.

Hippogriff avatar Feb 22 '23 00:02 Hippogriff

@tovacinni Has there been any update on this? I would really appreciate if the results from the original papers can be reproduced. Otherwise, it is hard to use this framework to do experiments related to publications. Thanx for your hard work.

Hippogriff avatar Mar 20 '23 16:03 Hippogriff

Hi, this has been still blocked on some other MRs that need to be cleared. Basically to explain what's missing if you want to implement them yourself:

  • Adaptive ray batching from INGP
  • Some hyperparameter tuning
  • The use of huber loss
  • Some other small tweaks that aren't in the INGP paper but are in the code

All of these things can improve the results.

tovacinni avatar Mar 20 '23 18:03 tovacinni

@tovacinni If you can provide specific values for these hyper parameters, that will be great. Thanx.

Hippogriff avatar Mar 20 '23 18:03 Hippogriff