nerf-pytorch icon indicating copy to clipboard operation
nerf-pytorch copied to clipboard

Perfect peformance with lego, but bad with other objects.

Open Q-Y-Yang opened this issue 2 years ago • 4 comments

Hey, @yenchenlin thanks for your pytorch implementation of nerf!

When I trained with lego in the nerf synthetic dataset, the test result is not bad even with only 20000 iterations. 004 For example, above is a render result of lego. However, when I tried to train other objects in nerf synthetic dataset, it did not work. Render result of ship with 30000 iterations training:

000 (1) Render result of chair with 50000 iterations training (a white image as follows) : 001

Therefore, the result is also not satisfying when I trained on my own 360 degree synthetic inward-facing dataset. I compared the nerf network in the official tensorflow release and that in this repo. It seems both are 8 layers MLP. Is there anyone has ideas?

Q-Y-Yang avatar May 13 '22 10:05 Q-Y-Yang

I think I figured it out. The point is near and far bounds are different for each obejct with different size.

Q-Y-Yang avatar May 22 '22 16:05 Q-Y-Yang

I think I figured it out. The point is near and far bounds are different for each obejct with different size.

new bee here, can you share some suggestions for the setting of bounds?

Feynman1999 avatar May 31 '22 09:05 Feynman1999

I think I figured it out. The point is near and far bounds are different for each obejct with different size.

new bee here, can you share some suggestions for the setting of bounds?

It is up to the distance between object and camera in your dataset. The bounds should cover the distance.

Q-Y-Yang avatar Jun 07 '22 09:06 Q-Y-Yang

I think I figured it out. The point is near and far bounds are different for each obejct with different size.

Hi, Hello, I also encounter the same problem as you. When I use other synthetic data, the images I render are all white. I have tried many methods but they still have no effect. I have read your understanding of this, but I do not understand it very well. Can you tell me how I should operate specifically? I will be very grateful if you can give me an answer

lllz815 avatar Aug 22 '22 02:08 lllz815