nerf icon indicating copy to clipboard operation
nerf copied to clipboard

What does it mean by 'rendering each ray requires querying a multilayer perceptron hundreds of times'

Open cx-tian opened this issue 1 year ago • 2 comments

To render a single ray, say we sample N=64 points along the ray. Then we only evaluated 64 times, why hundreds of times?

cx-tian avatar Mar 14 '23 20:03 cx-tian

NeRF uses Hierarchical volume sampling, see section 5.2 of the original paper for the description. Long story short, N locations are sampled and put through the "coarse network". After this, a more "informed" sampling is undertaken by incorporating the output of the coarse network, which tells us which parts of the volume are relevant. Therefore, more than N samples are taken.

If naive sampling were used, we would indeed get N points along a ray as you expected.

MvWouden avatar Mar 15 '23 11:03 MvWouden

@MvWouden Hi thank you, I got it now.

cx-tian avatar Mar 16 '23 15:03 cx-tian