nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

depth mask

Open h8c2 opened this issue 2 years ago • 1 comments

I am using nerfstudio working on Lidar-Image Dataset. I convert the lidar points to depth images and follow the guide https://github.com/nerfstudio-project/nerfstudio/blob/main/docs/quickstart/data_conventions.md to train my model. However, It seems like the code doesn't apply a mask to the zeros area of the depth images. This would be very helpful if you provide support related to sparse depth training.

h8c2 avatar Jan 09 '23 09:01 h8c2

Hi @h8c2, thanks for noting this. Do you imagine that this function call should look at termination_depth and mask out regions where GT depths == 0 in the loss?

We might not get to this soon but are open to pull requests. I think it's a good addition as long as the documentation makes clear what is happening.

ethanweber avatar Jan 10 '23 04:01 ethanweber