gsplat icon indicating copy to clipboard operation
gsplat copied to clipboard

Ray Renderer?

Open bolopenguin opened this issue 1 year ago • 1 comments

Hello!

I was wondering it could be possible to have a ray renderer, or a workaround. For example, given the ray origins and directions get the color seen from that ray.

Thanks you very much!

bolopenguin avatar Oct 02 '24 16:10 bolopenguin

Yes it should be possible, there are analytical formulas for ray-Gaussian intersections, that could be implemented. I imagine this could be quite slow, if naively done in pytorch.

Gojcic's team have a nice paper https://gaussiantracer.github.io speeding it up with a BVH and other tricks. There is an earlier project from Leonid Keselman that does it as well.

Edit: there is an even more recent paper about ray tracing Gaussian blobs here:

maturk avatar Oct 02 '24 22:10 maturk