nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

Equirectangular Camera Support

Open akristoffersen opened this issue 2 years ago • 1 comments

Is your feature request related to a problem? Please describe. Currently, 360 data must be taken from the raw Insta360 format, and then the inner rectangle is cropped to get out a usable part of the image. We could solve this either through masking, or by converting the data into another format, like equirectangular.

Describe the solution you'd like This might be difficult, as the sampling from the image has to be updated for equirectangular. Normal uniform sampling over pixels will result in biases around the poles of the image. The viewer may also need updating, as each of the cameras is no longer a flat plane, but a textured sphere (might be fine to just do an equirectangular though).

akristoffersen avatar Nov 03 '22 17:11 akristoffersen

This sounds interesting. I don't mind helping out with this. I even have a Insta360 camera to test as well.

kevinddchen avatar Nov 04 '22 06:11 kevinddchen