nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

Support for individual intrinsics? (feature request)

Open pooncs opened this issue 2 years ago • 2 comments

Hi I was wondering if there is any plans to include individual camera intrinsics, while keeping backwards compatibility to the current transforms.json file, as with instant-ngp? That'll be helpful for training on images in the wild, where the camera resolution and intrinsics are different.

pooncs avatar Oct 13 '22 16:10 pooncs

Good request! @jake-austin has been working on this right now. Maybe you can comment on the state of this feature?

ethanweber avatar Oct 13 '22 17:10 ethanweber

Just about there. All on the CamerasV2 branch. Last night I think I about cracked it, I just need to write more exhaustive and stress tests and make sure that I'm correctly processing all combinations of inputs to the generate_rays() function and whatnot. Also need to resolve some weird viewer issues since it was training correctly last night, just the viewer wasn't showing the model itself.

That being said, I fully agree that this is something that needs to happen, and I really want this to be a feature that we have support for... my main dev priority is getting this up asap

jake-austin avatar Oct 13 '22 18:10 jake-austin

Added documentation in #1246

tancik avatar Jan 17 '23 18:01 tancik