Add backward gradients for camera intrinsics

Open arthurhero opened this issue 8 months ago • 5 comments

Hi,

Thank you for the great work! May I ask if you have plan to add gradients for camera intrinsics (fxfycxcy)? I think there are gradients provided for extrinsics already. It would be great to have gradients for intrinsics as well!

Thank you very much, Ziwen

Jun 03 '25 22:06 arthurhero

I'm also very interested in this problem. If we can make the intrinsics differentiable, we might not need COLMAP or bundle adjustment anymore.

Jun 12 '25 04:06 zhanglq2024

See this new paper! https://arxiv.org/html/2502.19800v1 I might look into implementing it for gsplat...

Sep 20 '25 00:09 nlml

Got this working (I think) ! PR here: https://github.com/nerfstudio-project/gsplat/pull/801

Sep 23 '25 02:09 nlml

Got this working (I think) ! PR here: #801

Looks like a huge amount of work! Thank you, Liam! I will try it out

Oct 12 '25 06:10 arthurhero

@arthurhero no worries! Let me know if it seems to work for you, I haven't tested it deeply yet.

Oct 15 '25 02:10 nlml