Track to which gaussian splats XYZ points belong to in term of pixel coordinates and image when using splatfacto?

[abrahamezzeddine]

Hello,

With COLMAP, it is possible to extract data to determine which images and keypoints correspond to specific 3D points and to identify which images have been matched.

I am wondering if it is possible to track which Gaussian splats correspond to which keypoints, along with their associated image files and pixel coordinates. Is there a way to "tap" into the code to keep track of this when using Nerfstudio?

Specifically, I want to identify the originating image and pixel coordinate for each Gaussian splat (with respect to the point cloud). While COLMAP provides this information for 3D points, I would like to know if it is possible to extend this tracking to the exported PLY file for the splats, even after a split.

I assume that I need to utilize the exported .ply file, transforms.json and the images-folder.