Possible to use a pre-trained gaussian splatting and export the SAM extraction into the .ply file?

[abrahamezzeddine]

Hello,

Is it possible to load a pre-trained 3D Gaussian splatting (.ply) model from Nerfstudio and perform semantic segmentation on it? Specifically, I want to segment the entire model, regardless of the view, and export these segments back into the .ply file.

Can I extract the complete semantic segmentation of a Gaussian splatting model, ensuring that all objects in the scene (for example a room with all its objects) are segmented and these segments are stored as unique attributes within the .ply file? The goal is to avoid running SAM (Segment Anything Model) repeatedly on the same model because I need to store this information.

How can I export or append the segmented data into the .ply file for each respective point?

I hope this made sense, thank you! :)