AI-Friends icon indicating copy to clipboard operation
AI-Friends copied to clipboard

Any Chance of New NeRF method implementation?

Open Maki9009 opened this issue 2 years ago • 2 comments

was wondering if you are considering on adding https://github.com/graphdeco-inria/gaussian-splatting for training and viewing since NeRF never really have any good GUI going for them and the setup process is Hell... but this new Gaussian Splatting brings a lot of quality in realtime.. So just wondering if you were considering add this?

Maki9009 avatar Aug 23 '23 16:08 Maki9009

I think that's doable.. Just got started adapting the Instant-NGP code to apply to that. I've looked into other alternatives to Instant-NGP, and they weren't looking ready enough, but this could work. I won't do the real-time viewer they've got since it's OpenGL and looks like it's made in C. Trying to figure out the best way to run it and what extra parameters I can use. Would like to simplify it to generate a textured mesh obj file from the ply point-cloud to make the 3D file usable, but not seeing a clean way to do it. Just getting back a rendered video flythrough doesn't seem practical enough. Did you want to help contribute to the implementation, or just leave it to me? I got a good start already, just need to dig in deeper to the gaussian splatting code. I've been looking for more 3D AIs to include, and just haven't been too satisfied with the ones I've played with so far...

Skquark avatar Aug 24 '23 06:08 Skquark

Honestly if i knew how I’d implement it I would have already started but no clue.. tbh sorry. But I think if u can simplify the process to train a model, and then perhaps just allow a pass through to their real-time viewer… even though that has horrible controls.. but honestly the quality for this is incredible yeah

Maki9009 avatar Aug 24 '23 11:08 Maki9009