playcanvas
does spherical harmonics data supports for gaussian splatting model visualization?
Hello, i wanted to know does the app supports spherical harmonics data in rendering? e.g. with spherical harmonics at 3rd degree.
Hi @hardikdava ,
No, the model viewer doesn't render with spherical harmonics. Is this important for your use case? Can you explain what you need it for?
In general the extra memory and rendering overhead has meant SH isn't a priority for us, but is something we will add, depending on user requirements.
Thanks!
@slimbuck thanks for quick reply.
I am working on gaussian splatting and I have observed that there is a huge difference in rendering images with and without spherical harmonics. The rendering with spherical harmonics looks much more promising and detailed. Here you can check the difference. I think there should be an option to enable it based on user selection. However, I agree that it might be slow.
Hi @hardikdava,
Yes I see. Most of the difference in the overall saturation is because we just throwing away some of the SH data and what's left is desaturated compared to the original. It would be nice if we could figure out a better method of going from SH->color, but till then I guess the only option is to add SH rendering support.
It probably won't be added too quickly, but we'll use this ticket to prioritise the work.
Thanks!
It seems most of the difference is just due to the difference in contrast, not due to missing SH data. I loaded your first image into photopea.com, applied contrast (using curve black and while point adjustment), and the image looks very similar to the point of not being able to tell the difference.
Depending on what viewer is used, you could check if it has contrast controls or similar, or at least what tone mapping iss used.
