Scaffold-GS icon indicating copy to clipboard operation
Scaffold-GS copied to clipboard

How to view ply in supersplat

Open HuangTY96 opened this issue 10 months ago • 5 comments

Hi, This work is perfect, but the result cannot be displayed in those existing tools like supersplat and unity. Do you have any ideal to deal with this problem?

HuangTY96 avatar Apr 08 '24 06:04 HuangTY96

Any update on this?

fantasy-fish avatar Aug 18 '24 09:08 fantasy-fish

We will soon release the anchor version of 3DGS, and the training results can be converted to standard 3DGS.ply files, which can be used in web viewer and UE5

tongji-rkr avatar Aug 21 '24 06:08 tongji-rkr

@tongji-rkr How is going of 'anchor version of 3DGS'? It's really usefull for showcase online.

hecodeit avatar Sep 20 '24 14:09 hecodeit

We propose Octree-AnyGS, a general anchor-based framework that supports explicit Gaussians (2D-GS, 3D-GS) and neural Gaussians (Scaffold-GS). Additionally, Octree-GS has been adapted to the aforementioned Gaussian primitives, enabling Level-of-Detail representation for large-scale scenes. This framework holds potential for application to other Gaussian-based methods. Please refer to https://github.com/city-super/Octree-AnyGS.

tongji-rkr avatar Sep 25 '24 14:09 tongji-rkr

@tongji-rkr

Checked the project: https://github.com/city-super/Octree-AnyGS.

Lack of the document and "The SIBR viewers is coming soon". So how "...converted to standard 3DGS.ply files..." with Octree-AnyGS?

hecodeit avatar Sep 25 '24 21:09 hecodeit

Each anchor in the anchor version of 3D-GS can be converted to a SH0 Gaussian, which I think does not depend on the SIBR viewers.

tongji-rkr avatar Oct 07 '24 01:10 tongji-rkr

I think the main problem lies in how to obtain the spherical harmonic coefficients of orders 1-3, because rgb colors can be easily obtained, corresponding to the spherical harmonic coefficient of order 0.

muzol132126 avatar Nov 20 '24 04:11 muzol132126

Scaffold-GS uses MLP to obtain view-dependent RGB results, so it is difficult to directly convert to SH1-3, but we also try to modify the MLP output as SH functions and obtained good results.

tongji-rkr avatar Dec 11 '24 04:12 tongji-rkr