SuGaR icon indicating copy to clipboard operation
SuGaR copied to clipboard

Holes in recontructed mesh

Open turandai opened this issue 1 year ago • 2 comments

Hi, thanks for your nice work! I meet some strange issues that there are big holes in the reconstructed meshes, both coarse and refined mesh. I was trying to set the extraction level set to smaller values, the Gaussians do expand but still not fully cover the holes. I am wondering what should I do to fix this problem? Thank you very much! Screenshot from 2024-01-20 17-44-04

turandai avatar Jan 20 '24 09:01 turandai

Hi, we have encountered a similar issue using own data. Do you have any ideas to resolve it? Thanks.

ShiQiu0419 avatar Jan 24 '24 12:01 ShiQiu0419

Hello guys,

For scenes like this one, where the camera is very close to a simple object (and there may be no background), the default hyperparameters used for Poisson reconstruction are too fine compared to the size of the Gaussians, which produce results like this: Gaussian are visible on the mesh, and you may have some holes.

To increase the quality and make these weird Gaussian bumps disappear, you should reduce the depth of the poisson reconstruction, as well as the threshold used for cleaning the poisson mesh. You can do it by modifying lines 42 and 43 of sugar_extractors/coarse_mesh.py (I just pushed a small change of the script, so please pull the changes before). You could change these lines from

    poisson_depth = 10  # 10 for most real scenes. 6 or 7 work well for most synthetic scenes
    vertices_density_quantile = 0.1  # 0.1 for most real scenes. 0. works well for most synthetic scenes

To the following:

    poisson_depth = 6  # 10 for most real scenes. 6 or 7 work well for most synthetic scenes
    vertices_density_quantile = 0.  # 0.1 for most real scenes. 0. works well for most synthetic scenes

You can also try poisson_depth = 7 for example.

Anttwo avatar Feb 15 '24 14:02 Anttwo