2d-gaussian-splatting icon indicating copy to clipboard operation
2d-gaussian-splatting copied to clipboard

gaussians spread out at no background dataset

Open qianqiuzzz opened this issue 9 months ago • 1 comments

When I use a dataset with no background, gaussians begins to become scattered, they appear in the background position after 7k iterations, causing black areas to appear in the mesh. Is this phenomenon caused by Normal Consistency regularization? Is there any way to avoid this problem? image image

qianqiuzzz avatar May 10 '24 07:05 qianqiuzzz

Hi, We haven't tested our algorithm for scenes without background. Because the floater can learn fake background color, an intrinsic ambiguity of volume rendering, the normal consistency loss may treat it as solid object and may spread these floaters. I suggest you move the start iteration of normal consistency after densitification , e.g., 15k, when the floaters may have been effectively cleaned by reset opacity. Or if you have a background mask, just use it to mask the regularization loss. Hope these will help.

hbb1 avatar May 10 '24 08:05 hbb1

Hi, We haven't tested our algorithm for scenes without background. Because the floater can learn fake background color, an intrinsic ambiguity of volume rendering, the normal consistency loss may treat it as solid object and may spread these floaters. I suggest you move the start iteration of normal consistency after densitification , e.g., 15k, when the floaters may have been effectively cleaned by reset opacity. Or if you have a background mask, just use it to mask the regularization loss. Hope these will help.

怎么移动normal consistency的迭代呢?

shiwangyan avatar Jun 03 '24 12:06 shiwangyan