floaters: increase sparsity / beta loss, or try a new loss?

[pwais]

I see a lot of floaters in Tanks and Temples (in particular the playground and even the M60 scene). Do you recommend trying to increase the sparsity prior / beta prior to encourage more binary opacity and to try to smooth the background / foreground transition?

Or would trying some other loss be applicable? E.g. something like the "distortion loss" in mipnerf 360 (see section 4 https://arxiv.org/pdf/2111.12077.pdf )

I've tried playing with the scene scale and foreground radius a bit and that can help a little but the floaters seem to be consistent where there is not much camera coverage. (In the playground scene, some of the trees almost always escape the background).

Alternatively, could the sparsity loss just be on a different schedule / learning rate ramp?

dumb idea but perhaps the regularizers should dominate over the color-based loss if voxel-to-camera distance is high?

[reconlabs-sergio]

@pwais, Seeing many floaters here too. Were you successful with any of your strategies?

[Learningm]

Hi, did you resolve the 'floaters' problem? I met the same issue, so many floaters.

[MELANCHOLY828]

I have the same problem too, did you solve it?

[sarafridov]

It looks like code is not available for this yet, but I recently came across a paper that targets floater reduction in Plenoxels, through a mix of initialization and regularization strategies: https://www.sciencedirect.com/science/article/abs/pii/S0950705124007305. Sharing in case anyone finds it helpful.