SuGaR
SuGaR copied to clipboard
Artifacts on a reomved/black_background data
first of all, thx for the great work and sharing with the community !!!
I had a 360 degree data recording a human in the center, so I was expecting a noisy reconstruction in the background area since there is no enough coverage for it. I tried to run SuGaR with the original images and had got what I expected.
So in order to get a clean reconstructed mesh of my "target", I segmented the foreground human and set the background as empty, namely [0,0,0] for the background pixels. Then I got a result similar to the one described by @ansj11 in the https://github.com/Anttwo/SuGaR/issues/72#issuecomment-1968443831 issue, with black artifacts in the background, mostly around the head and the feet, like below
Then I tried to change the vertices_density_quantile = 0.1 in line 42 in the sugar_extractors/coarse_mesh.py to vertices_density_quantile = 0 as the empty background data is similar to the synthetic scenes, the result was not much better, like
Though the holes in the back and the head were filled in some way, the artifacts seems to be worse.
I've also tried to set the poisson depth from 10 to 7, it did not help.
I understood that this is mainly because that SuGaR does not support masked data yet. But I remembered that in a other issue slot @Anttwo you mentioned that you've already implemented this and would update the code soon. It is defintely not a "chasing-up" :p haha. Maybe you can give me some advise about how to do this.
Thx again for the great work and I'm looking forward to your reply.