dn-splatter icon indicating copy to clipboard operation
dn-splatter copied to clipboard

reproduce results on Tanks&Temples Auditorium

Open jinmaodaomaye2021 opened this issue 10 months ago • 0 comments

Hi author,

Thanks for your contribution of using monocular cues to supervise 3D GS. I am trying to reconstruct the Tanks&Temples Auditorium scene with your code and compare with the results from monosdf. Unfortunately, I found the mesh reconstruction from your code is inferior to monosdf. I am not sure if I followed the same setting as your paper.

The first video is from your code and the second video is from monosdf.

I also attached the rendered depth map and the normal map from DN-Splatter. The depth map looks ok and the normal map is not smooth. Any idea why ?

Thanks.

Experiment setting:

  • mono depth supervision with ZoeDepth, aligned with SfM sparse depth

  • surface normal supervision with Omni data

  • command for training

ns-train dn-splatter --max-num-iterations 30000 --pipeline.model.use-depth-loss True --pipeline.model.mono-depth-lambda 0.2 --pipeline.model.use-depth-smooth-loss True --pipeline.model.use-normal-loss True --pipeline.model.normal-supervision mono coolermap --data Auditorium --depth-mode mono --load-normals True --normals-from pretrained --normal-format opengl --load-depths True

  • command for mesh extraction

gs-mesh dn --load-config Auditorium/config.yml --output-dir Auditorium

https://github.com/maturk/dn-splatter/assets/89769436/3486b281-0d9c-442e-bbdc-4050811249a2

https://github.com/maturk/dn-splatter/assets/89769436/e03bb543-ca23-461e-8835-8a885f18fc47

Screenshot from 2024-04-22 14-51-55

Screenshot from 2024-04-22 14-52-26

jinmaodaomaye2021 avatar Apr 22 '24 21:04 jinmaodaomaye2021