Wrong Predictions using custom Images

[marcomiglionico94]

I tried to use the Structured 3D pretrained model on some custom images taken from my phone and online. I noticed that the prediction are not very correct and I wanted to know if there is any preprocessing step that needs to be done on the images. Here are some results I obtained:

Any help would be appreciated

[bertjiazheng]

Hi @marcomiglionico94,

Thanks for your interest in our work! A common failure mode of our approach (as discussed in Section 4.4 of our paper) is that the ceiling-wall and floor-wall boundaries are not precisely localized. The reason is clear since our method does not explicitly detect these two boundaries.

Best, Jia

[marcomiglionico94]

Thanks @bertjiazheng any ideas of how we can visualize it in 3 dimensions like you did in the paper? Thanks, Marco

[bertjiazheng]

I will add this feature (same as #1) ASAP.

Best, Jia

[marcomiglionico94]

Great @bertjiazheng, thanks a lot

[marcomiglionico94]

I will add this feature (same as #1) ASAP.

Best, Jia

Hi any updates on this?

[HardikJain02]

I will add this feature (same as #1) ASAP.

Best, Jia

Any plan to publish? If not, you can tell the approach or publish the messy code.