Generating textured meshes.

[codinghaven]

How difficult would it be to generate a textured mesh with Atlas?

Thanks!

[zmurez]

There is a color head implemented which regresses RGB color: https://github.com/magicleap/Atlas/blob/bee3ddbdb0935cf9aa9fc810e829115c6ab74dc5/atlas/heads3d.py#L211 The results are OK, but quite blurry (unfortunately we do not provide a pretrained model for this configuration). More work on hyperparameter tuning and network architecture could help with this, along with additional losses like a GAN loss. The simple averaging of feature volumes is also a probable culprit for the network having a hard time just copying the color from the input images without blurring.

If you are willing to pass through the image sequence twice, you can first reconstruct the mesh with Atlas and then in a second pass use existing mesh texturing algorithms to backproject the images onto the mesh.