stable-dreamfusion icon indicating copy to clipboard operation
stable-dreamfusion copied to clipboard

The texture when I use fine-tuning with DMTet (mesh representation)

Open ug-kim opened this issue 1 year ago • 2 comments

I have some questions about DMTET fine-tuning.

DMTet makes mesh as final representations; I'm curious how we learn the texture of mesh at DMTet fine-tuning stages.

And how do you render mesh rendering with geometry and texture?

It would be appreciated to tell me about the method and code part.

Thanks for sharing your awesome work.

ug-kim avatar Apr 20 '23 11:04 ug-kim

@ug-kim Hi, the code of DMTet is majorly adapted from nvdiffrec. You may check their paper for a detailed explanation. In summary, we still use the 3D hashgrid from NeRF stage to encode the texture during training, and only bake it into 2D texture images at exporting.

ashawkey avatar Apr 20 '23 11:04 ashawkey

@ashawkey Thank you for your fast and kind response! I will check the paper you mentioned :)

ug-kim avatar Apr 20 '23 16:04 ug-kim