How to use my own pictures

[Ginger-X]

Hello, I took a set of pictures and got the camera pose matrix, but don't know how to proceed, such as how to modify or generate .json files. I sincerely hope you can help me, thank you.

[jmunkberg]

Hello,

We currently do not provide detailed instructions on how to run with your own images, but it has been discussed in other issues:

https://github.com/NVlabs/nvdiffrec/issues/33 https://github.com/NVlabs/nvdiffrec/issues/31 https://github.com/NVlabs/nvdiffrec/issues/26 https://github.com/NVlabs/nvdiffrec/issues/3

[Ginger-X]

Thank you, another question I want to ask, after I get the chair.obj and texture in the out file, how to map them and get a textured model in the issac sim?

[jmunkberg]

Hello,

What 3D file format does Isaac Sim support?

This issue https://github.com/NVlabs/nvdiffrec/issues/21 describes how to map the textures to Blender's PBR material (visual shader graph example and export code), perhaps that is helpful.

For USD export, I would recommend looking at NVIDIA Kaolin, which provides a Python USD export option that likely can be adapted to nvdiffrec: https://github.com/NVIDIAGameWorks/kaolin/blob/master/kaolin/io/usd.py#L625