stable-dreamfusion icon indicating copy to clipboard operation
stable-dreamfusion copied to clipboard

Published 20 hours ago • verified publisher icon ashawkey

Pretrain NeRF

Open Pashtetickus opened this issue 1 year ago • 2 comments

Hi!

I'd like to know if there is a simple way of loading (or training) a pretrained NeRF model. For example, if i want to start not with a random initialization but with a NeRF, that has been trained on a sphere, human etc.

Thank you!

Pashtetickus avatar Apr 19 '23 02:04 Pashtetickus

@Pashtetickus Hi, for NeRF this can be a little hard as we assume known lighting conditions, where most reconstruction methods do not support. However, you can load a mesh into the second DMTet stage to initialize the SDF grid, which is used in methods like Fantasia3D (You'll still need to modify some code to achieve this)

ashawkey avatar Apr 19 '23 12:04 ashawkey

Hi! @ashawkey I think my question relates to this issue as well. Is it possible to train Nerf in stable dream-fusion as in https://github.com/ashawkey/torch-ngp with data like fox dataset for example?

ToxaSurkov avatar Apr 20 '23 12:04 ToxaSurkov