eg3d
eg3d copied to clipboard
NVlabs
Hope that this will be setup on Colab
Would be awesome if the Inversion Demo could be set up on colab. That way we could also try making 3d avatars of ourselfs with just a single input image.
Would be awesome if the Inversion Demo could be set up on colab.
Yes, like the one for https://github.com/facebookresearch/pifuhd
Looking forward to see the code for eg3d.
Beta, let me know if anything breaks! https://colab.research.google.com/drive/1nu4maHdENDav54UUYk7H0MjC3IBP81yZ
Beta, let me know if anything breaks! https://colab.research.google.com/drive/1nu4maHdENDav54UUYk7H0MjC3IBP81yZ
Thank you for making the Colab notebook! How can I use this notebook to generate novel views images and head around views videos like the one in #28 ? I would like to generate them from a single face photo of a particular person.
Beta, let me know if anything breaks! https://colab.research.google.com/drive/1nu4maHdENDav54UUYk7H0MjC3IBP81yZ
Thank you for making the Colab notebook! How can I use this notebook to generate novel views images and head around views videos like the one in #28 ? I would like to generate them from a single face photo of a particular person.
You should put that photo into this cell
(just remove the default URL link)
Then tweak focal length and make sure the optimization doesn't break. After that you can export the model and open it in something like Blender. I will probably add normalization and look around views like in #28 in the next version, thanks for the idea!
Beta, let me know if anything breaks! https://colab.research.google.com/drive/1nu4maHdENDav54UUYk7H0MjC3IBP81yZ
Thank you for making the Colab notebook! How can I use this notebook to generate novel views images and head around views videos like the one in #28 ? I would like to generate them from a single face photo of a particular person.
You should put that photo into this cell
(just remove the default URL link)
Then tweak focal length and make sure the optimization doesn't break. After that you can export the model and open it in something like Blender. I will probably add normalization and look around views like in #28 in the next version, thanks for the idea!
Thank you for your reply. I see. I'd like to try the around view version. Once that's done, I want to be first in line to run it!
Thank you for your reply. I see. I'd like to try the around view version. Once that's done, I want to be first in line to run it!
Lookarounds are done #47
Lookarounds are done #47
I've done, too!
But The generated images do not resemble the person's face, have different faces mixed in, or have a lot of noise.
https://streamable.com/qw5l4z
And I would like to download "video.mp4" instead of "video.gif" if possible, cause I couldn't have found that mp4.
What should I do?
It looks like your optimization broke (look at the upper left corner, it should be similar to upper right). You should tune parameters like focal_length and the optimization weights.
You can change the video save path in the cell below from video.gif to video.mp4 but I haven't tested it
FYI We added additional scripts that can preprocess in-the-wild images compatible with the FFHQ checkpoints. https://github.com/NVlabs/eg3d/issues/18#issuecomment-1200366872
Thanks Neverix for your work. It is really appreciated. I use your Colab notebook and I feel like the images generated are always frontal view and the colours are usually dull. Why is this? . Also the inversion is not very accurate in terms of likeness. Is this due to the database? , Is there any way to obtain the same results as in the videos of the paper (different positions, full colour) and the same quality in inversion as in Stylegan3?. It would be great if this could be setup On the other hand, showing the depth maps is a great feature!. Thanks again for your work.
Thank you very much @neverix for the notebook. Is it possible to use another dataset, for example of flowers ? We are trying to convert images of flowers into basic 3D forms for an artistic project. It seems possible in their explanation but maybe not on the colab notebook ? I am pretty new on the subject. All help is greatly appreciated !
