stable-dreamfusion icon indicating copy to clipboard operation
stable-dreamfusion copied to clipboard

How dream fusion that takes input as an image

Open shanalikhan opened this issue 1 year ago • 3 comments

Hello, Is it possible, instead of text to generate 3D image. How about If i upload any other image instead and use dream fusion to convert that image to 3D.

Is this possible or certain tweak can be applied, please let me know

shanalikhan avatar Feb 27 '23 12:02 shanalikhan

@shanalikhan Hi, as far as I know, there are already several papers related to this:

  • https://github.com/VITA-Group/NeuralLift-360
  • https://github.com/lukemelas/realfusion

ashawkey avatar Feb 27 '23 13:02 ashawkey

Hi @shanalikhan We've released our implementation that supports image-to-3D (based on ashawkey's current repo) https://github.com/VITA-Group/NeuralLift-360

Ir1d avatar Mar 13 '23 02:03 Ir1d

I found another implementation that generates 3D models from images; it uses Stable Diffusion, but not Stable-DreamFusion.

jarble avatar Apr 08 '23 20:04 jarble