CLIP-guided diffusion

Open alex-moon opened this issue 4 years ago • 3 comments

Results from CGD appear to better than those from vqganclip. Investigate and implement!

Check out this colab from Crowson: https://colab.research.google.com/drive/1mpkrhOjoyzPeSWy2r7T8EYRaU7amYOOi?s=09 or https://colab.research.google.com/drive/1uGKaBOEACeinAA7jX1_zSFtj_ZW-huHS?s=09

Also Nerdy Rodent has a repo: https://github.com/nerdyrodent/CLIP-Guided-Diffusion

Might be kind to make a PR to this repo with changes from the updated colabs...

Nov 14 '21 14:11 alex-moon

OK lots of options. Let's try the Crowson colab 256x256 first.

Dec 04 '21 18:12 alex-moon

Using the nerdyrodent one would be easier btw.

Dec 04 '21 20:12 alex-moon

Preliminary results are not promising. CGD doesn't like complex prompts.

Dec 11 '21 08:12 alex-moon