stable-diffusion icon indicating copy to clipboard operation
stable-diffusion copied to clipboard

support image variation ?

Open heurainbow opened this issue 3 years ago • 6 comments

can this diffusion model support image variation without text prompt as dalle2

heurainbow avatar Aug 20 '22 03:08 heurainbow

You can get something similar to Dall-E 2's image variations if you play around with img2img.py. Feed in the original image that you want to get variations for, use the same text prompt that you used to create your original image, and then play around with the "strength" parameter. Higher strength means more of your original image is overwritten with noise, and so the results will be further from your original.

gregturk avatar Aug 20 '22 04:08 gregturk

You can get something similar to Dall-E 2's image variations if you play around with img2img.py. Feed in the original image that you want to get variations for, use the same text prompt that you used to create your original image, and then play around with the "strength" parameter. Higher strength means more of your original image is overwritten with noise, and so the results will be further from your original.

This works only when I generate the init-image first, what if I use a real image instead of a generated one?

heurainbow avatar Aug 20 '22 12:08 heurainbow

You don't need to generate the initial image. You can use a real image just fine. Just resize it to the same dimensions you wish to output.

atarashansky avatar Aug 23 '22 00:08 atarashansky

You don't need to generate the initial image. You can use a real image just fine. Just resize it to the same dimensions you wish to output.

What I need is image translation without conditioning on text prompt, and the generated image must maintain the general semantics of the original image. As in dalle2, the top right image changes into the bottom right one without using the text prompt.

heurainbow avatar Aug 23 '22 01:08 heurainbow

@cunicode same issues here! Have you found an appropriate way to do this? 😭

ZiboZ avatar Jan 07 '23 09:01 ZiboZ

Versatile Diffusion has an image variation task

pribadihcr avatar May 02 '23 06:05 pribadihcr