fast-stable-diffusion icon indicating copy to clipboard operation
fast-stable-diffusion copied to clipboard

V2 generate noise instead of images.

Open ozeron opened this issue 3 years ago • 6 comments

First of all, thank you for your work, you are amazing. 🙇‍♂️ 🙇‍♂️ 🙇‍♂️

I tried from scratch V2 notebook a few times and it consistently generate only noise, I tried a few prompts different variations of sampler, number of training. It generates noisy images, which are far from what I prompt.

I tried a picture of person with negative prompt/and without (((stock photo))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), grayscale, black and white, (((bad composition))), ((((stock photo)))) 00000-705790541-a picture of p

Screenshot 2022-11-29 at 20 12 07 Screenshot 2022-11-29 at 20 17 06

Tried various sampling steps:

  • changing sampling steps
  • changing steps
  • playing with sampler
  • prompts
  • CFG scale
  • picked 512 model and generated 512 pix images

Any suggestions?

P.S. wiped everything. Remove sd folder and got same results: Screenshot 2022-11-29 at 20 32 27

ozeron avatar Nov 29 '22 20:11 ozeron

Hi, did you delete/rename the folder sd recently ? if you didn't you should, and always use the colab from the link to avoid being out of date : https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast_stable_diffusion_AUTOMATIC1111.ipynb

TheLastBen avatar Nov 29 '22 20:11 TheLastBen

We've all been there, just change the resolution to the trained model 768 x 768 (or higher)

Topzie avatar Nov 29 '22 22:11 Topzie

I had the same problem with the V2 colab version for free colab users. What worked for me is: Select under the point "Start stable-diffusion -> Model_Version:" the model V2-768 instead of the V2-512 (with the V2-512 comes only noise, no matter what you set in the Web-UI). After you have executed the point and started the web UI, set the resolution to 768x768 and everything works normally without noise.

Ted-Teddy avatar Nov 30 '22 09:11 Ted-Teddy

I had the same problem with the V2 colab version for free colab users. What worked for me is: Select under the point "Start stable-diffusion -> Model_Version:" the model V2-768 instead of the V2-512 (with the V2-512 comes only noise, no matter what you set in the Web-UI). After you have executed the point and started the web UI, set the resolution to 768x768 and everything works normally without noise.

That fixed it for me, thanks! However, I still do get noise with some settings in the Web UI. Not sure which specifically are triggering this.

acjbizar avatar Dec 03 '22 12:12 acjbizar

Have u fixed the issue?

orshi avatar Jul 11 '23 06:07 orshi

i started to change the config file from v2-inference.yaml to v2-inference-v.yaml , then fixed this problem. hope it can help you

RRooyyCChheenn avatar Mar 27 '24 13:03 RRooyyCChheenn