fast-stable-diffusion icon indicating copy to clipboard operation
fast-stable-diffusion copied to clipboard

fine tuning on SD2-512. Got all brown images

Open jgeibel opened this issue 3 years ago • 11 comments

Just saw that SD2-512 was an option, so I did my first training with a dataset I've used on 1.5 many times. When inferencing from that, all I get are brown images (with some black shadows). Curious if I did something wrong?

jgeibel avatar Nov 25 '22 22:11 jgeibel

the problem is with the inference, not the training, the 768 model works fine, but the 512 gives brown images, I'm trying to fin the cause

TheLastBen avatar Nov 26 '22 00:11 TheLastBen

👍

jgeibel avatar Nov 26 '22 00:11 jgeibel

I just actually tried this with 768 and i got the brown. has 512 been fixed?

archimedesinstitute avatar Nov 26 '22 05:11 archimedesinstitute

Could this be issue with how cpkt is converted or read in?

When manually importing the model weights (fine-tuned on sd2.0-base), using StableDiffusionPipeline & different schedulers from diffusers package, it generates just fine

nmeln avatar Nov 26 '22 20:11 nmeln

Could this be issue with how cpkt is converted or read in?

very likely, yes, I don't think diffusers has the right conversion scripts yet.

TheLastBen avatar Nov 26 '22 22:11 TheLastBen

Can someone confirm I can do that in colab? I’m still getting brown outputs and I am really unclear on how to run it through correctly. Thanks!

archimedesinstitute avatar Nov 27 '22 15:11 archimedesinstitute

I got brown outputs with 512 and 768 ckpts, tried running the 768 diffusers output with the official sd 2.0 diffusers pipeline and still the same

Tophness avatar Nov 27 '22 17:11 Tophness

Any update on this? I have nice images after training, but loading ckpt gets all brown

guumaster avatar Dec 05 '22 17:12 guumaster

@guumaster that problem was solved days ago, use the latest colab and make sure you choose the correct model version in the cells

TheLastBen avatar Dec 05 '22 17:12 TheLastBen

I'm using the colab from today (3-4 hours ago), I've chosen the V2-768px version on both dropdown menus

Training and testing is ok. But if I take ckpt to another colab, I get the brown images. Any clues?

guumaster avatar Dec 05 '22 18:12 guumaster

Which other colab, fast-A1111 ? or not from this repo ?

TheLastBen avatar Dec 05 '22 19:12 TheLastBen