diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Support for SD 2.1 in dreambooth (ShivamShrirao)

Open slives-lab opened this issue 2 years ago • 5 comments

Support for SD 2.1 in dreambooth (ShivamShrirao) Is there an updated SD v2.1 model for dreambooth?

https://github.com/ShivamShrirao/diffusers/tree/main/examples/dreambooth

slives-lab avatar Jan 03 '23 22:01 slives-lab

I was able to successfully use this repo (and the example/dreambooth scripts) with SD2.1 512 base. Just the AUTOMATIC1111 is a bit picky with the resulting models and needs an additional yaml config file

chris-aeviator avatar Jan 04 '23 19:01 chris-aeviator

@chris-aeviator Hey, I wonder if those YAML files do the work in your case? Or is there any other YAML file sources that you are using with your fine-tuned SD v2.x models?

https://github.com/Stability-AI/stablediffusion/tree/main/configs/stable-diffusion

NeoAnthropocene avatar Jan 05 '23 11:01 NeoAnthropocene

I have success with 2.1 768, but always have unusable result with 2.1 512(base) model

sebaxakerhtc avatar Jan 16 '23 18:01 sebaxakerhtc

I have success with 2.1 768, but always have unusable result with 2.1 512(base) model

Thanks for the feedback! I wonder if there is an update on the repo, because whatever I tried; I can't get reasonable results with the SD 2.1 -768.

If you don't mind, would you please share your training settings with us?

NeoAnthropocene avatar Jan 16 '23 19:01 NeoAnthropocene

would you please share your training settings with us?

Ok. Give me a half an hour - i will repeat the steps to train 2.1 768 model If matters - i use Automatic1111 with dreambooth extension based on this repo

Upd: So... It works again. Quadro RTX A4000 Scheduler: euler-ancestral

Screenshots of settings:

I have these files

v2-1_768-ema-pruned.ckpt
v2-1_512-ema-pruned.ckpt

sebaxakerhtc avatar Jan 16 '23 19:01 sebaxakerhtc