diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Errors: Converting inpainting diffusers to OG stable diffusion

Open BenjaminIrwin opened this issue 2 years ago • 1 comments

Am I right in saying the diffusers to OG stable diffusion script (link below), shouldn't work for a non-standard architectures?

I've finetuned an inpainting model from Runway's SD 1.5 Inpainting checkpoint. It has 9 input channels instead of 5. I created a .ckpt file from this finetuned model with the script below, but it's crashing Automatic111's repo when I run it.

https://github.com/huggingface/diffusers/blob/main/scripts/convert_diffusers_to_original_stable_diffusion.py

BenjaminIrwin avatar Dec 16 '22 12:12 BenjaminIrwin

Hey @BenjaminIrwin,

We don't actively maintain the diffusers to OG stable diffusion script. Maybe someone from the community can help here though :-)

patrickvonplaten avatar Dec 19 '22 15:12 patrickvonplaten

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Jan 15 '23 15:01 github-actions[bot]

Hi @BenjaminIrwin,

I would really love to have a detailed guide on how you were able to finetune the Runway's SD 1.5 Inpainting checkpoint on a custom dataset for inpainting. It would be great if you could describe to me your process on how I can do the same on my own image-mask dataset.

zaryabmakram avatar Feb 06 '23 07:02 zaryabmakram