stable-diffusion icon indicating copy to clipboard operation
stable-diffusion copied to clipboard

Training/Fine-tuning img2img

Open lukasfolle opened this issue 2 years ago • 8 comments

Thank you for open-sourcing this awesome project!

I would be interested in training a stable diffusion model conditioned on an input sketch and a text string just like the script under scripts/img2img.py allows, but on my own dataset. Do you provide the training/fine-tuning code for this and I just overlooked it?

:wave: Lukas

lukasfolle avatar Sep 20 '22 08:09 lukasfolle

Hey @lukasfolle, did you have any luck with this? Working on something similar and keen to discuss.

BenjaminIrwin avatar Dec 06 '22 23:12 BenjaminIrwin

Hi Luke & Ben, just you make any progress here? Have been considering something similar for a project I'm working on

peteromallet avatar Jan 19 '23 09:01 peteromallet

Hello, I am also interested in img2img fine-tune. I'm also considering on similar subjects. Did you get any ideas about this?

YJ-142150 avatar Jan 24 '23 12:01 YJ-142150

This worked for me: https://www.reddit.com/r/StableDiffusion/comments/wv2msc/stable_diffusion_img2img_google_collab_setup_guide/

pfdamasceno avatar Jan 24 '23 15:01 pfdamasceno

I looked at it, but it seems that the code is not for fine-tuning.

YJ-142150 avatar Jan 25 '23 02:01 YJ-142150

I looked at it, but it seems that the code is not for fine-tuning.

I have the same question about fintune/train img2img. Maybe img2img is untrainable?

RicoJYang avatar Mar 28 '23 13:03 RicoJYang

I'm curious too

AlexanderKozhevin avatar Dec 09 '23 17:12 AlexanderKozhevin

,ccy a

On Sat, Dec 9, 2023, 11:11 PM Alexander Kozhevin @.***> wrote:

I'm curious too

— Reply to this email directly, view it on GitHub https://github.com/CompVis/stable-diffusion/issues/303#issuecomment-1848592658, or unsubscribe https://github.com/notifications/unsubscribe-auth/AU2KAD57HBWU5X4BJDS664LYISPEHAVCNFSM6AAAAAAQQ2644WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBYGU4TENRVHA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

MrJ0bs avatar Dec 10 '23 15:12 MrJ0bs