ControlNet icon indicating copy to clipboard operation
ControlNet copied to clipboard

Published 20 hours ago • verified publisher icon lllyasviel

merge with Dreambooth

Open rese1f opened this issue 2 years ago • 1 comments

What a wonderful work! I'm thinking about how this model merge with Dreambooth. I mean, how to train like Dreambooth style, just the same as vanilla stable diffusion is fine?

rese1f avatar Feb 15 '23 13:02 rese1f

You could first finetune SD (with Dreambooth), then use the finetuned weights to train ControlNet.

xiankgx avatar Feb 16 '23 05:02 xiankgx

What a wonderful work! I'm thinking about how this model merge with Dreambooth. I mean, how to train like Dreambooth style, just the same as vanilla stable diffusion is fine?

You can use control net on any model, if you are using the auto1111 extension.

Ihateyoudattebayo avatar Feb 16 '23 21:02 Ihateyoudattebayo

@Ihateyoudattebayo which way is better? using finetuned Dreambooth model to train ControlNet, or use control net for finetune Dreambooth?

SajjadAemmi avatar Feb 22 '23 12:02 SajjadAemmi

@Ihateyoudattebayo which way is better? using finetuned Dreambooth model to train ControlNet, or use control net for finetune Dreambooth?

The second one

Ihateyoudattebayo avatar Feb 22 '23 12:02 Ihateyoudattebayo

How do we do it through code? without using the plugin?

geekyayush avatar Feb 26 '23 13:02 geekyayush

I would like to do it in code too. Docs are very weird about this specific part.

rvizcaino80 avatar Feb 27 '23 01:02 rvizcaino80

some genius has try this successfuly, https://www.reddit.com/r/StableDiffusion/comments/1174pjp/controlnet_dreambooth/

xs1997zju avatar Mar 08 '23 13:03 xs1997zju