Sébastien Carbain
Sébastien Carbain
Just a quick note, we might soon have a great inpainting model from BrushNet authors. Their inpainting model works great on SD1.5 and they're currently training SDXL. https://github.com/TencentARC/BrushNet
Hi @juxuan27, any idea on when BrushNet for SDXL might be released ? :)
Why don't you use the diffusers pipeline to perform inference with your trained ControlNet ? Personally, I use diffusers to both train and perform inference : https://huggingface.co/docs/diffusers/api/pipelines/controlnet It's easier and...
What errors do you get ? Why don't you also train using diffusers ? https://github.com/huggingface/diffusers/tree/main/examples/controlnet
Same ! An approximative schedule would be much appreciated :)
Great, thanks! I have a 12GB vram gpu, does it also work for training ? Currently I can't train, even with a batch size of 1 I get OOM errors
I also tried using xformers but I kept having incompatibility issues
I've managed to make the training work but reading your paper, the current published models were trained for 10 epochs on at least 120K images. That's a lot of steps...
I often have this error in forge when using batch size > 1 or when using fooocus inpainting. Don't know if it's correlated.
No, I haven't tried again