stable-diffusion-webui-forge icon indicating copy to clipboard operation
stable-diffusion-webui-forge copied to clipboard

Controlnet for Flux

Open gin1412a-b opened this issue 10 months ago • 19 comments

Anyone has solutions pls help, really don't want to use comfyUI.

gin1412a-b avatar Feb 22 '25 12:02 gin1412a-b

Image

Image

Image

In a few days I will publish an extension

AcademiaSD avatar Feb 23 '25 05:02 AcademiaSD

In eager anticipation.

Rolf-100R avatar Feb 23 '25 18:02 Rolf-100R

Great job!

soyv4 avatar Feb 23 '25 20:02 soyv4

And to use flux fill with inpainting, is there a solution?

tritant avatar Feb 24 '25 11:02 tritant

I pumped all the models for ControlLNET FLUX does not work! ... Who does ControlLNET work in the blacksmith!? Share models then

Morbleh avatar Feb 24 '25 14:02 Morbleh

And to use flux fill with inpainting, is there a solution?

I have managed to make it work, but I will try to create a canvas environment to manage it correctly, it will be later, after releasing this version.

AcademiaSD avatar Feb 24 '25 21:02 AcademiaSD

I pumped all the models for ControlLNET FLUX does not work! ... Who does ControlLNET work in the blacksmith!? Share models then

I have managed to get them to work using them in diffuser mode.

AcademiaSD avatar Feb 24 '25 21:02 AcademiaSD

I pumped all the models for ControlLNET FLUX does not work! ... Who does ControlLNET work in the blacksmith!? Share models then

I have managed to get them to work using them in diffuser mode.

I am waiting for your application, I hope Laura will work there !!! You can immediately give a link to coffee there!)

Morbleh avatar Feb 24 '25 23:02 Morbleh

Image

Image

Image

In a few days I will publish an extension

Image

Image

Image

几天后,我将发布一个扩展

Hi, is this available for download?

silent37 avatar Feb 25 '25 10:02 silent37

几天后,我将发布一个扩展

Hi, is this available for download?

If all goes well in two days

AcademiaSD avatar Feb 25 '25 12:02 AcademiaSD

几天后,我将发布一个扩展

嗨,这个可以下载吗?

如果两天内一切顺利

So much looking forward to it!!!

silent37 avatar Feb 25 '25 12:02 silent37

Thank you!

gin1412a-b avatar Feb 26 '25 01:02 gin1412a-b

https://www.youtube.com/watch?v=WdTrQchJRmU

AcademiaSD avatar Feb 26 '25 11:02 AcademiaSD

It's not working. I have installed everything - generation is not happening. It says: OSError: Incorrect path_or_model_id: './models/diffusers/text_encoders_FP8'. Please provide either the path to a local folder or the repo_id of a model on the Hub.

But I installed all FP8 text encoders from the link. Can this be related to your requirement to register on a third-party resource and get a token?

Rolf-100R avatar Feb 26 '25 19:02 Rolf-100R

You must unzip the text encoders that you have previously downloaded from my drive, make sure that the text_encoders_FP8 folder exists inside models/diffuser All detailed instructions in the youtube video

AcademiaSD avatar Feb 26 '25 21:02 AcademiaSD

Thank you very much for your reply. I was inattentive, now I've done everything as you said, but it doesn't work again.

The following message appears: Cannot access gated repo for url https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev/resolve/61201579c6a6ad57a1acc19ffe62a1188f8adfc9/model_index.json. Access to model black-forest-labs/FLUX.1-Depth-dev is restricted. You must have access to it and be authenticated to access it. Please log in.

So it was all downloaded for nothing.

Rolf-100R avatar Feb 27 '25 08:02 Rolf-100R

Thank you very much for your reply. I was inattentive, now I've done everything as you said, but it doesn't work again.

The following message appears: Cannot access gated repo for url https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev/resolve/61201579c6a6ad57a1acc19ffe62a1188f8adfc9/model_index.json. Access to model black-forest-labs/FLUX.1-Depth-dev is restricted. You must have access to it and be authenticated to access it. Please log in.

So it was all downloaded for nothing.

You may have to accept the terms of this link https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev

AcademiaSD avatar Feb 27 '25 11:02 AcademiaSD

I pumped all the models for ControlLNET FLUX does not work! ... Who does ControlLNET work in the blacksmith!? Share models then

I have managed to get them to work using them in diffuser mode.

I am waiting for your application, I hope Laura will work there !!! You can immediately give a link to coffee there!)

LoRAs work now!

AcademiaSD avatar Feb 27 '25 11:02 AcademiaSD

Hi, thank you for making this available to us! I'm running on a 3060 Nvidia, aftyer each image generation I have to restart Forge because I get the dreaded error: torch.cuda.OutOfMemoryError: Allocation on device

Any pointers on how to fix this?

donwildman avatar Apr 03 '25 23:04 donwildman