stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

[Feature Request]: Please add support for the FLUX model, thank you!

Open divineblessing opened this issue 1 year ago • 12 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

The FLUX model's hand processing and prompt accuracy are incredibly powerful, and it's been super popular recently!

Proposed workflow

  1. thank you!
  2. thank you!
  3. thank you!

Additional information

No response

divineblessing avatar Aug 13 '24 08:08 divineblessing

we neeeeeeed this :)

Ahmet-Dedeler avatar Aug 13 '24 21:08 Ahmet-Dedeler

Needed add

BimBomBin avatar Aug 15 '24 12:08 BimBomBin

Duplicate of https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/16311 You can close it.

TLDR: SD WebUI uses a different diffusion library than what Flux is supported on. It would be a lot of effort to change it.

FlyWieEinAirplane avatar Aug 15 '24 18:08 FlyWieEinAirplane

@FlyWieEinAirplane and that's bad. I don't wanna use that clusterfuck comfyui =_=

Therises avatar Aug 18 '24 18:08 Therises

@FlyWieEinAirplane and that's bad. I don't wanna use that clusterfuck comfyui =_=

Then use Forge

nailz420 avatar Aug 18 '24 20:08 nailz420

Forge has a lot of extensions not working or just not there.

bobba84 avatar Aug 19 '24 00:08 bobba84

Why does A1111 use a different diffusers setup than the standard release?

Filthy420 avatar Aug 22 '24 19:08 Filthy420

Why does A1111 use a different diffusers setup than the standard release?

I think there is nothing standard about Flux

tetsuoo-online avatar Sep 03 '24 16:09 tetsuoo-online

Even in Forge only "Euler" and sometimes "LMS" samplers are working on FLUX and this only on the "simple" type (no karras or others). So Forge seems to have problems with FLUX too.

Rendering a prompt from A1111 in Forge with identical settings, generates a different picture. ... at least on my system.

So I think it's very important, to keep care on integrating FLUX, not to disturb the usual behaviour and functionality of A1111 for the older models. So if FLUX comes, it's welcome, but not for every price.

schoenid avatar Sep 08 '24 01:09 schoenid

Karras and exponential sampler types do not work on SD3/FLUX type of models regardless of backend.

nailz420 avatar Sep 08 '24 15:09 nailz420

Karras and exponential sampler types do not work on SD3/FLUX type of models regardless of backend.

... because it's not yet included/added/improved ...

schoenid avatar Sep 11 '24 01:09 schoenid

Karras and exponential sampler types do not work on SD3/FLUX type of models regardless of backend.

... because it's not yet included/added/improved ... This is how it was explained to me - "early SD models used stochastic flow, ie they were designed every step to take random noise and remove it until they get an image back. Modern SD models (SD3, Flux) use rectified flow, ie they were designed to take one initial noise blob and step iteratively towards a known trajectory of where the image will be. Rectified flow is the key to how example how turbo models work - once you have a known trajectory, you can distill the model to travel the known path much quicker.

Karras, Exponential, and all the other schedulers n samplers are basically ways of actively fucking up the denoising process, based on the principle that - well, it's random intelligent noise removal, maybe if we give it differenty noise, it'll do betterer. And sometimes it does. These all don't apply to rectified flow because it is now trying to work with a predictable coherent trajectory, so fucking around with the noise just breaks the one thing it's been trained to do."

nailz420 avatar Sep 11 '24 03:09 nailz420

[lllyasviel]/ [stable-diffusion-webui-forge] seems to support Flux now

evan8686 avatar Nov 24 '24 07:11 evan8686

[lllyasviel]/ [stable-diffusion-webui-forge] 似乎现在支持 Flux

But I can't live without comfyui anymore.

divineblessing avatar Dec 06 '24 01:12 divineblessing