Issue - Flux Loras not working with Flux1-dev-bnb-NF4 model!

[RamonGuthrie]

Flux Loras doesn't seem to be working with Flux1-dev-bnb-NF4 model, I don't see any effect with this model!

[Mirabilis1729]

Seconded. I tried with the Realism Lora that came out and it didn't register it at all when generating.

[hrnf]

I had this issue when the lora tag was at the end of the prompt. Try inserting it at the start.

[Greywolf665]

I had this issue when the lora tag was at the end of the prompt. Try inserting it at the start.

Nope, doesn't work when in front of prompt, or somewhere else

[ptits]

Does lora work with fp8?

[ptits]

I meant flux loras, do they work in Forge with fp8 model?

[Greywolf665]

Lora do not work on non Flux models. Like Lora for XL dose not work on 1.5 and vise-versa.

We are talking about Loras released for Flux.. https://huggingface.co/XLabs-AI/flux-lora-collection

[krakotay]

I meant flux loras, do they work in Forge with fp8 model?

yes, in comfyui with else models all are works

[ptits]

Let me ask again:

Can Xlabs Loras be loaded and work in Forge(not in comfy) with Ferge's FP8 model?

[RamonGuthrie]

Let me ask again:

Can Xlabs Loras be loaded and work in Forge(not in comfy) with Ferge's FP8 model?

The main focus here to be clear is about reporting issues with Forge about Loras not working only!!!

I do use Comfy I have noticed today that when using the Flux1-dev-bnb-NF4 model Loras have no effect, I have also reported that issue here https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4/issues/7

When using fp8 models in ComfyUI with a regular checkpoint, Loras do work but they have a very subtle effect!

[BenDes21]

Fp8 lora's not even work with flux + forge

[txhno]

+1 not working with flux + forge

[wil1974]

My flux nf4 model works with flux realism lora and all the other loras.

https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/981

I'm getting quite similar output given in the examples. https://github.com/XLabs-AI/x-flux

[Greywolf665]

My flux nf4 model works with flux realism lora and all the other loras.

https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/981#discussioncomment-10311362

I'm getting quite similar output given in the examples. https://github.com/XLabs-AI/x-flux

Are you sure? Try the same seed and prompt with and without lora. If it works: Did you update today or are you running any special command line prompts?

[wil1974]

My flux nf4 model works with flux realism lora and all the other loras. https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/981#discussioncomment-10311362 I'm getting quite similar output given in the examples. https://github.com/XLabs-AI/x-flux

Are you sure? Try the same seed and prompt with and without lora. If it works: Did you update today or are you running any special command line prompts?

This is what i get too from the other thread forge dev suggested to test. I followed the sampling method and schedule and the rest to the T.

And i tried out all the examples in the flux github for the loras. same outcome. I got roughly similar output. Can't be the same because they do not provide the seed number. https://huggingface.co/XLabs-AI/flux-lora-collection

Oh ok, I get what you mean now. With or without the lora, the output is the same for the same seed (i fixed the seed).

[RamonGuthrie]

My flux nf4 model works with flux realism lora and all the other loras. https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/981#discussioncomment-10311362 I'm getting quite similar output given in the examples. https://github.com/XLabs-AI/x-flux

Are you sure? Try the same seed and prompt with and without lora. If it works: Did you update today or are you running any special command line prompts?

This is what i get too from the other thread forge dev suggested to test. I followed the sampling method and schedule and the rest to the T.

And i tried out all the examples in the flux github for the loras. same outcome. I got roughly similar output. Can't be the same because they do not provide the seed number. https://huggingface.co/XLabs-AI/flux-lora-collection

Oh ok, I get what you mean now. With or without the lora, the output is the same for the same seed (i fixed the seed).

I have stated the problem above, Loras don't wirh NF4 models in ComfyUI either!

[wil1974]

Oh. I tried with flux-dev-fp8.safetensors and flux1-dev-bnb-nf4.safeteensors. Indeed, the lora dont seem to work. I could have produced the same output using keywords in the prompt without putting on any LORAs.

This is without any keyword. Just a prompt "A handsome man in a suit, 25 years old, cool, futuristic"

This is with the keyword in the prompt "anime"

This is with the keyword in the prompt "disney style"

[al3dv2]

Someone know how to fix this bug ? thanks

[lllyasviel]

For each lora that are not working, give me:

1. lora link
2. lora download link

[al3dv2]

Here the link of the lora file (thanks for your awesome work lllyasviel ) https://huggingface.co/kudzueye/Boreal

https://huggingface.co/kudzueye/Boreal/blob/main/boreal-flux-dev-lora-v04_400_steps.safetensors

or https://huggingface.co/kudzueye/Boreal/blob/main/boreal-flux-dev-lora-v04_1000_steps.safetensors

[CCpt5]

For each lora that are not working, give me:

1. lora link
2. lora download link

Mine on civ (made w/ Ostris trainer) - but simple tuner one doesn't work either:

Ostrist (diffusers + extra layer(s)

https://civitai.com/models/638000/arnold-schwarzenegger-1990s-flux-lora (Arnold Person) https://civitai.com/models/640340?modelVersionId=716167 (Dreamyvibes Artstyle)

Simple tuner: https://huggingface.co/hackmans/RetroBoxartFluxV3/tree/main (ohwx painting artstyle)

[watzon]

@lllyasviel as far as I've been able to tell, no LoRA's work

[artificail22]

Hello these loras do not work: Flux+ Detailer https://civitai.com/models/636355?modelVersionId=712060 FormCorrector Anatomic https://civitai.com/models/641309/formcorrector-anatomic?modelVersionId=717317

[CCpt5]

The PR Ostris submittted to Comfy to update their code so it would support the diffusers/Ostris trainer LoRA key formatting is here (was added to comfy yesterday):

hxxps://github.com/comfyanonymous/ComfyUI/commit/1765f1c60c862f8fc9f3346384a37c5d6d13d35b - change xx to tt.

[BenDes21]

The PR Ostris submittted to Comfy to update their code so it would support the diffusers/Ostris trainer LoRA key formatting is here (was added to comfy yesterday):

hxxps://github.com/comfyanonymous/ComfyUI/commit/1765f1c60c862f8fc9f3346384a37c5d6d13d35b - change xx to tt.

what's that mean for Forge ?

[CCpt5]

The PR Ostris submittted to Comfy to update their code so it would support the diffusers/Ostris trainer LoRA key formatting is here (was added to comfy yesterday): hxxps://github.com/comfyanonymous/ComfyUI/commit/1765f1c60c862f8fc9f3346384a37c5d6d13d35b - change xx to tt.

what's that mean for Forge ?

Explains the differences between the formats.

[RamonGuthrie]

For each lora that are not working, give me:

1. lora link
2. lora download link

Here is a link to XLabs-Al/flux-lora-collection https://huggingface.co/XLabs-AI/flux-lora-collection/tree/main These should be looked at first due to they being currently the most popular Loras!

[BenDes21]

For each lora that are not working, give me:

1. lora link
2. lora download link

Hi, none of the lora's working ( from civitai, huggingface, my personnal lora's created with simpletuner etc.. )

[PixelClassicist]

https://civitai.com/models/641755/flux-at-j-lora

https://civitai.com/api/download/models/717794?type=Model&format=SafeTensor

[xDarkAgentx]

Honestly in forge I don't even see a way to load Loras when you change into XL mode. or redirect it to a folder for them in settings. (I could be blind?) Odd that it picks up the checkpoint models with no issues

[PierrunoYT]

I added a Lora like the Realism one but it's not working.