Kohya Lora not working on flux dev 1 fp8 bnb nf4 and v2

[DarkViewAI]

Expected Behavior

to work

Actual Behavior

not loaded

Steps to Reproduce

load the lora model and prompt

Debug Logs

<img width="887" alt="error" src="https://github.com/user-attachments/assets/28ce5be6-0310-4afb-84d1-bf2833656bf1">

Other

it works fine on flux dev1 and not on any other flux models

[DarkViewAI]

[ltdrdata]

This request should be posted here: https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4/issues