ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

Flux Lora from SimpleTuner training not working with ComfyUI

Open a-l-e-x-d-s-9 opened this issue 6 months ago • 2 comments

Expected Behavior

Flux Lora form SimpleTuner loading and working.

Actual Behavior

Lora not loading. Created a bug report for SimpleTuner.

Steps to Reproduce

Use link to Lora. With simple Lora loading workflow.

Debug Logs

Getting a list of "lora key not loaded" in ComfyUI:


lora key not loaded: transformer.transformer_blocks.0.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.0.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.0.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.0.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.0.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.0.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.1.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.1.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.1.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.1.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.1.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.1.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.10.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.10.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.10.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.10.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.10.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.10.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.11.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.11.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.11.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.11.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.11.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.11.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.12.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.12.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.12.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.12.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.12.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.12.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.13.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.13.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.13.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.13.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.13.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.13.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.14.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.14.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.14.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.14.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.14.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.14.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.15.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.15.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.15.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.15.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.15.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.15.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.16.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.16.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.16.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.16.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.16.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.16.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.17.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.17.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.17.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.17.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.17.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.17.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.18.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.18.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.18.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.18.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.18.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.18.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.2.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.2.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.2.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.2.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.2.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.2.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.3.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.3.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.3.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.3.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.3.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.3.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.4.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.4.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.4.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.4.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.4.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.4.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.5.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.5.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.5.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.5.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.5.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.5.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.6.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.6.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.6.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.6.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.6.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.6.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.7.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.7.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.7.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.7.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.7.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.7.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.8.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.8.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.8.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.8.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.8.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.8.attn.add_v_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.9.attn.add_k_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.9.attn.add_k_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.9.attn.add_q_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.9.attn.add_q_proj.lora_B.weight
lora key not loaded: transformer.transformer_blocks.9.attn.add_v_proj.lora_A.weight
lora key not loaded: transformer.transformer_blocks.9.attn.add_v_proj.lora_B.weight


### Other

Flux Lora from SimpleTuner training not working with ComfyUI.

a-l-e-x-d-s-9 avatar Aug 08 '24 15:08 a-l-e-x-d-s-9