sd-scripts
sd-scripts copied to clipboard
Correct FLUX layer specification for down_lr_weight, mid_lr_weight, up_lr_weight network args?
FLUX's layer structure is huge and confusing. I'd like to be able to isolate which layers I'm training (which on SDXL allows me to train style-only LoRAs more quickly that are smaller and experience far less content bleed). But it's not clear to me how these arguments are supposed to work with Flux layers. When I use the block weights node in comfy, the full FLUX block specification looks something like this:
0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,0,0,0,0,0,0,0,0,0
I know some of these are double layers and some are single layers. Are some of them considered UP, MID, and DOWN? How many of each are there? Or is it correct to specify all layers for both up and down, like this:
... --network_args "down_lr_weight=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,0,0,0,0,0,0,0,0,0,0,0,0 up_lr_weight=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,0,0,0,0,0,0,0,0,0,0,0,0"