[Bug]: Loading SDXL Dora as Base Lora Fails

Open Calamdor opened this issue 8 months ago • 2 comments
What happened?

Training a Dora in the current release in SDXL, and then loading it to continue training causes an error of missing keys.
What did you expect would happen?

No error, start training.
Relevant log output

Missing key for down_blocks.1.attentions.0.proj_in; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.1.attentions.0.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for down_blocks.1.attentions.0.proj_out; initializing it to zero.
Missing key for down_blocks.1.attentions.1.proj_in; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.1.attentions.1.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for down_blocks.1.attentions.1.proj_out; initializing it to zero.
Missing key for down_blocks.2.attentions.0.proj_in; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.2.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.3.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.4.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.5.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.6.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.7.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.8.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.0.transformer_blocks.9.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.0.proj_out; initializing it to zero.
Missing key for down_blocks.2.attentions.1.proj_in; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.2.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.3.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.4.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.5.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.6.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.7.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.8.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_q; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_k; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_v; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_out.0; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.ff.net.0.proj; initializing it to zero.
Missing key for down_blocks.2.attentions.1.transformer_blocks.9.ff.net.2; initializing it to zero.
Missing key for down_blocks.2.attentions.1.proj_out; initializing it to zero.
Missing key for up_blocks.0.attentions.0.proj_in; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.2.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.3.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.4.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.5.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.6.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.7.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.8.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.0.transformer_blocks.9.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.0.proj_out; initializing it to zero.
Missing key for up_blocks.0.attentions.1.proj_in; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.2.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.3.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.4.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.5.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.6.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.7.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.8.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.1.transformer_blocks.9.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.1.proj_out; initializing it to zero.
Missing key for up_blocks.0.attentions.2.proj_in; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.0.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.1.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.2.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.3.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.4.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.5.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.6.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.7.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.8.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_q; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_k; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_v; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_out.0; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.ff.net.0.proj; initializing it to zero.
Missing key for up_blocks.0.attentions.2.transformer_blocks.9.ff.net.2; initializing it to zero.
Missing key for up_blocks.0.attentions.2.proj_out; initializing it to zero.
Missing key for up_blocks.1.attentions.0.proj_in; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_q; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_k; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_v; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.0; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_q; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_k; initializing it to zero.
Missing key for up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_v; initializing it to zero.
Generate and upload debug_report.log

No response
Apr 22 '25 16:04 Calamdor
Same here.
May 04 '25 19:05 Wayfa
Think I confused the bug. But I can assure enabling "Apply on Output Axis" in the DoRA options, will produce a Sdxl DoRA that cannot be loaded in ComfyUI and will return a similar block error load to the one up.
May 05 '25 12:05 Wayfa
Please update and try again, this should be fixed now
May 10 '25 12:05 Nerogar
Closing as fixed
Jun 22 '25 11:06 O-J1