AnyDoor icon indicating copy to clipboard operation
AnyDoor copied to clipboard

Weight mismatch with SD 2.1

Open ifeherva opened this issue 1 year ago • 1 comments

If I understand the approach correctly the in blocks of SD 2.1 were frozen during training.

Yet, when I compare the weights between the checkpoint shared here vs the SD 2.1 on huggingface the weights, don't match. What am I missing?

For example the keys I am comparing from the 2 state dicts:

Anydoor checkpoint: model.diffusion_model.input_blocks.0.0.weight vs. SD 2.1 loaded as UNet2DConditionModel: conv_in.weight

ifeherva avatar Jan 12 '24 21:01 ifeherva

I figured out what was happening, the link in the README points to SD-v2.1 however you used SD-2.1-base. I recommend to update the README :)

ifeherva avatar Jan 12 '24 22:01 ifeherva