Runtime error while loading pretrained weights provided

[ice-pice]

Hi,

Getting the below error while loading provided pretrained weights from test.py:133

raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format( RuntimeError: Error(s) in loading state_dict for SwinTransformer: Unexpected key(s) in state_dict: "layers.0.blocks.0.attn.relative_position_index", "layers.0.blocks.1.attn_mask", "layers.0.blocks.1.attn.relative_position_index", "layers.1.blocks.0.attn.relative_position_index", "layers.1.blocks.1.attn_mask", "layers.1.blocks.1.attn.relative_position_index", "layers.2.blocks.0.attn.relative_position_index", "layers.2.blocks.1.attn_mask", "layers.2.blocks.1.attn.relative_position_index", "layers.2.blocks.2.attn.relative_position_index", "layers.2.blocks.3.attn_mask", "layers.2.blocks.3.attn.relative_position_index", "layers.2.blocks.4.attn.relative_position_index", "layers.2.blocks.5.attn_mask", "layers.2.blocks.5.attn.relative_position_index", "layers.2.blocks.6.attn.relative_position_index", "layers.2.blocks.7.attn_mask", "layers.2.blocks.7.attn.relative_position_index", "layers.2.blocks.8.attn.relative_position_index", "layers.2.blocks.9.attn_mask", "layers.2.blocks.9.attn.relative_position_index", "layers.2.blocks.10.attn.relative_position_index", "layers.2.blocks.11.attn_mask", "layers.2.blocks.11.attn.relative_position_index", "layers.2.blocks.12.attn.relative_position_index", "layers.2.blocks.13.attn_mask", "layers.2.blocks.13.attn.relative_position_index", "layers.2.blocks.14.attn.relative_position_index", "layers.2.blocks.15.attn_mask", "layers.2.blocks.15.attn.relative_position_index", "layers.2.blocks.16.attn.relative_position_index", "layers.2.blocks.17.attn_mask", "layers.2.blocks.17.attn.relative_position_index", "layers.3.blocks.0.attn.relative_position_index", "layers.3.blocks.1.attn.relative_position_index".

Command used to run : python test.py --config configs/architecture.yaml --model1_weights weights/SwinDCTfull_checkpoint32.pth --output_path output.json --gpu_id 0 --test_folder demogen1/1_fake --model 2

Can you please help me understand if I'm doing something wrong ?

[iamwangyabin]

just skip these parameters

[davide-coccomini]

I think your problem is related to the timm version. They have done some slight changes in the architecture of the swin so you would need to downgrade timm. Try some previous versions and hopefully you will find the right one.

[10and01]

I downgraded timm version to timm-v0.9.6 and the weights can be loaded normally