Ckpt Loading error

[antonilo]

Hi all,

Thanks for your work! I am trying to fine-tune the layout model you provide on my data, but I get the following warning while launching the fine-tuning command:

$ python -m models.base -m  --config-name=train \
  expname=reproduce/\${model.module} \
  model=layout 
[...]
[2023-07-31 12:27:02,222][root][WARNING] - Checkpoint misses key splat_to_mask.template
[2023-07-31 12:27:02,222][root][WARNING] - Checkpoint misses key splat_to_mask.ndcTloll
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key proj_in_param_img.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key proj_in_param_img.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.norm.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.norm.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.qkv.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.qkv.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.encoder_kv.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.encoder_kv.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.proj_out.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_img.0.proj_out.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_txt.0.norm.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_txt.0.norm.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_txt.0.qkv.weight
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_txt.0.qkv.bias
[2023-07-31 12:27:02,223][root][WARNING] - Checkpoint misses key spatial_txt.0.encoder_kv.weight
[2023-07-31 12:27:02,224][root][WARNING] - Checkpoint misses key spatial_txt.0.encoder_kv.bias
[2023-07-31 12:27:02,224][root][WARNING] - Checkpoint misses key spatial_txt.0.proj_out.weight
[2023-07-31 12:27:02,224][root][WARNING] - Checkpoint misses key spatial_txt.0.proj_out.bias
[2023-07-31 12:27:02,224][root][WARNING] - Checkpoint misses key proj_out_param.weight
[2023-07-31 12:27:02,224][root][WARNING] - Checkpoint misses key proj_out_param.bias

Apparently, some of the weights are not loaded correctly. Is this expected?

[ccmCCMfk]

Hello,I want to ask you how to install manopth module,I can't use "pip" to install it,"ERROR: No matching distribution found for manopth",I try to download manopth project,and put it under jutils,but it didn't work.

[JudyYe]

Hi, I install it with pip install git+https://github.com/hassony2/manopth.git