UM-MAE icon indicating copy to clipboard operation
UM-MAE copied to clipboard

Semantic segmentation Pretrained model?

Open wuyuanmm opened this issue 3 years ago • 1 comments

I use upernet_mae_swin_tiny_256_mask...py, but when I use checkpoint-99-model.pth as the backbone pretrained model. It reports this:

mmseg - WARNING - The model and loaded state dict do not match exactly unexpected key in source state_dict: fc_norm.weight, fc_norm.bias, head.weight, head.bias

when trainning with this model, Gradient overflow.

wuyuanmm avatar Jul 07 '22 06:07 wuyuanmm

Hi, we do not observe the gradient problem when training upernet using the pre-trained model. The message is correct since segmentation model indeed doesnot need fc and head layers of the pre-trained classification model.

implus avatar Aug 02 '22 11:08 implus