Transformer-SSL icon indicating copy to clipboard operation
Transformer-SSL copied to clipboard

Published 20 hours ago • verified publisher icon SwinTransformer

config setting "NORM_BEFORE_MLP" takes no effect

Open flishwang opened this issue 3 years ago • 0 comments

in models/build.py:41, the keyword passed to partial(SwinTransformer,...) is norm_befor_mlp, while the keyword in SwinTransformer (models/swin_transformer.py:497) is norm_before_mlp. The formmer missed a letter E compared with the latter.

Therefore, the 'bn' setting in configs takes no effect.

flishwang avatar Jun 23 '21 12:06 flishwang