mmsegmentation icon indicating copy to clipboard operation
mmsegmentation copied to clipboard

Default weight initialization

Open anirbala98 opened this issue 2 years ago • 1 comments

Hi,

If I don't specify any weight initialization method in init_cfg or implement a custom init_weights() function, how does mmseg assign the initial weights? What is the default method used to assign the initial weights for an encoder/decoder?

anirbala98 avatar Oct 17 '23 01:10 anirbala98

some model set their own init when init_cfg=None example: mmseg/models/backbones/swin.py:664

image

If in your model, this cornercase is not handled, it seems the value are from then the tensor was created: random, (which is a very bad idea and will lead to bad performance)

joihn avatar Dec 09 '24 14:12 joihn