PyTorch-BYOL icon indicating copy to clipboard operation
PyTorch-BYOL copied to clipboard

模型的参数需要初始化吗?你的代码里好像没有初始化的步骤?

Open LiDaiY opened this issue 4 years ago • 1 comments

LiDaiY avatar Feb 05 '21 08:02 LiDaiY

@LiDaiY if you initialized the parameters of the resnet with the flag pretrained=True then the model would already have learnt a representation. You might get better results, but the purpose of this repository is to learn a good representation from scratch using BYOL. The other model parameters (classifier, mlp head, ...) are initialized randomly (there is not really any other option).

hafnerfe avatar Feb 12 '21 10:02 hafnerfe