Swin-Transformer icon indicating copy to clipboard operation
Swin-Transformer copied to clipboard

How to set learning_rate when using pretrained weights

Open JingyangXiang opened this issue 4 years ago • 1 comments
trafficstars

JingyangXiang avatar Sep 17 '21 01:09 JingyangXiang

Try different lr and evaluate on your datasets. For classification, you can start by trying 1/10 of the pre-training learning rate

ancientmooner avatar Dec 20 '21 10:12 ancientmooner