Swin-Transformer icon indicating copy to clipboard operation
Swin-Transformer copied to clipboard

Can I directly train swin v2 large on imagenet 1k ?

Open Zhaoyi-Yan opened this issue 3 years ago • 1 comments
trafficstars

If I directly train swin v2-L on imagenet 1k, then will it perform better than swin v2-B trained on imagenet 1k ?

Zhaoyi-Yan avatar Sep 02 '22 10:09 Zhaoyi-Yan

No, it will not get better accuracy. But if you use SimMIM pre-training, Swin V2-L will perform better than Swin V2-B. Please try https://github.com/microsoft/Swin-Transformer/blob/main/get_started.md#simmim-support

ancientmooner avatar Sep 29 '22 15:09 ancientmooner