pytorch-image-models
pytorch-image-models copied to clipboard
add SelfPatch trained ViT
SelfPatch is a wonderful self-supervised training strategy which could be used to train a VIT, it encourages the model to learn semantic correlations among patches (better than DINO as shown in their Figure 1, I take it in below). However, they do not provide pretrained model with patch 8 * 8, is there a potential to provide SelfPatch by timm?
see paper and code below: https://arxiv.org/abs/2206.07990 https://github.com/alinlab/SelfPatch
Thanks.
or is it possible for timm including their provided models?