pytorch-image-models icon indicating copy to clipboard operation
pytorch-image-models copied to clipboard

add SelfPatch trained ViT

Open Luciennnnnnn opened this issue 2 years ago • 1 comments

SelfPatch is a wonderful self-supervised training strategy which could be used to train a VIT, it encourages the model to learn semantic correlations among patches (better than DINO as shown in their Figure 1, I take it in below). However, they do not provide pretrained model with patch 8 * 8, is there a potential to provide SelfPatch by timm?

see paper and code below: https://arxiv.org/abs/2206.07990 https://github.com/alinlab/SelfPatch

Thanks.

image

Luciennnnnnn avatar Feb 19 '23 02:02 Luciennnnnnn

or is it possible for timm including their provided models?

Luciennnnnnn avatar Apr 04 '23 04:04 Luciennnnnnn