solo-learn icon indicating copy to clipboard operation
solo-learn copied to clipboard

Implement multi-crop (SwAV, DCv2, DINO, MoCo)

Open DonkeyShot21 opened this issue 2 years ago • 1 comments

and improve SimCLR's implementation

DonkeyShot21 avatar Oct 04 '21 15:10 DonkeyShot21

We should keep in mind that this repo has nice parameters for multi-crop on CIFAR

Edit: I have just tested their parameters and they work quite well

DonkeyShot21 avatar Oct 05 '21 08:10 DonkeyShot21

@vturrisi @DonkeyShot21 hi guys, I'm trying to use multicrop with DINO but it seems that it does not work. My guess is that it is because timm vision_transformer is used here, but contrary to the "classical" DINO implem, it does not automatically interpolate positional embeddings for different image sizes. Do you relate on your side ?

nicoboou avatar Aug 26 '23 09:08 nicoboou