Spidartist

@swarajnanda2021 Have you added register tokens to ViT like in [this paper](https://arxiv.org/abs/2309.16588)? And the result is bad? I want to try using register tokens but the pretraining phase is very...

hello @FalsoMoralista, I'm currently interested in pretraining IJEPA and finetuning on that pretrained model on semantic segmentation task, can I join with you? this is my discord info: spidartist

Hi @MidoAssran, I'm currently facing the same issue, the training loss act very weird like above @ChristianEschen's chart, how could we resolve that? Best regards, Quan