mage
mage copied to clipboard
The code for contrastive leanring is included in the current codebase or not?
As the title says, I can not find the contrastive learning loss in your codebase.
I just updated the README to include pre-trained MAGE-C checkpoints converted from JAX. We are still wrapping up the PyTorch code for the contrastive loss. We will endeavor to release that part soon.
Can you provide the performance comparison between models trained by MIM and MIM+CL?
Please refer to this paper for that comparison. We also have the comparison between MAGE and MAGE-C in Table 2 and Table 13 in our paper.
@LTH14 Is MAGE-C ready?