beit topic

OpenMMLab Pre-training Toolbox and Benchmark

open-mmlab

OpenMMLab Self-Supervised Learning Toolbox and Benchmark

open-mmlab

PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE 等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉...

PaddlePaddle

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

microsoft

PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI

arxyzan