pretraining topic

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

j-min

code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022

uta-smile

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

qqlu

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

akanyaani

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

PaddlePaddle

BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training

amazon-science

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

guolinke

[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links

michiyasunaga

PITI: Pretraining is All You Need for Image-to-Image Translation

PITI-Synthesis

AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training

CZWin32768