roberta topic

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

jessevig

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

brightmart

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

dbiir

RoBERTa中文预训练模型: RoBERTa for Chinese

brightmart

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

HHousen

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Tencent

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

microsoft

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

VinAIResearch

The implementation of DeBERTa

microsoft

news-please - an integrated web crawler and information extractor for news that just works

fhamborg