roberta topic

List roberta repositories

MMM-MCQA

42
Stars
11
Forks
Watchers

Source code for our "MMM" paper at AAAI 2020

bert_seq2seq_DDP

43
Stars
5
Forks
Watchers

bert_seq2seq的DDP版本,支持bert、roberta、nezha、t5、gpt2等模型,支持seq2seq、ner、关系抽取等任务,无需添加额外代码,轻松启动DDP多卡训练。

Text-Classification-Pytorch

34
Stars
3
Forks
Watchers

Summary and comparison of Chinese classification models

zabanshenas

17
Stars
1
Forks
Watchers

Zabanshenas is a solution for identifying the most likely language of a piece of written text. Demo (👇 )

efficient-task-transfer

34
Stars
4
Forks
Watchers

Research code for "What to Pre-Train on? Efficient Intermediate Task Selection", EMNLP 2021

palbert

37
Stars
1
Forks
Watchers

Code for the paper "PALBERT: Teaching ALBERT to Ponder", NeurIPS 2022 Spotlight

Master-Thesis-Multilingual-Longformer

32
Stars
8
Forks
Watchers

Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models cou...

erc

84
Stars
23
Forks
Watchers

Emotion recognition in conversation

ko-sentence-transformers

180
Stars
14
Forks
Watchers

한국어 사전학습 모델을 활용한 문장 임베딩