pre-trained-language-models topic

List pre-trained-language-models repositories

DART

125
Stars
16
Forks
Watchers

[ICLR 2022] Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners

SIFRank

120
Stars
21
Forks
Watchers

The code of our paper "SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model"

Awesome-Efficient-PLM

100
Stars
14
Forks
Watchers

Must-read papers on improving efficiency for pre-trained language models.

GigaBERT

28
Stars
5
Forks
Watchers

Zero-shot Transfer Learning from English to Arabic

ARES

24
Stars
2
Forks
Watchers

SIGIR'22 paper: Axiomatically Regularized Pre-training for Ad hoc Search

VaLM

54
Stars
3
Forks
Watchers

VaLM: Visually-augmented Language Modeling. ICLR 2023.

DynamicKD

39
Stars
6
Forks
Watchers

Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"

super-structured-lottery-tickets

16
Stars
1
Forks
Watchers

Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (ACL 2021)

Chinese-LLaMA-Alpaca

18.2k
Stars
1.9k
Forks
Watchers

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

LLMSurvey

10.1k
Stars
795
Forks
Watchers

The official GitHub page for the survey paper "A Survey of Large Language Models".