pre-trained-language-models topic
DART
[ICLR 2022] Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners
SIFRank
The code of our paper "SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model"
Awesome-Efficient-PLM
Must-read papers on improving efficiency for pre-trained language models.
GigaBERT
Zero-shot Transfer Learning from English to Arabic
ARES
SIGIR'22 paper: Axiomatically Regularized Pre-training for Ad hoc Search
VaLM
VaLM: Visually-augmented Language Modeling. ICLR 2023.
DynamicKD
Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
super-structured-lottery-tickets
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (ACL 2021)
Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".