pretrained-language-model topic

List pretrained-language-model repositories

YAYI2

3.6k
Stars
15
Forks
Watchers

YAYI 2 是中科闻歌研发的新一代开源大语言模型,采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs)

UniCRS

21
Stars
14
Forks
Watchers

[KDD22] Official PyTorch implementation for "Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning".

CoditT5

26
Stars
2
Forks
Watchers

Code and data for "CoditT5: Pretraining for Source Code and Natural Language Editing" in ASE 2022.

lawyer-llama

781
Stars
99
Forks
Watchers

中文法律LLaMA (LLaMA for Chinese legel domain)

AttrPrompt

120
Stars
9
Forks
Watchers

[NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.

awesome-refreshing-llms

114
Stars
8
Forks
Watchers

EMNLP'23 survey: a curation of awesome papers and resources on refreshing large language models (LLMs) without expensive retraining.

hierarchical-domain-adaptation

32
Stars
3
Forks
Watchers

Code of NAACL 2022 "Efficient Hierarchical Domain Adaptation for Pretrained Language Models" paper.

Diffusion-BERT

276
Stars
21
Forks
Watchers

ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models