languagemodel topic

List languagemodel repositories

SimCTG

446
Stars
40
Forks
Watchers

[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation

CodeGen

4.8k
Stars
368
Forks
Watchers

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

CodeRL

480
Stars
60
Forks
Watchers

This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).

LightLM

57
Stars
13
Forks
Watchers

高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task

yobulkdev

855
Stars
43
Forks
Watchers

🔥 🔥 🔥Open Source & AI driven Data Onboarding Platform:Free flatfile.com alternative

embeddings

34
Stars
3
Forks
Watchers

Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polish Language

TurkishBERTweet

28
Stars
0
Forks
Watchers

TurkishBERTweet: Fast and Reliable Large Language Model for Social Media Analysis

lmppl

102
Stars
8
Forks
Watchers

Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).