language-modeling topic

List language-modeling repositories

comparatively-finetuning-bert

115
Stars
28
Forks
Watchers

Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.

KenLM-training

111
Stars
21
Forks
Watchers

Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2

unif

114
Stars
27
Forks
Watchers

基于 Tensorflow,仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类,涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域

pretraining-for-language-understanding

83
Stars
14
Forks
Watchers

Pre-training of Language Models for Language Understanding

fed-att

61
Stars
17
Forks
Watchers

Attentive Federated Learning for Private NLM

rome

505
Stars
99
Forks
Watchers

Locating and editing factual associations in GPT (NeurIPS 2022)

referit3d

100
Stars
14
Forks
Watchers

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

UDSMProt

81
Stars
24
Forks
Watchers

Protein sequence classification with self-supervised pretraining

gated-state-spaces-pytorch

94
Stars
4
Forks
Watchers

Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch

incontext-learning

91
Stars
12
Forks
Watchers

Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implicit Bayesian Inference"