attention-is-all-you-need topic

List attention-is-all-you-need repositories

bert_language_understanding

959
Stars
212
Forks
Watchers

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Speech-Transformer

751
Stars
194
Forks
Watchers

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

kospeech

559
Stars
192
Forks
Watchers

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

sockeye

1.2k
Stars
335
Forks
Watchers

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

transformer

4.1k
Stars
1.3k
Forks
Watchers

A TensorFlow Implementation of the Transformer: Attention Is All You Need

attention-is-all-you-need-pytorch

8.3k
Stars
1.9k
Forks
Watchers

A PyTorch implementation of the Transformer model in "Attention is All You Need".

pytorch-original-transformer

859
Stars
154
Forks
Watchers

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pret...

TextClassificationBenchmark

592
Stars
137
Forks
Watchers

A Benchmark of Text Classification in PyTorch