attention-is-all-you-need topic

list of efficient attention modules

Separius

Transformer based Bangla Speech Recognition

menon92

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

brightmart

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

kaituoxu

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

sooftware

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

awslabs

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Kyubyong

A PyTorch implementation of the Transformer model in "Attention is All You Need".

jadore801120

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pret...

gordicaleksa

A Benchmark of Text Classification in PyTorch

FreedomIntelligence