transformer-xl topic

custom cuda kernel for {2, 3}d relative attention with pytorch wrapper

Separius

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

sooftware

XLNet for generating language.

rusiaaman

End-to-end ASR/LM implementation with PyTorch

hirofumi0810

Transformer-XL with checkpoint loader

CyberZHG

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

sail-sg

Music and text generation with Transformer-XL.

davidsvy

Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)

asigalov61

[ACL‘20] Highway Transformer: A Gated Transformer.

cyk1337

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

menghuanlater