transformer-xl topic
CudaRelativeAttention
custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
conformer
[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)
XLnet-gen
XLNet for generating language.
neural_sp
End-to-end ASR/LM implementation with PyTorch
keras-transformer-xl
Transformer-XL with checkpoint loader
Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
transformer-xl
Music and text generation with Transformer-XL.
SuperPiano
Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)
Highway-Transformer
[ACL‘20] Highway Transformer: A Gated Transformer.
Tianchi2020ChineseMedicineQuestionGeneration
2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛