linformer topic

list of efficient attention modules

Separius

My take on a practical implementation of Linformer for Pytorch.

tatp22

Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

kuixu

Vision Xformers

pranavphoenix