efficient-transformers topic

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

swz30

Mask Transfiner for High-Quality Instance Segmentation, CVPR 2022

SysCV

Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).

NVIDIA

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

lucidrains

[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

VITA-Group

[NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"

ziplab

Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"

szq0214

Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models cou...

MarkusSagen

[MICCAI 2023] DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentation

xmindflow

[CVPR 2023] IMP: iterative matching and pose estimation with transformer-based recurrent module

feixue94