Zhuang Intelligent Processing Lab

[NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"

ziplab

[AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"

ziplab

[NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"

ziplab

[CVPR 2023] This is the official PyTorch implementation for "Dynamic Focus-aware Positional Queries for Semantic Segmentation".

ziplab

[ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"

ziplab

This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".

ziplab

Collections of model quantization algorithms. Any issues, please contact Peng Chen ([email protected])

ziplab

This is the official PyTorch implementation for "Sharpness-aware Quantization for Deep Neural Networks".

ziplab

[TPAMI 2024] This is the official repository for our paper: ''Pruning Self-attentions into Convolutional Layers in Single Path''.

ziplab

[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.

ziplab