oversmoothing topic

List oversmoothing repositories

gradientgating

51
Stars
4
Forks
Watchers

Gradient gating (ICLR 2023)

Diverse-ViT

25
Stars
3
Forks
Watchers

[CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong Chen, Zhenyu Zhang, Yu Cheng, Ahmed Awadallah, Zhangyang Wang

ViT-Anti-Oversmoothing

76
Stars
7
Forks
Watchers

[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang