Tao Huang
Tao Huang
LightViT
Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
DIST_KD
Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
DyRep
Official implementation for paper "DyRep: Bootstrapping Training with Dynamic Re-parameterization", CVPR 2022
image_classification_sota
Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
MasKD
Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
ReLoss
Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022
DiffKD
Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023