kd topic
awesome-knowledge-distillation
Awesome Knowledge Distillation
Awesome-Knowledge-Distillation
Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
mgd
Matching Guided Distillation (ECCV 2020)
Rotated-LD
Rotated Localization Distillation (CVPR 2022, TPAMI 2023)
KnowledgeFactor
[ECCV2022] Factorizing Knowledge in Neural Networks
DIST_KD
Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
image_classification_sota
Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
MasKD
Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.