knowledge-distillation topic

A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', https://arxiv.org/abs/1905.08094

luanyunteng

[AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".

DefangChen

PyTorch code for ECCV 2020 paper: "Robust Re-Identification by Multiple Views Knowledge Distillation"

aimagelab

Blog https://medium.com/neuralmachine/knowledge-distillation-dc241d7c2322

ujjwal-9

Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".

JetRunner

[AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".

DefangChen

Rotated Localization Distillation (CVPR 2022, TPAMI 2023)

Zzh-tju

Official repository for PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation

fdbtrs

jingyang2017

A curated list of resources dedicated to Knowledge Distillation, Recommendation System, especially Natural Language Processing (NLP).

JudePark96