knowledge-distillation topic

Knowledge Distillation Toolkit

marload

Paper Lists, Notes and Slides, Focus on NLP. For summarization, please refer to https://github.com/xcfcode/Summarization-Papers

xcfcode

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

szagoruyko

A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.

DomHudson

[NeurIPS-2021] Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation

canqin001

OpenMMLab Model Compression Toolbox and Benchmark.

open-mmlab

FasterAI: Prune and Distill your models with FastAI and PyTorch

nathanhubens

A treasure chest for visual classification and recognition powered by PaddlePaddle

PaddlePaddle

A large scale study of Knowledge Distillation.

karanchahal

Awesome Knowledge Distillation

dkozlov