model-distillation topic
awesome-knowledge-distillation
Awesome Knowledge Distillation
mgd
Matching Guided Distillation (ECCV 2020)
Causal-Distill
The Codebase for Causal Distillation for Language Models (NAACL '22)
diffusion_distiller
🚀 PyTorch Implementation of "Progressive Distillation for Fast Sampling of Diffusion Models(v-diffusion)"
autodistill
Images to inference with no labeling (use foundation models to train supervised models).
minilmv2.bb
Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
deepdistilling
Mechanistically interpretable neurosymbolic AI (Nature Comput Sci 2024): losslessly compressing NNs to computer code and discovering new algorithms which generalize out-of-distribution and outperform...