self-distillation topic
List
self-distillation repositories
pytorch-be-your-own-teacher
144
Stars
27
Forks
Watchers
A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', https://arxiv.org/abs/1905.08094
Deep-Hash-Distillation
40
Stars
6
Forks
Watchers
Deep Hash Distillation for Image Retrieval - ECCV 2022
self_distillation
17
Stars
1
Forks
Watchers
Self-Distillation with weighted ground-truth targets; ResNet and Kernel Ridge Regression
Awesome-Knowledge-Distillation-of-LLMs
305
Stars
19
Forks
Watchers
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vert...
sdft
42
Stars
3
Forks
Watchers
[ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".