knowledge-distillation topic

(CVPR-Oral 2021) PyTorch implementation of Knowledge Evolution approach and Split-Nets

ahmdtaha

Universal Representation Learning from Multiple Domains for Few-shot Classification - ICCV 2021, Cross-domain Few-shot Learning with Task-specific Adapters - CVPR 2022

VICO-UoE

TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.

sayakpaul

[CVPR 2022] Learning Multiple Adverse Weather Removal via Two-stage Knowledge Learning and Multi-contrastive Regularization: Toward a Unified Model

fingerk28

Code and pretrained models for paper: Data-Free Adversarial Distillation

VainF

Compressing Representations for Self-Supervised Learning

UMBCvision

Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification

yxgeee

Matching Guided Distillation (ECCV 2020)

kaiyuyue

[NeurIPS2021] Learning Distilled Collaboration Graph for Multi-Agent Perception

ai4ce

[ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling

Alibaba-NLP