distillation topic

List distillation repositories

HAWQ

400
Stars
83
Forks
Watchers

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

roberta-wwm-base-distill

64
Stars
11
Forks
Watchers

this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large

MEAL-V2

685
Stars
69
Forks
Watchers

MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.

LAV

384
Stars
64
Forks
Watchers

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

ares

465
Stars
89
Forks
Watchers

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

Awesome-Knowledge-Distillation

2.4k
Stars
334
Forks
Watchers

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

Knowledge-Distillation-Zoo

1.5k
Stars
262
Forks
Watchers

Pytorch implementation of various Knowledge Distillation (KD) methods.

biosteam

171
Stars
33
Forks
Watchers

The Biorefinery Simulation and Techno-Economic Analysis Modules; Life Cycle Assessment; Chemical Process Simulation Under Uncertainty

distiller

4.3k
Stars
798
Forks
Watchers

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller