quantization topic

List quantization repositories

Pretrained-Language-Model

3.0k
Stars
624
Forks
Watchers

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

micronet

2.2k
Stars
477
Forks
Watchers

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ar...

awesome-AutoML-and-Lightweight-Models

827
Stars
160
Forks
Watchers

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hype...

KD_Lib

575
Stars
57
Forks
Watchers

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

awesome-ai-infrastructures

370
Stars
71
Forks
Watchers

Infrastructures™ for Machine Learning Training/Inference in Production.

phpstan-deprecation-rules

370
Stars
71
Forks
Watchers

PHPStan rules for detecting usage of deprecated classes, methods, properties, constants and traits.

deepsparse

3.0k
Stars
173
Forks
Watchers

Sparsity-aware deep learning inference runtime for CPUs

optimum

2.2k
Stars
385
Forks
Watchers

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

libimagequant

738
Stars
126
Forks
Watchers

Palette quantization library that powers pngquant and other PNG optimizers

distiller

4.3k
Stars
798
Forks
Watchers

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

PaddleSlim

1.5k
Stars
348
Forks
Watchers

PaddleSlim is an open-source library for deep model compression and architecture search.