smoothquant topic

List smoothquant repositories

neural-compressor

2.2k
Stars
254
Forks
Watchers

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

LightCompress

649
Stars
64
Forks
649
Watchers

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.