smoothquant topic
List
smoothquant repositories
neural-compressor
2.2k
Stars
254
Forks
Watchers
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
LightCompress
649
Stars
64
Forks
649
Watchers
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.