smoothquant topic
List
smoothquant repositories
neural-compressor
2.2k
Stars
254
Forks
Watchers
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
LightCompress
625
Stars
62
Forks
625
Watchers
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLM, VLM, and video generation models.