smoothquant topic

List smoothquant repositories

neural-compressor

2.2k
Stars
254
Forks
Watchers

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

LightCompress

625
Stars
62
Forks
625
Watchers

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLM, VLM, and video generation models.