weight-only topic
List
weight-only repositories
auto-round
81
Stars
9
Forks
Watchers
SOTA Weight-only Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"
