AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard
verified publisher icon casper-hansen

can I quantize a model to 8bit model using autoawq?

Open cute149q opened this issue 1 year ago • 0 comments

Is it only supported for 4-bit quantization?

cute149q avatar Dec 08 '24 19:12 cute149q