quanto icon indicating copy to clipboard operation
quanto copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Does AWQ is officially supported now?

Open lifelongeeek opened this issue 5 months ago • 3 comments

I can see that optimum-quanto provides several external (weight-only) quantization algorithm such as smoothquant and awq in here.

It looks like smoothquant only supports OPT models, and awq is still under development. Do you have any further development plans for AWQ?

lifelongeeek avatar Sep 20 '24 04:09 lifelongeeek