GPTQ-for-LLaMa icon indicating copy to clipboard operation
GPTQ-for-LLaMa copied to clipboard

Published 20 hours ago • verified publisher icon qwopqwop200

Does not support 3bit quantization?

Open foamliu opened this issue 1 year ago • 0 comments

3-bit quant of a 65B model, encoutered following error during pack stage：

image

foamliu avatar May 29 '23 07:05 foamliu