willintonmb

Error trying Quantize 7B model to 2-bit

5

I have installed GPTQ as said "https://pypi.org/project/gptq/#description", but following error comes out after execute `python -m llama.llama_quant D:\Repo\Llama\weights\7B c4 --wbits 2 --save pyllama-7B2b.pt`: `Traceback (most recent call last): File "C:\Users\ASUS\.conda\envs\PyLlama\lib\runpy.py",...