VldmrB

Nah, it only affects this newer 4-bit model, with groupsize=128. It's a known issue: https://github.com/oobabooga/text-generation-webui/pull/530#issuecomment-1484509503 I think I meant to link this issue instead of the pull request in my...

Do you have multiple models? I'd double check that you did it in the right place, etc. It's unlikely there's another root cause for the issue. Worst case scenario, search...

Not sure then. I suspect it might be the cuda that you install here: https://github.com/oobabooga/text-generation-webui/pull/206 ``` mkdir repositories git clone https://github.com/qwopqwop200/GPTQ-for-LLaMa cd GPTQ-for-LLaMa python setup_cuda.py install ``` But I think...

> @waarmond Kindly double-check the target name you're using. The error message suggests "build_pip_package.py" might exist. Could you ensure you're using the correct target name with a colon (":") separating...