GPTQ-for-LLaMa icon indicating copy to clipboard operation
GPTQ-for-LLaMa copied to clipboard

Published 20 hours ago • verified publisher icon qwopqwop200

Inference using CPU

Open lodorg opened this issue 2 years ago • 0 comments

Hi, I'm interested to run LLAMA 4bit GPTQ, but I don't have a GPU. Is it possible to run this model on CPU only?

lodorg avatar Mar 23 '23 08:03 lodorg