GPTQ-for-LLaMa icon indicating copy to clipboard operation
GPTQ-for-LLaMa copied to clipboard

Published 20 hours ago • verified publisher icon qwopqwop200

Why does the model quantization prompt KILLED at the end?

Open g558800 opened this issue 2 years ago • 2 comments

Why does the model quantization prompt KILLED at the end? 无标题

g558800 avatar Jul 16 '23 16:07 g558800

It's a RAM issue, try to increase the RAM size, or add a memory swap

msalhab96 avatar Jul 24 '23 07:07 msalhab96

Resolved. thanks

g558800 avatar Jul 24 '23 10:07 g558800