Alpaca-LoRA-Serve icon indicating copy to clipboard operation
Alpaca-LoRA-Serve copied to clipboard

Published 20 hours ago • verified publisher icon deep-diver

ggml-alpaca-3b-q4 on CPU?

Open DaveScream opened this issue 1 year ago • 0 comments

Is it possible to run ggml-alpaca-3b-4q.bin model on cpu ram? And specify filepath instead of url to hf?

DaveScream avatar Mar 22 '23 18:03 DaveScream