llama-api icon indicating copy to clipboard operation
llama-api copied to clipboard

how to run this api in cpu only mode

Open delta-whiplash opened this issue 1 year ago • 1 comments

Hello can someone guide me to run this nice API in CPU mode only

delta-whiplash avatar Nov 07 '23 15:11 delta-whiplash

@c0sogi could you help me to figure how to run it please I love the project but some of my models are too big for my gtx 1080

delta-whiplash avatar Nov 17 '23 16:11 delta-whiplash