llama-api
llama-api copied to clipboard
how to run this api in cpu only mode
Hello can someone guide me to run this nice API in CPU mode only
@c0sogi could you help me to figure how to run it please I love the project but some of my models are too big for my gtx 1080