mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Enable multiple CPU from arguments

Open lij55 opened this issue 6 months ago • 6 comments

I have a 32 core AMD CPU and no GP. mistral.rs will only use two of the cores. 2 cores is a bit less. Is it possible to allow to set it through arguments? Ollama will use half of core numbers by default.

Thanks!

lij55 avatar Aug 13 '24 04:08 lij55