mistral.rs
mistral.rs copied to clipboard
Enable multiple CPU from arguments
I have a 32 core AMD CPU and no GP. mistral.rs will only use two of the cores. 2 cores is a bit less. Is it possible to allow to set it through arguments? Ollama will use half of core numbers by default.
Thanks!