Jeffser
Set num_threads model parameter
Is your feature request related to a problem? Please describe. When I run Alpaca, the Ollama instance is under-utilizing my resources, resulting in slower outputs.
Describe the solution you'd like A menu option under Preferences>General for setting the number of threads as an Ollama model parameter
Describe alternatives you've considered Editing config files for the ollama model
Additional context This would add a lot of convenience for people who want to configure how many cores the ollama instance can use, and it would be nice easily change this value for each model. I currently have a change implemented already, and I'm testing it now.
I have a change implemented already, but still need to test it out. I'll do that today. Can I submit this issue?
I have a change implemented already, but still need to test it out. I'll do that today.
@71f681c20d any updates on that? i could see why this feature may be handy.
