continue icon indicating copy to clipboard operation
continue copied to clipboard

feat: Add num_treads to ollama along with docs

Open RangerMauve opened this issue 1 year ago • 1 comments

I found that when running with ollama my computer would freeze up while doing inference. Exposing num_thread should help leave some threads to the GUI to handle user input.

RangerMauve avatar Feb 16 '24 16:02 RangerMauve

Deploy Preview for continuedev canceled.

Name Link
Latest commit 1fac655fe86cf9fb9fbb6417d40c2d6f02cbee02
Latest deploy log https://app.netlify.com/sites/continuedev/deploys/65cf8df777cc76000813549f

netlify[bot] avatar Feb 16 '24 16:02 netlify[bot]

@RangerMauve very nice, and thank you for adding the documentation!

sestinj avatar Feb 21 '24 22:02 sestinj

Sweet, thanks for the merge. :) Gonna test it out in my workflow this week.

RangerMauve avatar Feb 27 '24 21:02 RangerMauve