local-deep-researcher icon indicating copy to clipboard operation
local-deep-researcher copied to clipboard

Add lm studio as a LLM provider

Open mpnikhil opened this issue 9 months ago • 1 comments

Added lmstudio as a LLM provider to be able to run GGUF models. With that we need to skip the tokens ourselves in the nodes where we expect structured response. Ollama json mode seems to do it for us but doesn't look like LMStudio API strips it away. I am still able to get structured json output outside of the block.

mpnikhil avatar Mar 07 '25 18:03 mpnikhil

Any progress on merging this PR?

MrZoidberg avatar Mar 18 '25 09:03 MrZoidberg

Yes, will do now after resolving merge conflicts.

rlancemartin avatar Mar 20 '25 20:03 rlancemartin