quickadd icon indicating copy to clipboard operation
quickadd copied to clipboard

[FEATURE REQUEST] AI assistant with local LLM

Open aparente opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. I'd like to choose to run the AI assistant with a local LLM e.g. via ollama. I know I could probably do this through an arbitrary script, but it would be nice to add a local model as an option in the AI assistant.

Describe the solution you'd like Specify path to a model while keeping system prompts and macro recipes the same.

Additional context This isn't a super fleshed out request. I know there's probably options to do this through local scripts, I'll have to dig through documentation first (though it might be a nice documentation example!). Having an option for local model specification in the AI assistant macros would be really useful.

aparente avatar Dec 31 '23 00:12 aparente