Local LLMs (self-hosting / desktop client)

[pacoccino]

Why Local LLMs are raising, such as ollama, LMStudio etc. It's already possible to use them with big-agi, but only if they are accessible by the machine who hosts the big-agi server.

Description Being able to use local LLMs that runs on the client's machine accessing big-agi frontend. That'd allow people who doesn't self host to use their own local LLMs, as to hosters don't run LLMs for all the users.

Requirements The frontend have to call the local LLM, not the backend anymore