Connection to Ollama Local Server

[MauriceDroll]

Hey,

for a project for University we are looking for a possibility to connect ROS 2 to a local running LLM. We decided to use OLLAMA to run Mistral 7B.

Is it possible to change the endpoint from the OpenAI Website to the local running endpoint of OLLAMA (something like this: https://github.com/ollama-ui/ollama-ui). Then we would be able to run this free of cost (requirement by university). Is this possible or even planned for an further update of this repo?

Thanks for any kind of answer :)