LocalAI integration: Run with local models

[mudler]

Great project!

Did you considered the possibility to run models locally? There are projects like LocalAI https://github.com/go-skynet/LocalAI that provide a free, drop-in OpenAI alternative with local models.

I think also #243 is tangentially related, as could be leveraged to use LocalAI instead of OpenAI

[sirajperson]

I posted a work around solution in #243. I was able to get it working so maybe I will do a pr.

[sirajperson]

I created a pull request adding it. PR. Full discussion in issue #243

[neelayan7]

Closing this as this is solved.