[Feature request] Integration of local LLMs

[lightningRalf]

Hello, with the integration of other models like gpt3.5 the first step was made by introducing the ability to make the net wider. This was shortly discussed in #337.

So I wanted to ask if there is a chance to widen the net further and introduce more models. There is already an open source project that provides an API for this, but I dont know if you want to add dependencies. Just wanted to share, for better understanding what I mean.

Thanks in advance.