buzz
buzz copied to clipboard
Customizable api_base for OpenAI
There some projects out there replicating the OpenAI API like LocalAI. Some organizations are using them for experimentation and local-AI powered projects. The possibility of connecting Buzz with those platforms is interesting.
The openai module already supports this by just setting an internal attribute:
import openai
openai.base_api = "http://someinternalhost.local/v1"
I made some tests by manually tweaking Buzz code and it works but it needs some UI.
The propose is to add some UI to expose the "base API" for OpenAI to the user
Even if related PR on LocalAI is not accepted this would be an interesting feature for interoperability with other projects
I would also suggest to add a feature like that.