buzz icon indicating copy to clipboard operation
buzz copied to clipboard

Customizable api_base for OpenAI

Open ldotlopez opened this issue 1 year ago • 1 comments

There some projects out there replicating the OpenAI API like LocalAI. Some organizations are using them for experimentation and local-AI powered projects. The possibility of connecting Buzz with those platforms is interesting.

The openai module already supports this by just setting an internal attribute:

import openai
openai.base_api = "http://someinternalhost.local/v1"

I made some tests by manually tweaking Buzz code and it works but it needs some UI.

The propose is to add some UI to expose the "base API" for OpenAI to the user

Even if related PR on LocalAI is not accepted this would be an interesting feature for interoperability with other projects

ldotlopez avatar Jul 04 '23 08:07 ldotlopez

I would also suggest to add a feature like that.

faspie avatar Feb 04 '24 17:02 faspie