autogen-ui icon indicating copy to clipboard operation
autogen-ui copied to clipboard

Can I use this package with AzureOpenAI?

Open mraguth opened this issue 1 year ago • 1 comments

I can use Autogen with my AzureOpenAI keys. Can I do the same with this package? Please help.

mraguth avatar Dec 06 '23 02:12 mraguth

In theory as follows, I've not got around to trying it yet.

Without code changes

AZURE_OPENAI_API_KEY= AZURE_OPENAI_API_BASE=

api_version="2023-07-01-preview" need to be set during your Azure OpenAI deployment. deployment name of your Azure OAI deployment needs to be "gpt-35-turbo". I think this is the default (note no full stop between 3 and 5).

main of this repo is currently using a pre v0.2.* AutoGen

ref to env vars : https://github.com/microsoft/autogen/blob/dd90756bdb05479cea035db718f6473ce3e1859f/autogen/oai/openai_utils.py#L110

If you are working with an existing Azure OAI deployment that doesn't have the above deployment name and API version and don't want to or cannot change / deploy a new one, then you'll have to modify the autogen-ui code to set those two in the llmconfig.

If I test, I'll confirm.

janaka avatar Dec 12 '23 06:12 janaka