llm
llm copied to clipboard
Cannot use Azure OpenAI endpoint
Since openai version 1.x
, the azure endpoint annoyingly uses a different class than the regular OpenAI
class, namely AzureOpenAI
(see here for the Microsoft Documentation).
With the current release, it is not possible to use the Azure OpenAI api. Would changing the openai_models.py
to suit Azure make sense? Or should we implement this as a plugin?