[Feature] Support Azure OpenAI Service

[jhhuang96]

Azure OpenAI Service provides REST API access to OpenAI's powerful language models including the GPT-3, Codex and Embeddings model series. (link)

Azure OpenAI Service gives customers advanced language AI with OpenAI GPT-4, GPT-3, Codex, and DALL-E models with the security and enterprise promise of Azure. Azure OpenAI co-develops the APIs with OpenAI, ensuring compatibility and a smooth transition from one to the other.

With Azure OpenAI, customers get the security capabilities of Microsoft Azure while running the same models as OpenAI. Azure OpenAI offers private networking, regional availability, and responsible AI content filtering.

Reference: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/reference

[kalufinnle]

Not a feature request. Open AI api allow include and extend services by Azure. No need for Azure integration.

Please close this Issue #268

[jhhuang96]

Hi @kalufinnle , Azure OpenAI differs from OpenAI, especially for endpoint API URL and API key format. Currently, Azure OpenAI is exclusively available for enterprise and educational purposes.

[Bin-Huang]

Please give me some time to understand the differences between the Azure and OpenAI interfaces.

[jhhuang96]

Sure, below are related resource:

• Related PR: https://github.com/yetone/openai-translator/pull/178

• stable/[2022-12-01] API (https://github.com/Azure/azure-rest-api-specs/tree/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/stable/2022-12-01) https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/stable/2022-12-01/inference.json

• preview/2023-03-15-preview API https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2023-03-15-preview/inference.json

[haibbo]

try this project: https://github.com/haibbo/cf-openai-azure-proxy

and it has implement a printer mode

[kalufinnle]

Hi @kalufinnle , Azure OpenAI differs from OpenAI, especially for endpoint API URL and API key format. Currently, Azure OpenAI is exclusively available for enterprise and educational purposes. @jhhuang96

What I am saying is that I dont see a reason to use Azure OpenAI. Because it will be slower and redundant as Azure-OpenAI make use of OpenAI's API calls. And we already have OpenAI API 's integrations. Azure OpenAI is built for Azure users where those users are already using other Azure products, which does not apply to the users/developers of chatbox since chatbox is not interacting with other Azure products

hence I recommend to close the issue unless it becomes critical

[jhhuang96]

Hi @kalufinnle , compared to OpenAI, Azure OpenAI has two main advantages: one is the payment method and the other is network requirements. They are very important users in countries that cannot use OpenAI.

[zhuyaguang]

Azure openai can not use

[PeterDaveHello]

What I am saying is that I dont see a reason to use Azure OpenAI. Because it will be slower and redundant as Azure-OpenAI make use of OpenAI's API calls. And we already have OpenAI API 's integrations. Azure OpenAI is built for Azure users where those users are already using other Azure products, which does not apply to the users/developers of chatbox since chatbox is not interacting with other Azure products

That's totally wrong, Azure OpenAI is not calling OpenAI'API, it's using OpenAI's model that deployed in Azure's data center. Azure OpenAI can be more reliable, and has less restrictions, also it has 99.9% SLA and OpenAI API doesn't.

It'll be great if Azure OpenAI can be supported here.

[jhhuang96]

Please give me some time to understand the differences between the Azure and OpenAI interfaces.

@Bin-Huang Do you have any update on it, thanks!

[jhhuang96]

https://github.com/Bin-Huang/chatbox/commit/515eaf1eb2cbc530721669b7b37e9a42aaf07294