zed
zed copied to clipboard
zed-industries
Azure OpenAI Support
Check for existing issues
- [X] Completed
Describe the feature
Does Zed support Azure OpenAI? If not please add the support.
If applicable, add mockups / screenshots to help present your vision of the feature
No response
Hey @vivekrp, we don't currently have support for any models outside of a few from OpenAI. We do intend to add other services in after our code is public and open sourced.
Azure OpenAI has the same models just a different endpoint. Same api as OpenAI I believe.
Just adding this context as supporting azure OpenAI is not the same supporting completely different providers like Anthropic (to my understanding 😀)
we self host our 'Assistant' OpenAI API-like LLM on a private server. Azure support and others, or just having a custom endpoint, would be hugely beneficial.
Azure OpenAI has the same models just a different endpoint. Same api as OpenAI I believe.
This is correct, it is the exact same models.
Having an option to customize the endpoint which currently seem to be specified in OPEN_AI_API_URL in crates/ai/src/providers/open_ai.rs and the authentication header, is enough to support OpenAI models in Azure.
Businesses that already rely on Microsoft for data processing are likely to favor Azure as it would be covered under the same contracts, potentially broadening the user base for the assistant panel significantly.
Just tried using this with azure openai, but can't seem to get it working. Looking at the recent implementation for open_api_url, it may because from the azure docs, we need to supply an api-version after chat/completions - which isn't possible with the implementation.
See the azure docs that I'm referring to here - https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completions
I would also like to know if it is possible to configure the Azure OpenAI API and what the settings are.
If anyone still wants to try Azure, I have a very hacky PR/branch for it: https://github.com/zed-industries/zed/pull/8493/
I don't have an Azure API key to test with so please let me know if it works 🙇
