Azure OpenAI Completions Support

[animalnots]

trafficstars

Proposal

It would be nice to add Azure OpenAI Completions to our project. It's widely used in business, so it could attract more users and keep us ahead as AI and ML become standard. Besides, implementation shouldn't differ that much and there are libs that already support OpenAI on azure platform.

Use-Case

Similar to OpenAI.

Is this a feature you are interested in implementing yourself?

Maybe

[arielweinberger]

Thanks for creating this one, @animalnots! We'll prioritize this and aim to deliver very soon.

[imkratos]

maybe can use one-api replace openai url ,one-api proxy to Azure OpenAI

[arielweinberger]

Thanks for the suggestion @imkratos. However, there is no English support/maintenance for this library, therefore it's a no-go for us.

[ishaan-jaff]

@arielweinberger @imkratos @animalnots i'm the maintainer of LiteLLM: https://github.com/BerriAI/litellm

We provide a hosted or self hosted open-source proxy that can call 100 + LLM APIs.

If this is a priority, I'd love to help with an integration 😀

[ishaan-jaff]

Happy to help with implementing this feature myself to - can I just get some guidance on how to best do this @arielweinberger @eylonmiz ?

https://github.com/BerriAI/litellm is a python library and noticed you're using JS

• We provide a hosted proxy that you can set your OpenAI base to to handle this
• If you'd like you can use our self hosted proxy

[arielweinberger]

Thanks @ishaan-jaff - was good to have a chat. We'll see if and how we choose to implement this in the roadmap.

[XiaMuYao]

I just want to ask if this is on the agenda?

[cthompson-insight]

Is there any update on this integration?

[verhelstq]

Just wanted to add a +1 here, holding off on using pezzo until this is available