R2R icon indicating copy to clipboard operation
R2R copied to clipboard

Support for Azure OpenAI

Open sauravpanda opened this issue 11 months ago • 3 comments

I wanted to inquire if you would be interested in adding access to Azure's OpenAI endpoints?

Happy to help with this issue if you want!

sauravpanda avatar Feb 26 '24 19:02 sauravpanda

Hey Saurav,

Sure, why not - could you create a PR with that modification to our OpenAIProvider?

emrgnt-cmplxty avatar Feb 26 '24 19:02 emrgnt-cmplxty

Will work on this, might need couple of days!

sauravpanda avatar Feb 27 '24 04:02 sauravpanda

How is that coming along?

emrgnt-cmplxty avatar Feb 28 '24 05:02 emrgnt-cmplxty

Sorry, I got started on this yesterday. I have updated llms/openai/base.py, but it seems we need changes in multiple places.

Should I create a pull request for the partial updates I have made just for feedback? We don't need to merge it, but I can get your input.

sauravpanda avatar Feb 29 '24 15:02 sauravpanda

Sure - today i will be merging LiteLLM shortly which handily supports most providers, including Azure w/ a unified API.

emrgnt-cmplxty avatar Feb 29 '24 19:02 emrgnt-cmplxty

Solved with LiteLLM integration.

emrgnt-cmplxty avatar Feb 29 '24 19:02 emrgnt-cmplxty