[Integration]: OpenAI on Azure

[ianu82]

Is there an existing integration?

• [X] I have searched the existing integrations.

Use Case

If you can't guess, ask Ian why.

Motivation

If you can't guess, ask Ian why.

Implementation

No response

Anything else?

No response

[younes-io]

@ianu82 : did you manage to integrate with Azure OpenAI ? @tomhuds : it seems that there is no specific handler for Azure OpenAI, is there a workaround using LangChain's class AzureChatOpenAI ?

[nx-chen]

Waiting the response as well.

[ianu82]

@torrmal FYI

[ianu82]

@younes-io, @nx-chen, is this something you’d be interested in using immediately?

[younes-io]

Yes, we chose mindsdb as an alternative to another tool, but we just realized that Azure OpenAI is not supported

[younes-io]

@ianu82 : could you please recommend a workaround if it's not ready / supported yet ? We really would like to use / test the capabilities of mindsdb for our usecase

[ianu82]

Hi Younes, the options I see are to use an open source model (Llama2 for instance, perhaps finetuned) or use the OpenAI API rather than OpenAI on Azure.

depending on your task, you could consider finetuning an open source model which potentially could deliver as good or superior performance as a generalist commercial model.

[younes-io]

My client uses the Azure OpenAI API for all their apps, and I have no control over that decision. Additionally, the widespread use of the Azure OpenAI API in the market cannot be ignored, and I believe its support is essential.

I was considering that since MindsDB is integrated with LangChain, which supports Azure OpenAI, there might be a feasible solution. However, if changing the LLM is the only option, I view it not as a viable solution but as a limitation. Companies choose their LLMs for various reasons, and MindsDB's requirements shouldn't dictate those choices, right?

Thank you for your feedback – I really appreciate your help.

[younes-io]

Another reason why this argument is not valid is that a company cannot simply change their LLM because of MindsDB, especially when they use Azure OpenAI API for all their apps. This means that now they would have to add a new LLM specifically for MindsDB, which is very costly.

[younes-io]

@ianu82 @torrmal, sorry to ping you again, but I was just wondering if there may be a workaround for us to integrate MindsDB with Azure OpenAI API. Could you please help? Thank you!

[ianu82]

Hey @younes-io - is there an email address I can reach you on please? Mine’s ian at mindsdb . com.

Let’s fully explore the options here 👍

[younes-io]

Thank you @ianu82 I just sent you an email :)

[ZoranPandovski]

This issue has been open for over 5 months without activity. We are closing it to keep our project focused.

Please reopen or create a new issue with updated details if it's still relevant.