Archon icon indicating copy to clipboard operation
Archon copied to clipboard

Feature Request: Add the ability to use Azure Open AI LLM's

Open Dods80 opened this issue 3 months ago • 2 comments

Hello, A lot of users will probably want to deploy this in their organisation which has taken onboard the Azure model to govern and consume there AI units.

Dods80 avatar Sep 04 '25 08:09 Dods80

We are working on OpenAI API compatibility which should help with this! I do know that the Azure Open AI integration is trickier though since there are extra parameters for the client if I remember correctly... something like the organization ID needs to be passed in when initializing the OpenAI client?

coleam00 avatar Sep 06 '25 18:09 coleam00

Summary of requirements on the Azure Platform

Requirement Details
Azure Subscription Needed for resource allocation
Resource Deployment Model selection, deployment type, region-specific availability
Authentication API Key or Entra ID (Azure AD); assign RBAC roles
API Parameters Endpoint URL, API key/token, Deployment Name, sometimes Organization ID
Network & Security CORS for storage, VNet/private endpoint for advanced security
Compliance Align with standards (GDPR, HIPAA, SOC2, etc.)
SDK/Client Libraries Use official clients for Python, .NET, Java, others

miskaone avatar Sep 27 '25 14:09 miskaone