azure-service-operator icon indicating copy to clipboard operation
azure-service-operator copied to clipboard

Missing OpenAI Resource & Deployment Model Support in Azure Service Operator

Open vijay176us opened this issue 8 months ago • 1 comments

## Describe the bug

Azure Service Operator (ASO) does not currently support provisioning Azure OpenAI resources (Microsoft.CognitiveServices/accounts) and Deployment Models (Microsoft.CognitiveServices/accounts/deployments). This limitation prevents managing OpenAI services via Kubernetes and blocks the adoption of a GitOps approach for deploying and managing these resources efficiently. Adding a Custom Resource Definition (CRD) for OpenAI would enable seamless deployment and lifecycle management through ASO.

Azure Service Operator Version: ASOv2

🔹 Description Azure Service Operator (ASO) currently does not support provisioning Azure OpenAI resources (Microsoft.CognitiveServices/accounts) and Deployment Models (Microsoft.CognitiveServices/accounts/deployments). This feature is essential for managing OpenAI workloads via Kubernetes.

🔹 Expected Behavior ASO should provide a CRD (Custom Resource Definition) for "Microsoft.CognitiveServices/accounts" and "Microsoft.CognitiveServices/accounts/deployments". Users should be able to deploy and manage OpenAI resources through Kubernetes manifests.

🔹 Current Behavior Attempting to apply a Kubernetes manifest for OpenAI resources results in "Unknown resource type" errors. No ASO documentation exists for Microsoft.CognitiveServices/accounts and Microsoft.CognitiveServices/accounts/deployments.

Screenshots

If applicable, add screenshots to help explain your problem.

Additional context

Add any other context about the problem here.

vijay176us avatar Mar 10 '25 08:03 vijay176us

We agree that this is a gap and we'll add this to the backlog of requested resources.

If you have the time and inclination, we do accept PRs - see our guide on how to add these resources yourself.

theunrepentantgeek avatar Mar 10 '25 22:03 theunrepentantgeek