Azure ML Online Endpoints on AKS compute no longer supported

[tommyJimmy87]

Related command

az ml online-endpoint create --name aks_endpoint -f endpoint_aks.yaml

endpoint_aks.yaml :

$schema: https://azuremlschemas.azureedge.net/latest/managedOnlineEndpoint.schema.json
name: my-endpoint
compute: azureml:aks
auth_mode: Key
tags:
  version: 1

Extension name (the extension in question)

ml

Description of issue (in as much detail as possible)

here listed all the versions:

Please let us know how we are doing: https://aka.ms/azureclihats

and let us know if you're interested in trying out our newest features: https://aka.ms/CLIUXstudy
core                              2.38.0
telemetry                          1.0.6

Extensions:
ml                                 2.4.0
azure-devops                      0.25.0

Dependencies:
msal                            1.18.0b1
azure-mgmt-resource             21.1.0b1

Error I get is:

ERROR: (BadRequest) The request is invalid.
Code: BadRequest
Message: The request is invalid.
Exception Details:	(NotSupported) Creation of Online Endpoints or deployments on AKS compute type is no longer supported. More details can be found here, https://aka.ms/troubleshoot-creating-aks-endpoint
	Code: NotSupported
	Message: Creation of Online Endpoints or deployments on AKS compute type is no longer supported. More details can be found here, https://aka.ms/troubleshoot-creating-aks-endpoint
Additional Information:Type: ComponentName
Info: {
    "value": "managementfrontend"
}Type: Correlation
Info: {
    "value": {
        "operation": "601471e2620e594291f18ff4c47fe660",
        "request": "24c163354cf5ef6a"
    }
}Type: Environment
Info: {
    "value": "westeurope"
}Type: Location
Info: {
    "value": "westeurope"
}Type: Time
Info: {
    "value": "2022-07-11T16:08:58.3790235+00:00"
}

I don't find any reference in the documentation, instead, it appears to me that it should be supported as per docs here: https://docs.microsoft.com/en-us/azure/machine-learning/reference-yaml-endpoint-online

Also in the troubleshooting mentioned in the error there's no evidence of dropping the support of aks.

thanks

---

[yonzhan]

route to CXP team

[RakeshMohanMSFT]

@tommyJimmy87 Thank you for reaching out, we are looking into it.

[ghost]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @azureml-github.

Issue Details

---

Related command

az ml online-endpoint create --name aks_endpoint -f endpoint_aks.yaml

endpoint_aks.yaml :

$schema: https://azuremlschemas.azureedge.net/latest/managedOnlineEndpoint.schema.json
name: my-endpoint
compute: azureml:aks
auth_mode: Key
tags:
  version: 1

Extension name (the extension in question)

ml

Description of issue (in as much detail as possible)

here listed all the versions:

Please let us know how we are doing: https://aka.ms/azureclihats

and let us know if you're interested in trying out our newest features: https://aka.ms/CLIUXstudy
core                              2.38.0
telemetry                          1.0.6

Extensions:
ml                                 2.4.0
azure-devops                      0.25.0

Dependencies:
msal                            1.18.0b1
azure-mgmt-resource             21.1.0b1

Error I get is:

ERROR: (BadRequest) The request is invalid.
Code: BadRequest
Message: The request is invalid.
Exception Details:	(NotSupported) Creation of Online Endpoints or deployments on AKS compute type is no longer supported. More details can be found here, https://aka.ms/troubleshoot-creating-aks-endpoint
	Code: NotSupported
	Message: Creation of Online Endpoints or deployments on AKS compute type is no longer supported. More details can be found here, https://aka.ms/troubleshoot-creating-aks-endpoint
Additional Information:Type: ComponentName
Info: {
    "value": "managementfrontend"
}Type: Correlation
Info: {
    "value": {
        "operation": "601471e2620e594291f18ff4c47fe660",
        "request": "24c163354cf5ef6a"
    }
}Type: Environment
Info: {
    "value": "westeurope"
}Type: Location
Info: {
    "value": "westeurope"
}Type: Time
Info: {
    "value": "2022-07-11T16:08:58.3790235+00:00"
}

I don't find any reference in the documentation, instead, it appears to me that it should be supported as per docs here: https://docs.microsoft.com/en-us/azure/machine-learning/reference-yaml-endpoint-online

Also in the troubleshooting mentioned in the error there's no evidence of dropping the support of aks.

thanks

---

Author:	tommyJimmy87
Assignees:	-
Labels:	question, extension/ml, customer-reported, Machine Learning, Service Attention, Auto-Assign
Milestone:	-

[hugoaponte]

Thanks for bringing this up to our attention.

My first suggestion is to upgrade to the newest Azure ML CLI v2 extension.

The compute used to create Online Endpoints running on Kubernetes should be an attached Azure Arc-enabled Kubernetes cluster: https://docs.microsoft.com/en-us/azure/azure-arc/kubernetes/overview https://docs.microsoft.com/en-us/azure/machine-learning/how-to-attach-kubernetes-anywhere?tabs=deploy-extension-with-cli%2Ccli

I am unsure if the aks compute provided in your example is Arc-enabled or the Kubernetes clusters supported by Azure ML SDK v1. If unsure, you can provide the output of "az ml compute show -n NAME".

More info also here: https://docs.microsoft.com/en-us/azure/machine-learning/concept-endpoints

Thanks,

Hugo

[ghost]

Hi, we're sending this friendly reminder because we haven't heard back from you in a while. We need more information about this issue to help address it. Please be sure to give us your input within the next 7 days. If we don't hear back from you within 14 days of this comment the issue will be automatically closed. Thank you!

[tommyJimmy87]

Sorry I didn't have time to test this, will be back asap.

[RakeshMohanMSFT]

@tommyJimmy87 Thank you

[ghost]

Hi, we're sending this friendly reminder because we haven't heard back from you in a while. We need more information about this issue to help address it. Please be sure to give us your input within the next 7 days. If we don't hear back from you within 14 days of this comment the issue will be automatically closed. Thank you!

[hanshasharma]

Hi - I am also experiencing the same issue with Azure CLI v2.39.0 * and ml extension v2.8.0. I am trying to run https://github.com/Azure/azureml-examples/tree/main/cli/endpoints/online/kubernetes. I am getting the following error.

Message: The request is invalid. Exception Details: (NotSupported) Creation of Online Endpoints or deployments on AKS compute type is no longer supported. More details can be found here, https://aka.ms/troubleshoot-creating-aks-endpoint Code: NotSupported Message: Creation of Online Endpoints or deployments on AKS compute type is no longer supported. More details can be found here, https://aka.ms/troubleshoot-creating-aks-endpoint Additional Information:Type: ComponentName

[Bozhong68]

@hanshasharma Legacy AksCompute doesn't support online endpoint. For v2 online endpoint support, you can attach AKS cluster by following instruction here https://aka.ms/amlarc/doc