Invoke ML Pipeline step in Trigger ML Pipeline is failing.

[GannaSr]

Invoke ML Pipeline step in Trigger ML Pipeline is failing. But i do not see any error .Appreciate for any help.

Task : Invoke ML pipeline Description : Invoke Azure Machine Learning published pipelines. Version : 0.1.20 Author : ms-air-aiagility Help URL : https://marketplace.visualstudio.com/items?itemName=ms-air-aiagility.vss-services-azureml&ssr=false#overview

2022-10-27T20:28:35.0008554Z POST https://centralus.aether.ms/api/v1.0/subscriptions/71fc788e-df0b-4d38-9d88-67702c37e3b7/resourceGroups/mlops-RG/providers/Microsoft.MachineLearningServices/workspaces/mlops-AML-WS/PipelineRuns/PipelineSubmit/7616c9f1-6800-4fb8-a1ce-a939671633a4 Request body: { "AzDevOpsCallBackInfo": { "JobId": "77aee9c5-85bc-59ae-fa90-c3f20f9c111e", "HubName": "build", "TaskInstanceId": "7ffef4a3-944d-544a-2764-6fcc510d84c9", "PlanId": "62957fff-3f5b-4233-af61-4c199f045e84", "ProjectId": "18154d0f-4be3-420a-9ef3-1eb573c98452", "PlanUri": "https://dev.azure.com/MLOpsPython123/", "AuthToken": *** }, "ExperimentName": "mlopspython", "RunSource": "PipelineRun", "ParameterAssignments": { "model_name": "diabetes_regression_model.pkl" }, "tags": { "BuildId": "43", "BuildUri": "https://dev.azure.com/MLOpsPython123/ML/_build/results?buildId=43" }, "StepTags": { "BuildId": "43", "BuildUri": "https://dev.azure.com/MLOpsPython123/ML/_build/results?buildId=43" } } Response Code: OK Response: { "Description": null, "Status": { "StatusCode": 0, "StatusDetail": null, "CreationTime": "2022-10-27T20:28:34.520663Z", "EndTime": null }, "GraphId": "ba7b15ff-8c7b-4445-b451-7d65e2a7ae5f", "IsSubmitted": false, "HasErrors": false, "HasWarnings": false, "UploadState": 0, "ParameterAssignments": { "model_name": "diabetes_regression_model.pkl", "dataset_version": "latest", "data_file_path": "none", "caller_run_id": "none" }, "DataPathAssignments": {}, "DataSetDefinitionValueAssignments": {}, "AssetOutputSettingsAssignments": {}, "RunHistoryExperimentName": "mlopspython", "DisplayName": null, "PipelineRunId": "bc80c6dd-6c94-486a-af73-18ea1e387633", "PipelineId": "7616c9f1-6800-4fb8-a1ce-a939671633a4", "PipelineEndpointId": null, "RunSource": "PipelineRun", "RunType": 0, "TotalRunSteps": 3, "ScheduleId": null, "RunUrl": "https://ml.azure.com/experiments/mlopspython/runs/bc80c6dd-6c94-486a-af73-18ea1e387633?tid=a6fc8bb4-56cc-4ac5-a77e-3257928f9ffe&wsid=/subscriptions/71fc788e-df0b-4d38-9d88-67702c37e3b7/resourcegroups/mlops-RG/workspaces/mlops-AML-WS", "tags": { "BuildId": "43", "BuildUri": "https://dev.azure.com/MLOpsPython123/ML/_build/results?buildId=43" }, "StepTags": { "BuildId": "43", "BuildUri": "https://dev.azure.com/MLOpsPython123/ML/_build/results?buildId=43" }, "Properties": {}, "StepProperties": {}, "CreatedBy": { "UserObjectId": "831de4ec-e437-4ade-9da6-1ca41782937f", "UserTenantId": "a6fc8bb4-56cc-4ac5-a77e-3257928f9ffe", "UserName": "49103e81-f656-4c39-a843-93fab82bc857" }, "PreserveSubGraphs": true, "RootPipelineRunId": "bc80c6dd-6c94-486a-af73-18ea1e387633", "EnforceRerun": null, "ContinueRunOnFailedOptionalInput": true, "UserAlias": null, "DefaultCloudPriority": null, "DefaultCompute": null, "DefaultDatastore": null, "IdentityConfig": null, "PipelineTimeoutSeconds": null, "ContinueRunOnStepFailure": false, "EntityStatus": 0, "Id": "bc80c6dd-6c94-486a-af73-18ea1e387633", "Etag": ""8c0053de-0000-0300-0000-635ae9f20000"", "CreatedDate": "2022-10-27T20:28:34.520914Z", "LastModifiedDate": "2022-10-27T20:28:34.520914Z" }

[ruqianq]

You might need to log into your Azure ML studio and find that experiment. it would have the detail error log.

[cotus997]

Are you running on a free subscription? if yes, you have to change the low priority clusters into dedicated one in the diabete-regression-variable-template.yml file. - name: AML_CLUSTER_PRIORITY_SCORING value: dedicated

[codemohsmohammad789]

I am getting the same error please help

[havfront]

Are you running on a free subscription? if yes, you have to change the low priority clusters into dedicated one in the diabete-regression-variable-template.yml file. - name: AML_CLUSTER_PRIORITY_SCORING value: dedicated

Also getting this error. Although on a paid subscription, tried to change from 'lowpriority' to 'dedicated', but again same problem.

In my case, it seems like the ML-model is not being registered, as reported by the next pipeline step (Determine if evaluation succeeded and new model is registered (CLI)): ... /bin/bash /__w/_temp/azureclitaskscript1691755595349.sh Model was not registered for this run. ##[error]Script failed with error: Error: The process '/bin/bash' failed with exit code 1 at ExecState._setResult (/__w/_tasks/AzureCLI_46e4be58-730b-4389-8a2f-ea10b3e5e815/1.225.0/node_modules/azure-pipelines-task-lib/toolrunner.js:943:25) at ExecState.CheckComplete (/__w/_tasks/AzureCLI_46e4be58-730b-4389-8a2f-ea10b3e5e815/1.225.0/node_modules/azure-pipelines-task-lib/toolrunner.js:926:18) at ChildProcess.<anonymous> (/__w/_tasks/AzureCLI_46e4be58-730b-4389-8a2f-ea10b3e5e815/1.225.0/node_modules/azure-pipelines-task-lib/toolrunner.js:839:19) at ChildProcess.emit (node:events:513:28) at maybeClose (node:internal/child_process:1100:16) at Socket.<anonymous> (node:internal/child_process:458:11) at Socket.emit (node:events:513:28) at Pipe.<anonymous> (node:net:301:12) ...

I've not yet figured out where to find a log of the model registration process, or some other useful info about it. Seems like I would need some help for this.

[codervux]

Are you running on a free subscription? if yes, you have to change the low priority clusters into dedicated one in the diabete-regression-variable-template.yml file. - name: AML_CLUSTER_PRIORITY_SCORING value: dedicated

Also getting this error. Although on a paid subscription, tried to change from 'lowpriority' to 'dedicated', but again same problem.

In my case, it seems like the ML-model is not being registered, as reported by the next pipeline step (Determine if evaluation succeeded and new model is registered (CLI)): ... /bin/bash /__w/_temp/azureclitaskscript1691755595349.sh Model was not registered for this run. ##[error]Script failed with error: Error: The process '/bin/bash' failed with exit code 1 at ExecState._setResult (/__w/_tasks/AzureCLI_46e4be58-730b-4389-8a2f-ea10b3e5e815/1.225.0/node_modules/azure-pipelines-task-lib/toolrunner.js:943:25) at ExecState.CheckComplete (/__w/_tasks/AzureCLI_46e4be58-730b-4389-8a2f-ea10b3e5e815/1.225.0/node_modules/azure-pipelines-task-lib/toolrunner.js:926:18) at ChildProcess.<anonymous> (/__w/_tasks/AzureCLI_46e4be58-730b-4389-8a2f-ea10b3e5e815/1.225.0/node_modules/azure-pipelines-task-lib/toolrunner.js:839:19) at ChildProcess.emit (node:events:513:28) at maybeClose (node:internal/child_process:1100:16) at Socket.<anonymous> (node:internal/child_process:458:11) at Socket.emit (node:events:513:28) at Pipe.<anonymous> (node:net:301:12) ...

I've not yet figured out where to find a log of the model registration process, or some other useful info about it. Seems like I would need some help for this.

hello havfront, I also get this error. Did you fix it? please give me a hand...