azure-docs icon indicating copy to clipboard operation
azure-docs copied to clipboard

Queue and Table private endpoints are also needed in Batch Pipelines

Open ShaneOsborne opened this issue 2 years ago • 3 comments

Section https://learn.microsoft.com/en-us/azure/machine-learning/how-to-secure-workspace-vnet?tabs=pe%2Ccli#secure-azure-storage-accounts mentions that you only need 'Queue' and 'Table' endpoints when using ParallelRunStep when using Private endpoints

However this is also needed when running batch endpoints, for example when running the MLops-v2 QuickStart you will encounter an error when running the deploy-batch-endpoint-pipeline https://github.com/Azure/mlops-v2/blob/main/QUICKSTART.md#inner--outer-loop-moving-to-production---azure-devops

Error received in the logs will be

The master role failed. [AccessError("Failed to create table 'prsa8cb79c6x9d7cx4487x991ax182662a8c479job' due to authorization failure. If your workspace locates inside a private network, make sure to configure private endpoints for the storage account with 'table' and 'queue' subresources. Refer to https://aka.ms/prs-private-endpoint-tip for details."),

And more related errors.

Once the endpoints for queue and table created then the error disappears.

Thanks

Shane


Document Details

Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ShaneOsborne avatar Dec 08 '22 09:12 ShaneOsborne

@ShaneOsborne Thanks for your feedback! We will investigate and update as appropriate.

AjayBathini-MSFT avatar Dec 08 '22 16:12 AjayBathini-MSFT

@ShaneOsborne

I've delegated this to content author @jhirono to review and share his valuable insights.

Thank you for your feedback, it is correct and let me update the doc.

jhirono avatar Dec 15 '22 20:12 jhirono

@Blackmist can you update our doc?

jhirono avatar Jan 19 '23 18:01 jhirono

@jhirono @ShaneOsborne Thanks for the feedback! The docs have been updated; the update will go live later today.

Blackmist avatar Jan 19 '23 21:01 Blackmist

#please-close

Blackmist avatar Feb 03 '23 15:02 Blackmist