[FEATURE REQ] LIVE test for mgmt GA Lite packages

[weidongxu-microsoft]

Guide https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/resourcemanager/docs/HOW_TO_ADD_LIVE_TESTS.md

Sample PR (databricks) https://github.com/Azure/azure-sdk-for-java/pull/35315

Test can be very simple, just find the basic resource, create it (one can refer to samples for parameters, but it could be wrong; a better place would be Portal and its "export ARM template"), do some get/list, then delete it in finally block.

Have a pair of // @embedmeStart // @embedmeEnd enclosing the code that create a resource. Autorest.Java will extract it to README.md "Examples" section in next codegen.

Following lib would be avoided at present

• service that share track2 data-plane and mgmt-plane lib in same folder (especially those having data-plane test-resources.json/bicep), e.g. https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/eventgrid

PS: for shared folder, we should be able to specify another folder for bicep in "tests.mgmt.yml" e.g. https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/communication/communication-tests-template.yml#L14-L17. But better to delay it, as they are not many.

high priority

• [x] avs
• [x] cognitiveservices
• [ ] digitaltwins
• [x] hdinsight
• [x] iothub
• [x] mysql
• [x] mysqlflexibleserver (non-GA)
• [x] postgresql
• [x] postgresqlflexibleserver (non-GA)
• [x] redisenterprise

lower priority

• [x] recoveryservicesbackup
• [x] changeanalysis
• [ ] communication (data-plane)
• [ ] desktopvirtualization
• [ ] eventgrid (data-plane)
• [ ] fluidrelay
• [ ] iotcentral
• [x] machinelearningservices
• [ ] newrelicobservability
• [x] providerhub
• [ ] qumulo
• [x] recoveryservices
• [x] resourcemover
• [x] storagemover
• [ ] voiceservices
• [ ] webpubsub (data-plane)
• [x] workloads

[XiaofeiCao]

I'm adding test to postgresqlflexibleserver. @v-hongli1 You can leave this out.

[weidongxu-microsoft]

• [x] apimanagement
• [x] dataprotection
• [x] managednetworkfabric
• [ ] selfhelp

In Sept. (service may do it themselves)

• [ ] networkcloud

[v-hongli1]

Although the selfhelp service can create diagnostics, it does not have the deletion function and requires the intervention of azuer supporter. so it is recommended that the service does not add any live test cases.

[v-hongli1]

The networkcloud service needs to specify an ISP provider when creating an application service, so it is recommended that the service does not add any live test cases.

[weidongxu-microsoft]

A few new GAed (or to be GAed) libs

• [x] postgresqlhsc
• [ ] kubernetesconfiguration
• [ ] hybridconnectivity

[v-hongli1]

The kubernetesconfiguration service needs Owner permission, but a empower exceptions occurs when deploy test resources. so it is recommended that the service does not add any live test cases. DployTestResource.log

[v-hongli1]

HybridCompute needs to be used in the live test case of the HybridConnectivity service, but this front-end service can only be created through bicep, arm template or terraform. I think this way of creating front-end services is not suitable for appearing in live tests. so it is recommended that the service does not add any live test cases.

[weidongxu-microsoft]

Sure. Just check the box that you've added live test (in comments above).

[weidongxu-microsoft]

• [x] netapp
• [ ] connectedvmware
• [x] applicationinsights
• [x] loganalytics
• [x] kusto

[v-hongli1]

The connectedvmware service must be supported by the front-end service Kubernetes cluster with Azure Arc, but Kubernetes cluster with Azure Arc can only be created by script. This way of creating front-end services is not suitable for use in live test. So it is recommended that the service does not add any live test cases.

[weidongxu-microsoft]

• [x] containerservicefleet
• [x] devtestlabs

[XiaofeiCao]

• [ ] nginx
• [x] chaos
• [x] paloaltonetworks
• [ ] confluent
• [x] dashboard
• [ ] mobilenetwork

[v-hongli1]

The azure-resourcemanager-nginx requires the use of paid azure service NGINXSaas, so it is recommended that the service does not add any live test cases.

[v-hongli1]

The azure-resourcemanager-mobilenetwork service involves property settings of mobile network providers, so it is recommended that the service does not add any live test cases.

[v-hongli1]

The azure-resourcemanager-confluent service requires permission to create Marketplace offer on Partner Center, so it is recommended that the service does not add any live test cases.

[weidongxu-microsoft]

• [x] deviceupdate
• [x] servicenetworking
• [x] networkanalytics
• [x] elasticsan
• [ ] hybridcontainerservice
• [x] imagebuilder
• [x] healthcareapis

[v-hongli1]

The live test case of the service healthcareapis has been added at 2024/2/9.

[v-hongli1]

The hybridcontainerservice service must be supported by the front-end service Kubernetes cluster with Azure Arc, but Kubernetes cluster with Azure Arc can only be created by script. So just leave a List (and enable that test).

[weidongxu-microsoft]

• [x] apicenter
• [x] iotfirmwaredefense
• [x] sphere
• [x] frontdoor
• [ ] support

[v-hongli1]

The resource removal method is missing in the azure-resourcemanager-support service, so it is recommended not to add any live test cases for this service.

[v-hongli1]

• [ ] elastic
• [ ] containerorchestratorruntime
• [ ] workloadssapvirtualinstance
• [x] servicefabricmanagedclusters
• [x] computefleet
• [ ] appcontainers

[v-hongli1]

The elastic is a SaaS service and the Azure subscription must be associated with a valid payment method, so it is recommended not to add any live test cases for this service.

[github-actions[bot]]

Hi @weidongxu-microsoft, we deeply appreciate your input into this project. Regrettably, this issue has remained unresolved for over 2 years and inactive for 30 days, leading us to the decision to close it. We've implemented this policy to maintain the relevance of our issue queue and facilitate easier navigation for new contributors. If you still believe this topic requires attention, please feel free to create a new issue, referencing this one. Thank you for your understanding and ongoing support.