azure-rest-api-specs icon indicating copy to clipboard operation
azure-rest-api-specs copied to clipboard

HDInsight: onboard new apiversion 2023-11-01-preview

Open dw511214992 opened this issue 1 year ago • 109 comments

ARM (Control Plane) API Specification Update Pull Request

Tip: overwhelmed by all this guidance? See the Getting help section at the bottom of this PR description.

PR review workflow diagram

Please understand this diagram before proceeding. It explains how to get your PR approved & merged.

diagram

Click here to see the details of Step 1

Breaking changes review (Diagram Step 1)

If the automation determines you have breaking changes, i.e. Step 1 from the diagram applies to you, you must follow the breaking changes process.
IMPORTANT This applies even if:

  • The tool fails while it shouldn't, e.g. due to runtime exception, or incorrect detection of breaking changes.
  • You believe there is no need for you to request breaking change approval, for any reason. Such claims must be reviewed, and the process is the same.
Click here to see the details of Step 2

ARM API changes review (Diagram Step 2)

  • If this PR is in purview of ARM review then automation will add the ARMReview label.
  • If you want to force ARM review, add the label yourself.
  • Proceed according to the diagram at the top of this comment.
Click here to see the diagram footnotes

Diagram footnotes

[1] ARM review queue (for merge queues, see [2])
The PRs are processed by time opened, ascending. Your PR may show up on 2nd or later page. If you addressed Step 1 from the diagram and your PR is not showing up in the queue, ensure the label ARMChangesRequested is removed from your PR. This should cause the label WaitForARMFeedback to be added. [2] public repo merge queue, private repo merge queue (for ARM review queue, [1])

If you need further help with anything, see Getting help section below.

Purpose of this PR

What's the purpose of this PR? Check all that apply. This is mandatory!

  • [x] New API version. (If API spec is not defined in TypeSpec, the PR should have been generated using OpenAPI Hub).
  • [ ] Update existing version for a new feature. (This is applicable only when you are revising a private preview API version.)
  • [ ] Update existing version to fix swagger quality issues in S360.
  • [ ] Other, please clarify:
    • edit this with your clarification

Due diligence checklist

To merge this PR, you must go through the following checklist and confirm you understood and followed the instructions by checking all the boxes:

  • [x] I confirm this PR is modifying Azure Resource Manager (ARM) related specifications, and not data plane related specifications.
  • [x] I have reviewed following Resource Provider guidelines, including ARM resource provider contract and REST guidelines (estimated time: 4 hours).
    I understand this is required before I can proceed to the Diagram Step 2, "ARM API changes Review", for this PR.

Additional information

Viewing API changes

For convenient view of the API changes made by this PR, refer to the URLs provided in the table in the Generated ApiView comment added to this PR. You can use ApiView to show API versions diff.

Suppressing failures

If one or multiple validation error/warning suppression(s) is detected in your PR, please follow the Swagger-Suppression-Process to get approval.

Getting help

  • First, please carefully read through this PR description, from top to bottom. Please fill out the Purpose of this PR and Due diligence checklist.
  • To understand what you must do next to merge this PR, see the Next Steps to Merge comment. It will appear within few minutes of submitting this PR and will continue to be up-to-date with current PR state.
  • For guidance on fixing this PR CI check failures, see the hyperlinks provided in given failure and https://aka.ms/ci-fix.
  • If the PR CI checks appear to be stuck in queued state, please add a comment with contents /azp run. This should result in a new comment denoting a PR validation pipeline has started and the checks should be updated after few minutes.
  • If the help provided by the previous points is not enough, post to https://aka.ms/azsdk/support/specreview-channel and link to this PR.

dw511214992 avatar Jan 09 '24 06:01 dw511214992

Next Steps to Merge

Important checks have failed. As of today they are not blocking this PR, but in near future they will.
Addressing the following failures is highly recommended:
  • ⚠️ The check named TypeSpec Requirement has failed. TypeSpec usage is required for all new (greenfield) services. This is currently enforced as a warning, but will be made a blocking error in the near future. For information on converting from OpenAPI specs to TypeSpec specs or on data-plane (DP) policies, refer to aka.ms/azsdk/typespec. If you have general questions on resource provider (RP) policies, refer to aka.ms/rphelp.
If you still want to proceed merging this PR without addressing the above failures, refer to step 4 in the PR workflow diagram (even if your PR is for data plane, not ARM).

Swagger Validation Report

️️✔️BreakingChange succeeded [Detail] [Expand]
There are no breaking changes.
️⚠️Breaking Change(Cross-Version): 18 Warnings warning [Detail]
compared swaggers (via Oad v0.10.4)] new version base version
hdinsight.json 2023-11-01-preview(a434a5a) 2023-06-01-preview(main)

The following breaking changes are detected by comparison with the latest preview version:

Rule Message
:warning: 1017 - ReferenceRedirection The '$ref' property points to different models in the old and new versions.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1985:9
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L1665:9
:warning: 1022 - RemovedAdditionalProperties The new version removes the 'additionalProperties' element.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1985:9
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L1665:9
:warning: 1025 - RequiredStatusChange The 'required' status changed from the old version('True') to the new version('False').
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1936:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L1623:7
:warning: 1025 - RequiredStatusChange The 'required' status changed from the old version('True') to the new version('False').
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2296:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L1977:7
:warning: 1025 - RequiredStatusChange The 'required' status changed from the old version('True') to the new version('False').
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2358:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2018:7
:warning: 1025 - RequiredStatusChange The 'required' status changed from the old version('True') to the new version('False').
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2620:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2260:7
:warning: 1025 - RequiredStatusChange The 'required' status changed from the old version('True') to the new version('False').
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3711:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L3042:7
:warning: 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L781:13
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L551:13
:warning: 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3138:5
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2479:5
:warning: 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'location' renamed or removed?
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3141:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2482:7
:warning: 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'id' renamed or removed?
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3141:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2482:7
:warning: 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'name' renamed or removed?
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3141:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2482:7
:warning: 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'type' renamed or removed?
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3141:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2482:7
:warning: 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'systemData' renamed or removed?
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3141:7
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2482:7
:warning: 1034 - AddedRequiredProperty The new version has new required property 'diskStorage' that was not found in the old version.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2939:7
:warning: 1034 - AddedRequiredProperty The new version has new required property 'diskStorage' that was not found in the old version.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1985:9
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L1665:9
:warning: 1036 - ConstraintChanged The new version has a different 'pattern' value than the previous one.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2770:9
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2328:9
:warning: 1036 - ConstraintChanged The new version has a different 'pattern' value than the previous one.
New: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2585:9
Old: HDInsightOnAks/preview/2023-06-01-preview/hdinsight.json#L2222:9
️️✔️CredScan succeeded [Detail] [Expand]
There is no credential detected.
️⚠️LintDiff: 1 Warnings warning [Detail]
compared tags (via openapi-validator v2.1.6) new version base version
package-preview-2023-11 package-preview-2023-11(a434a5a) default(main)

[must fix]The following errors/warnings are introduced by current PR:

Rule Message Related RPC [For API reviewers]
:warning: AvoidNestedProperties Consider using x-ms-client-flatten to provide a better end user experience
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2826


The following errors/warnings exist before current PR submission:

Rule Message
XmsPageableForListCalls x-ms-pageable extension must be specified for LIST APIs.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1119
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1569
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1569
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1569
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1781
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1805
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1827
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1959
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L1991
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L2005
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3061
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3061
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3061
AllTrackedResourcesMustHaveDelete The resource Cluster does not have a corresponding delete operation.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3117
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3121
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3121
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3121
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3142
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3165
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3176
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3245
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3245
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3265
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3265
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3299
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3306
AvoidAdditionalProperties Definitions must not have properties named additionalProperties except for user defined tags or predefined references.
Location: HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json#L3761
️️✔️Avocado succeeded [Detail] [Expand]
Validation passes for Avocado.
️️✔️SwaggerAPIView succeeded [Detail] [Expand]
️️✔️TypeSpecAPIView succeeded [Detail] [Expand]
️️✔️ModelValidation succeeded [Detail] [Expand]
Validation passes for ModelValidation.
️️✔️SemanticValidation succeeded [Detail] [Expand]
Validation passes for SemanticValidation.
️️✔️PoliCheck succeeded [Detail] [Expand]
Validation passed for PoliCheck.
️️✔️SpellCheck succeeded [Detail] [Expand]
Validation passes for SpellCheck.
️️✔️Lint(RPaaS) succeeded [Detail] [Expand]
Validation passes for Lint(RPaaS).
️️✔️PR Summary succeeded [Detail] [Expand]
Validation passes for Summary.
️️✔️Automated merging requirements met succeeded [Detail] [Expand]
Posted by Swagger Pipeline | How to fix these errors?

Swagger Generation Artifacts

️️✔️ApiDocPreview succeeded [Detail] [Expand]
 Please click here to preview with your @microsoft account. 
️❌SDK Breaking Change Tracking failed [Detail]

Breaking Changes Tracking

azure-sdk-for-go - sdk/resourcemanager/hdinsightcontainers/armhdinsightcontainers - Approved - 0.3.0
+	Field `ID`, `Location`, `Name`, `SystemData`, `Type` of struct `ClusterPatch` has been removed
+	Type of `ClusterProfile.KafkaProfile` has been changed from `map[string]any` to `*KafkaProfile`
azure-sdk-for-python-track2 - track2_azure-mgmt-hdinsightcontainers - Approved - 1.0.0b1
+	Model ClusterPatch no longer has parameter id
+	Model ClusterPatch no longer has parameter location
+	Model ClusterPatch no longer has parameter name
+	Model ClusterPatch no longer has parameter system_data
+	Model ClusterPatch no longer has parameter type
azure-sdk-for-js - @azure/arm-hdinsightcontainers - Approved - 1.0.0-beta.2
+	Type of parameter kafkaProfile of interface ClusterProfile is changed from {
        [propertyName: string]: any;
    } to KafkaProfile
️❌ azure-sdk-for-net-track2 failed [Detail]
  • Pipeline Framework Failed [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. SDK Automation 14.0.0
    command	pwsh ./eng/scripts/Automation-Sdk-Init.ps1 ../azure-sdk-for-net_tmp/initInput.json ../azure-sdk-for-net_tmp/initOutput.json
    command	pwsh ./eng/scripts/Invoke-GenerateAndBuildV2.ps1 ../azure-sdk-for-net_tmp/generateInput.json ../azure-sdk-for-net_tmp/generateOutput.json
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGet-Content: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:388
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 388 | [0m       ([36;1mGet-Content $file[0m) -replace $rquirefileRex, "$requirefile" | S …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m        ~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mCannot find path
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m'/mnt/vss/_work/1/s/azure-sdk-for-net/sdk/hdinsight/Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers/src/autorest.md' because it does not exist.
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mResolve-Path: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:392
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 392 | [0m     $relativeFolderPath = [36;1mResolve-Path $projectFolder -Relative[0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m                           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mCannot find path
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m'/mnt/vss/_work/1/s/azure-sdk-for-net/sdk/hdinsight/Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers' because it does not exist.
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGeneratePackage: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:714
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 714 | [0m         [36;1mGeneratePackage -projectFolder $projectFolder -sdkRootPath $s[0m …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mFailed to generate sdk. exit code: False
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGet-ChildItem: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:807
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 807 | [0m … rtifacts += [36;1mGet-ChildItem $artifactsPath -Filter *.nupkg -exclude *.s[0m …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m               ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mCannot find path
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m'/mnt/vss/_work/1/s/azure-sdk-for-net/artifacts/packages/Debug/' because
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1mit does not exist.
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGeneratePackage: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:714
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 714 | [0m         [36;1mGeneratePackage -projectFolder $projectFolder -sdkRootPath $s[0m …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mFailed to generate sdk artifact
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGeneratePackage: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:883
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 883 | [0m         [36;1mGeneratePackage -projectFolder $projectFolder -sdkRootPath $s[0m …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mFailed to generate sdk. exit code: False
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGet-ChildItem: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:807
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 807 | [0m … rtifacts += [36;1mGet-ChildItem $artifactsPath -Filter *.nupkg -exclude *.s[0m …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m               ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mCannot find path
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m'/mnt/vss/_work/1/s/azure-sdk-for-net/artifacts/packages/Debug/' because
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1mit does not exist.
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1mGeneratePackage: [0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:883
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1mLine |
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m 883 | [0m         [36;1mGeneratePackage -projectFolder $projectFolder -sdkRootPath $s[0m …
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [36;1m     | [31;1m         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [31;1m[36;1m     | [31;1mFailed to generate sdk artifact
    cmderr	[Invoke-GenerateAndBuildV2.ps1] [0m
    fatal: 'sdkAuto/27306/Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers' is not a valid branch name
  • Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers [View full logs
    error	Fatal error: fatal: 'sdkAuto/27306/Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers' is not a valid branch name
    error	Fatal error: Error: fatal: 'sdkAuto/27306/Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers' is not a valid branch name    at Object.action (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1274:25)    at PluginStore.exec (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1309:29)    at /mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1674:43    at new Promise (<anonymous>)    at GitExecutorChain.handleTaskData (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1672:16)    at GitExecutorChain.<anonymous> (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1656:44)    at Generator.next (<anonymous>)    at fulfilled (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:55:24)    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    error	The following packages are still pending:
    error		Azure.ResourceManager.HDInsight Azure.ResourceManager.HDInsight.Containers
    error		Azure.ResourceManager.HDInsight.Containers
  • Azure.ResourceManager.HDInsight.Containers
️️✔️ azure-sdk-for-go succeeded [Detail] [Expand]
  • ️✔️Succeeded [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. SDK Automation 14.0.0
    command	sh ./eng/scripts/automation_init.sh ../../../../../azure-sdk-for-go_tmp/initInput.json ../../../../../azure-sdk-for-go_tmp/initOutput.json
    command	generator automation-v2 ../../../../../azure-sdk-for-go_tmp/generateInput.json ../../../../../azure-sdk-for-go_tmp/generateOutput.json
  • ️✔️sdk/resourcemanager/hdinsightcontainers/armhdinsightcontainers [View full logs]  [Preview SDK Changes] Breaking Change Detected
    info	[Changelog] ### Breaking Changes
    info	[Changelog]
    info	[Changelog] - Type of `ClusterProfile.KafkaProfile` has been changed from `map[string]any` to `*KafkaProfile`
    info	[Changelog] - Field `ID`, `Location`, `Name`, `SystemData`, `Type` of struct `ClusterPatch` has been removed
    info	[Changelog]
    info	[Changelog] ### Features Added
    info	[Changelog]
    info	[Changelog] - New value `ActionLASTSTATEUPDATE`, `ActionRELAUNCH` added to enum type `Action`
    info	[Changelog] - New enum type `ClusterAvailableUpgradeType` with values `ClusterAvailableUpgradeTypeAKSPatchUpgrade`, `ClusterAvailableUpgradeTypeHotfixUpgrade`
    info	[Changelog] - New enum type `ClusterPoolAvailableUpgradeType` with values `ClusterPoolAvailableUpgradeTypeAKSPatchUpgrade`, `ClusterPoolAvailableUpgradeTypeNodeOsUpgrade`
    info	[Changelog] - New enum type `ClusterPoolUpgradeType` with values `ClusterPoolUpgradeTypeAKSPatchUpgrade`, `ClusterPoolUpgradeTypeNodeOsUpgrade`
    info	[Changelog] - New enum type `ClusterUpgradeType` with values `ClusterUpgradeTypeAKSPatchUpgrade`, `ClusterUpgradeTypeHotfixUpgrade`
    info	[Changelog] - New enum type `CurrentClusterAksVersionStatus` with values `CurrentClusterAksVersionStatusDeprecated`, `CurrentClusterAksVersionStatusSupported`
    info	[Changelog] - New enum type `CurrentClusterPoolAksVersionStatus` with values `CurrentClusterPoolAksVersionStatusDeprecated`, `CurrentClusterPoolAksVersionStatusSupported`
    info	[Changelog] - New enum type `DataDiskType` with values `DataDiskTypePremiumSSDLRS`, `DataDiskTypePremiumSSDV2LRS`, `DataDiskTypePremiumSSDZRS`, `DataDiskTypeStandardHDDLRS`, `DataDiskTypeStandardSSDLRS`, `DataDiskTypeStandardSSDZRS`
    info	[Changelog] - New enum type `DbConnectionAuthenticationMode` with values `DbConnectionAuthenticationModeIdentityAuth`, `DbConnectionAuthenticationModeSQLAuth`
    info	[Changelog] - New enum type `DeploymentMode` with values `DeploymentModeApplication`, `DeploymentModeSession`
    info	[Changelog] - New enum type `MetastoreDbConnectionAuthenticationMode` with values `MetastoreDbConnectionAuthenticationModeIdentityAuth`, `MetastoreDbConnectionAuthenticationModeSQLAuth`
    info	[Changelog] - New enum type `OutboundType` with values `OutboundTypeLoadBalancer`, `OutboundTypeUserDefinedRouting`
    info	[Changelog] - New enum type `RangerUsersyncMode` with values `RangerUsersyncModeAutomatic`, `RangerUsersyncModeStatic`
    info	[Changelog] - New enum type `Severity` with values `SeverityCritical`, `SeverityHigh`, `SeverityLow`, `SeverityMedium`
    info	[Changelog] - New enum type `UpgradeMode` with values `UpgradeModeLASTSTATEUPDATE`, `UpgradeModeSTATELESSUPDATE`, `UpgradeModeUPDATE`
    info	[Changelog] - New function `*ClientFactory.NewClusterAvailableUpgradesClient() *ClusterAvailableUpgradesClient`
    info	[Changelog] - New function `*ClientFactory.NewClusterPoolAvailableUpgradesClient() *ClusterPoolAvailableUpgradesClient`
    info	[Changelog] - New function `*ClusterAKSPatchVersionUpgradeProperties.GetClusterUpgradeProperties() *ClusterUpgradeProperties`
    info	[Changelog] - New function `*ClusterAvailableUpgradeAksPatchUpgradeProperties.GetClusterAvailableUpgradeProperties() *ClusterAvailableUpgradeProperties`
    info	[Changelog] - New function `*ClusterAvailableUpgradeHotfixUpgradeProperties.GetClusterAvailableUpgradeProperties() *ClusterAvailableUpgradeProperties`
    info	[Changelog] - New function `*ClusterAvailableUpgradeProperties.GetClusterAvailableUpgradeProperties() *ClusterAvailableUpgradeProperties`
    info	[Changelog] - New function `NewClusterAvailableUpgradesClient(string, azcore.TokenCredential, *arm.ClientOptions) (*ClusterAvailableUpgradesClient, error)`
    info	[Changelog] - New function `*ClusterAvailableUpgradesClient.NewListPager(string, string, string, *ClusterAvailableUpgradesClientListOptions) *runtime.Pager[ClusterAvailableUpgradesClientListResponse]`
    info	[Changelog] - New function `*ClusterHotfixUpgradeProperties.GetClusterUpgradeProperties() *ClusterUpgradeProperties`
    info	[Changelog] - New function `*ClusterPoolAKSPatchVersionUpgradeProperties.GetClusterPoolUpgradeProperties() *ClusterPoolUpgradeProperties`
    info	[Changelog] - New function `*ClusterPoolAvailableUpgradeAksPatchUpgradeProperties.GetClusterPoolAvailableUpgradeProperties() *ClusterPoolAvailableUpgradeProperties`
    info	[Changelog] - New function `*ClusterPoolAvailableUpgradeNodeOsUpgradeProperties.GetClusterPoolAvailableUpgradeProperties() *ClusterPoolAvailableUpgradeProperties`
    info	[Changelog] - New function `*ClusterPoolAvailableUpgradeProperties.GetClusterPoolAvailableUpgradeProperties() *ClusterPoolAvailableUpgradeProperties`
    info	[Changelog] - New function `NewClusterPoolAvailableUpgradesClient(string, azcore.TokenCredential, *arm.ClientOptions) (*ClusterPoolAvailableUpgradesClient, error)`
    info	[Changelog] - New function `*ClusterPoolAvailableUpgradesClient.NewListPager(string, string, *ClusterPoolAvailableUpgradesClientListOptions) *runtime.Pager[ClusterPoolAvailableUpgradesClientListResponse]`
    info	[Changelog] - New function `*ClusterPoolNodeOsImageUpdateProperties.GetClusterPoolUpgradeProperties() *ClusterPoolUpgradeProperties`
    info	[Changelog] - New function `*ClusterPoolUpgradeProperties.GetClusterPoolUpgradeProperties() *ClusterPoolUpgradeProperties`
    info	[Changelog] - New function `*ClusterPoolsClient.BeginUpgrade(context.Context, string, string, ClusterPoolUpgrade, *ClusterPoolsClientBeginUpgradeOptions) (*runtime.Poller[ClusterPoolsClientUpgradeResponse], error)`
    info	[Changelog] - New function `*ClusterUpgradeProperties.GetClusterUpgradeProperties() *ClusterUpgradeProperties`
    info	[Changelog] - New function `*ClustersClient.BeginUpgrade(context.Context, string, string, string, ClusterUpgrade, *ClustersClientBeginUpgradeOptions) (*runtime.Poller[ClustersClientUpgradeResponse], error)`
    info	[Changelog] - New struct `ClusterAKSPatchVersionUpgradeProperties`
    info	[Changelog] - New struct `ClusterAccessProfile`
    info	[Changelog] - New struct `ClusterAvailableUpgrade`
    info	[Changelog] - New struct `ClusterAvailableUpgradeAksPatchUpgradeProperties`
    info	[Changelog] - New struct `ClusterAvailableUpgradeHotfixUpgradeProperties`
    info	[Changelog] - New struct `ClusterAvailableUpgradeList`
    info	[Changelog] - New struct `ClusterHotfixUpgradeProperties`
    info	[Changelog] - New struct `ClusterPoolAKSPatchVersionUpgradeProperties`
    info	[Changelog] - New struct `ClusterPoolAvailableUpgrade`
    info	[Changelog] - New struct `ClusterPoolAvailableUpgradeAksPatchUpgradeProperties`
    info	[Changelog] - New struct `ClusterPoolAvailableUpgradeList`
    info	[Changelog] - New struct `ClusterPoolAvailableUpgradeNodeOsUpgradeProperties`
    info	[Changelog] - New struct `ClusterPoolNodeOsImageUpdateProperties`
    info	[Changelog] - New struct `ClusterPoolUpgrade`
    info	[Changelog] - New struct `ClusterRangerPluginProfile`
    info	[Changelog] - New struct `ClusterUpgrade`
    info	[Changelog] - New struct `DiskStorageProfile`
    info	[Changelog] - New struct `FlinkJobProfile`
    info	[Changelog] - New struct `KafkaConnectivityEndpoints`
    info	[Changelog] - New struct `KafkaProfile`
    info	[Changelog] - New struct `RangerAdminSpec`
    info	[Changelog] - New struct `RangerAdminSpecDatabase`
    info	[Changelog] - New struct `RangerAuditSpec`
    info	[Changelog] - New struct `RangerProfile`
    info	[Changelog] - New struct `RangerUsersyncSpec`
    info	[Changelog] - New field `Filter` in struct `ClusterJobsClientListOptions`
    info	[Changelog] - New field `APIServerAuthorizedIPRanges`, `EnablePrivateAPIServer`, `OutboundType` in struct `ClusterPoolResourcePropertiesNetworkProfile`
    info	[Changelog] - New field `ClusterAccessProfile`, `RangerPluginProfile`, `RangerProfile` in struct `ClusterProfile`
    info	[Changelog] - New field `PrivateFqdn` in struct `ConnectivityProfileWeb`
    info	[Changelog] - New field `MetastoreDbConnectionAuthenticationMode` in struct `FlinkHiveCatalogOption`
    info	[Changelog] - New field `RunID` in struct `FlinkJobProperties`
    info	[Changelog] - New field `DeploymentMode`, `JobSpec` in struct `FlinkProfile`
    info	[Changelog] - New field `MetastoreDbConnectionAuthenticationMode` in struct `HiveCatalogOption`
    info	[Changelog] - New field `PrivateSSHEndpoint` in struct `SSHConnectivityEndpoint`
    info	[Changelog] - New field `DbConnectionAuthenticationMode` in struct `SparkMetastoreSpec`
    info	[Changelog] - New field `RangerPluginProfile`, `RangerProfile` in struct `UpdatableClusterProfile`
    info	[Changelog]
    info	[Changelog] Total 2 breaking change(s), 136 additive change(s).
️⚠️ azure-sdk-for-java warning [Detail]
  • ⚠️Warning [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. SDK Automation 14.0.0
    command	./eng/mgmt/automation/init.sh ../azure-sdk-for-java_tmp/initInput.json ../azure-sdk-for-java_tmp/initOutput.json
    cmderr	[init.sh] [notice] A new release of pip is available: 23.0.1 -> 23.3.2
    cmderr	[init.sh] [notice] To update, run: pip install --upgrade pip
    cmderr	[init.sh] [notice] A new release of pip is available: 23.0.1 -> 23.3.2
    cmderr	[init.sh] [notice] To update, run: pip install --upgrade pip
    cmderr	[init.sh] d  Average Speed   Time    Time     Time  Current
    cmderr	[init.sh]                                  Dload  Upload   Total   Spent    Left  Speed
    cmderr	[init.sh] 
      0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0  187k
    cmderr	[init.sh] Downloading https://nodejs.org/dist/v18.15.0/node-v18.15.0-linux-x64.tar.xz...
    cmderr	[init.sh] Computing checksum with sha256sum
    cmderr	[init.sh] Checksums matched!
    command	./eng/mgmt/automation/generate.py ../azure-sdk-for-java_tmp/generateInput.json ../azure-sdk-for-java_tmp/generateOutput.json
  • ️✔️azure-resourcemanager-hdinsight-containers [View full logs]  [Preview SDK Changes]
️⚠️ azure-sdk-for-python-track2 warning [Detail]
  • ⚠️Warning [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. SDK Automation 14.0.0
    command	sh scripts/automation_init.sh ../azure-sdk-for-python_tmp/initInput.json ../azure-sdk-for-python_tmp/initOutput.json
    cmderr	[automation_init.sh] WARNING: azure-devtools 1.2.1 does not provide the extra 'ci-tools'
    cmderr	[automation_init.sh] WARNING: azure-devtools 1.2.1 does not provide the extra 'ci-tools'
    cmderr	[automation_init.sh] WARNING: Skipping azure-nspkg as it is not installed.
    command	sh scripts/automation_generate.sh ../azure-sdk-for-python_tmp/generateInput.json ../azure-sdk-for-python_tmp/generateOutput.json
  • ️✔️track2_azure-mgmt-hdinsightcontainers [View full logs]  [Preview SDK Changes] Breaking Change Detected
    info	[Changelog] ### Features Added
    info	[Changelog]
    info	[Changelog]   - Added operation ClusterPoolsOperations.begin_upgrade
    info	[Changelog]   - Added operation ClustersOperations.begin_upgrade
    info	[Changelog]   - Added operation group ClusterAvailableUpgradesOperations
    info	[Changelog]   - Added operation group ClusterPoolAvailableUpgradesOperations
    info	[Changelog]   - Model ClusterPoolNetworkProfile has a new parameter api_server_authorized_ip_ranges
    info	[Changelog]   - Model ClusterPoolNetworkProfile has a new parameter enable_private_api_server
    info	[Changelog]   - Model ClusterPoolNetworkProfile has a new parameter outbound_type
    info	[Changelog]   - Model ClusterPoolResourcePropertiesNetworkProfile has a new parameter api_server_authorized_ip_ranges
    info	[Changelog]   - Model ClusterPoolResourcePropertiesNetworkProfile has a new parameter enable_private_api_server
    info	[Changelog]   - Model ClusterPoolResourcePropertiesNetworkProfile has a new parameter outbound_type
    info	[Changelog]   - Model ClusterProfile has a new parameter cluster_access_profile
    info	[Changelog]   - Model ClusterProfile has a new parameter ranger_plugin_profile
    info	[Changelog]   - Model ClusterProfile has a new parameter ranger_profile
    info	[Changelog]   - Model ConnectivityProfileWeb has a new parameter private_fqdn
    info	[Changelog]   - Model FlinkHiveCatalogOption has a new parameter metastore_db_connection_authentication_mode
    info	[Changelog]   - Model FlinkJobProperties has a new parameter run_id
    info	[Changelog]   - Model FlinkProfile has a new parameter deployment_mode
    info	[Changelog]   - Model FlinkProfile has a new parameter job_spec
    info	[Changelog]   - Model HiveCatalogOption has a new parameter metastore_db_connection_authentication_mode
    info	[Changelog]   - Model SparkMetastoreSpec has a new parameter db_connection_authentication_mode
    info	[Changelog]   - Model SshConnectivityEndpoint has a new parameter private_ssh_endpoint
    info	[Changelog]   - Model UpdatableClusterProfile has a new parameter ranger_plugin_profile
    info	[Changelog]   - Model UpdatableClusterProfile has a new parameter ranger_profile
    info	[Changelog]   - Model WebConnectivityEndpoint has a new parameter private_fqdn
    info	[Changelog]   - Operation ClusterJobsOperations.list has a new optional parameter filter
    info	[Changelog]
    info	[Changelog] ### Breaking Changes
    info	[Changelog]
    info	[Changelog]   - Model ClusterPatch no longer has parameter id
    info	[Changelog]   - Model ClusterPatch no longer has parameter location
    info	[Changelog]   - Model ClusterPatch no longer has parameter name
    info	[Changelog]   - Model ClusterPatch no longer has parameter system_data
    info	[Changelog]   - Model ClusterPatch no longer has parameter type
️️✔️ azure-sdk-for-js succeeded [Detail] [Expand]
  • ️✔️Succeeded [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. SDK Automation 14.0.0
    command	sh .scripts/automation_init.sh ../azure-sdk-for-js_tmp/initInput.json ../azure-sdk-for-js_tmp/initOutput.json
    warn	File azure-sdk-for-js_tmp/initOutput.json not found to read
    command	sh .scripts/automation_generate.sh ../azure-sdk-for-js_tmp/generateInput.json ../azure-sdk-for-js_tmp/generateOutput.json
  • ️✔️@azure/arm-hdinsightcontainers [View full logs]  [Preview SDK Changes] Breaking Change Detected
    info	[Changelog] **Features**
    info	[Changelog]
    info	[Changelog]   - Added operation group ClusterAvailableUpgrades
    info	[Changelog]   - Added operation group ClusterPoolAvailableUpgrades
    info	[Changelog]   - Added operation ClusterPools.beginUpgrade
    info	[Changelog]   - Added operation ClusterPools.beginUpgradeAndWait
    info	[Changelog]   - Added operation Clusters.beginUpgrade
    info	[Changelog]   - Added operation Clusters.beginUpgradeAndWait
    info	[Changelog]   - Added Interface ClusterAccessProfile
    info	[Changelog]   - Added Interface ClusterAKSPatchVersionUpgradeProperties
    info	[Changelog]   - Added Interface ClusterAvailableUpgrade
    info	[Changelog]   - Added Interface ClusterAvailableUpgradeAksPatchUpgradeProperties
    info	[Changelog]   - Added Interface ClusterAvailableUpgradeHotfixUpgradeProperties
    info	[Changelog]   - Added Interface ClusterAvailableUpgradeList
    info	[Changelog]   - Added Interface ClusterAvailableUpgradeProperties
    info	[Changelog]   - Added Interface ClusterAvailableUpgradesListNextOptionalParams
    info	[Changelog]   - Added Interface ClusterAvailableUpgradesListOptionalParams
    info	[Changelog]   - Added Interface ClusterHotfixUpgradeProperties
    info	[Changelog]   - Added Interface ClusterPoolAKSPatchVersionUpgradeProperties
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgrade
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgradeAksPatchUpgradeProperties
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgradeList
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgradeNodeOsUpgradeProperties
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgradeProperties
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgradesListNextOptionalParams
    info	[Changelog]   - Added Interface ClusterPoolAvailableUpgradesListOptionalParams
    info	[Changelog]   - Added Interface ClusterPoolNodeOsImageUpdateProperties
    info	[Changelog]   - Added Interface ClusterPoolsUpgradeHeaders
    info	[Changelog]   - Added Interface ClusterPoolsUpgradeOptionalParams
    info	[Changelog]   - Added Interface ClusterPoolUpgrade
    info	[Changelog]   - Added Interface ClusterPoolUpgradeProperties
    info	[Changelog]   - Added Interface ClusterRangerPluginProfile
    info	[Changelog]   - Added Interface ClustersUpgradeHeaders
    info	[Changelog]   - Added Interface ClustersUpgradeOptionalParams
    info	[Changelog]   - Added Interface ClusterUpgrade
    info	[Changelog]   - Added Interface ClusterUpgradeProperties
    info	[Changelog]   - Added Interface DiskStorageProfile
    info	[Changelog]   - Added Interface FlinkJobProfile
    info	[Changelog]   - Added Interface KafkaConnectivityEndpoints
    info	[Changelog]   - Added Interface KafkaProfile
    info	[Changelog]   - Added Interface RangerAdminSpec
    info	[Changelog]   - Added Interface RangerAdminSpecDatabase
    info	[Changelog]   - Added Interface RangerAuditSpec
    info	[Changelog]   - Added Interface RangerProfile
    info	[Changelog]   - Added Interface RangerUsersyncSpec
    info	[Changelog]   - Added Type Alias ClusterAvailableUpgradePropertiesUnion
    info	[Changelog]   - Added Type Alias ClusterAvailableUpgradesListNextResponse
    info	[Changelog]   - Added Type Alias ClusterAvailableUpgradesListResponse
    info	[Changelog]   - Added Type Alias ClusterAvailableUpgradeType
    info	[Changelog]   - Added Type Alias ClusterPoolAvailableUpgradePropertiesUnion
    info	[Changelog]   - Added Type Alias ClusterPoolAvailableUpgradesListNextResponse
    info	[Changelog]   - Added Type Alias ClusterPoolAvailableUpgradesListResponse
    info	[Changelog]   - Added Type Alias ClusterPoolAvailableUpgradeType
    info	[Changelog]   - Added Type Alias ClusterPoolsDeleteResponse
    info	[Changelog]   - Added Type Alias ClusterPoolsUpgradeResponse
    info	[Changelog]   - Added Type Alias ClusterPoolUpgradePropertiesUnion
    info	[Changelog]   - Added Type Alias ClusterPoolUpgradeType
    info	[Changelog]   - Added Type Alias ClustersDeleteResponse
    info	[Changelog]   - Added Type Alias ClustersUpgradeResponse
    info	[Changelog]   - Added Type Alias ClusterUpgradePropertiesUnion
    info	[Changelog]   - Added Type Alias ClusterUpgradeType
    info	[Changelog]   - Added Type Alias CurrentClusterAksVersionStatus
    info	[Changelog]   - Added Type Alias CurrentClusterPoolAksVersionStatus
    info	[Changelog]   - Added Type Alias DataDiskType
    info	[Changelog]   - Added Type Alias DbConnectionAuthenticationMode
    info	[Changelog]   - Added Type Alias DeploymentMode
    info	[Changelog]   - Added Type Alias MetastoreDbConnectionAuthenticationMode
    info	[Changelog]   - Added Type Alias OutboundType
    info	[Changelog]   - Added Type Alias RangerUsersyncMode
    info	[Changelog]   - Added Type Alias Severity
    info	[Changelog]   - Added Type Alias UpgradeMode
    info	[Changelog]   - Interface ClusterJobsListOptionalParams has a new optional parameter filter
    info	[Changelog]   - Interface ClusterPatch has a new optional parameter tags
    info	[Changelog]   - Interface ClusterPoolNetworkProfile has a new optional parameter apiServerAuthorizedIpRanges
    info	[Changelog]   - Interface ClusterPoolNetworkProfile has a new optional parameter enablePrivateApiServer
    info	[Changelog]   - Interface ClusterPoolNetworkProfile has a new optional parameter outboundType
    info	[Changelog]   - Interface ClusterProfile has a new optional parameter clusterAccessProfile
    info	[Changelog]   - Interface ClusterProfile has a new optional parameter rangerPluginProfile
    info	[Changelog]   - Interface ClusterProfile has a new optional parameter rangerProfile
    info	[Changelog]   - Interface FlinkHiveCatalogOption has a new optional parameter metastoreDbConnectionAuthenticationMode
    info	[Changelog]   - Interface FlinkJobProperties has a new optional parameter runId
    info	[Changelog]   - Interface FlinkProfile has a new optional parameter deploymentMode
    info	[Changelog]   - Interface FlinkProfile has a new optional parameter jobSpec
    info	[Changelog]   - Interface HiveCatalogOption has a new optional parameter metastoreDbConnectionAuthenticationMode
    info	[Changelog]   - Interface SparkMetastoreSpec has a new optional parameter dbConnectionAuthenticationMode
    info	[Changelog]   - Interface SshConnectivityEndpoint has a new optional parameter privateSshEndpoint
    info	[Changelog]   - Interface UpdatableClusterProfile has a new optional parameter rangerPluginProfile
    info	[Changelog]   - Interface UpdatableClusterProfile has a new optional parameter rangerProfile
    info	[Changelog]   - Interface WebConnectivityEndpoint has a new optional parameter privateFqdn
    info	[Changelog]   - Added Enum KnownClusterAvailableUpgradeType
    info	[Changelog]   - Added Enum KnownClusterPoolAvailableUpgradeType
    info	[Changelog]   - Added Enum KnownClusterPoolUpgradeType
    info	[Changelog]   - Added Enum KnownClusterUpgradeType
    info	[Changelog]   - Added Enum KnownCurrentClusterAksVersionStatus
    info	[Changelog]   - Added Enum KnownCurrentClusterPoolAksVersionStatus
    info	[Changelog]   - Added Enum KnownDataDiskType
    info	[Changelog]   - Added Enum KnownDbConnectionAuthenticationMode
    info	[Changelog]   - Added Enum KnownDeploymentMode
    info	[Changelog]   - Added Enum KnownMetastoreDbConnectionAuthenticationMode
    info	[Changelog]   - Added Enum KnownOutboundType
    info	[Changelog]   - Added Enum KnownRangerUsersyncMode
    info	[Changelog]   - Added Enum KnownSeverity
    info	[Changelog]   - Added Enum KnownUpgradeMode
    info	[Changelog]   - Enum KnownAction has a new value LastStateUpdate
    info	[Changelog]   - Enum KnownAction has a new value RELaunch
    info	[Changelog]
    info	[Changelog] **Breaking Changes**
    info	[Changelog]
    info	[Changelog]   - Type of parameter kafkaProfile of interface ClusterProfile is changed from {
    info	[Changelog]         [propertyName: string]: any;
    info	[Changelog]     } to KafkaProfile
️❌ azure-resource-manager-schemas failed [Detail]
  • Pipeline Framework Failed [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. Schema Automation 14.0.0
    command	.sdkauto/initScript.sh ../azure-resource-manager-schemas_tmp/initInput.json ../azure-resource-manager-schemas_tmp/initOutput.json
    cmderr	[initScript.sh] npm notice
    cmderr	[initScript.sh] npm notice New minor version of npm available! 10.2.3 -> 10.4.0
    cmderr	[initScript.sh] npm notice Changelog: <https://github.com/npm/cli/releases/tag/v10.4.0>
    cmderr	[initScript.sh] npm notice Run `npm install -g [email protected]` to update!
    cmderr	[initScript.sh] npm notice
    warn	File azure-resource-manager-schemas_tmp/initOutput.json not found to read
    command	.sdkauto/generateScript.sh ../azure-resource-manager-schemas_tmp/generateInput.json ../azure-resource-manager-schemas_tmp/generateOutput.json
    fatal: cannot force update the branch 'sdkAuto/27306/hdinsight' used by worktree at '/mnt/vss/_work/1/s/azure-resource-manager-schemas'
  • ️✔️hdinsight [View full logs]  [Preview Schema Changes]
  • ️✔️hdinsight [View full logs
    error	Fatal error: fatal: cannot force update the branch 'sdkAuto/27306/hdinsight' used by worktree at '/mnt/vss/_work/1/s/azure-resource-manager-schemas'
    error	Fatal error: Error: fatal: cannot force update the branch 'sdkAuto/27306/hdinsight' used by worktree at '/mnt/vss/_work/1/s/azure-resource-manager-schemas'    at Object.action (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1274:25)    at PluginStore.exec (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1309:29)    at /mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1674:43    at new Promise (<anonymous>)    at GitExecutorChain.handleTaskData (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1672:16)    at GitExecutorChain.<anonymous> (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:1656:44)    at Generator.next (<anonymous>)    at fulfilled (/mnt/vss/_work/1/a/unified-pipeline-runtime/common/temp/node_modules/.pnpm/[email protected]/node_modules/simple-git/dist/cjs/index.js:55:24)    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    error	The following packages are still pending:
    error		hdinsight
    error		hdinsight
️⚠️ azure-powershell warning [Detail]
  • ⚠️Warning [Logs] Generate from e847bf1bd278acab5a8efd37f6be3d6a1e943b0a. SDK Automation 14.0.0
    command	sh ./tools/SwaggerCI/init.sh ../azure-powershell_tmp/initInput.json ../azure-powershell_tmp/initOutput.json
    command	pwsh ./tools/SwaggerCI/psci.ps1 ../azure-powershell_tmp/generateInput.json ../azure-powershell_tmp/generateOutput.json
  • ⚠️Az.hdinsight.DefaultTag [View full logs]  [Preview SDK Changes]
  • ⚠️Az.HdInsightOnAks.Autorest [View full logs]  [Preview SDK Changes]
Posted by Swagger Pipeline | How to fix these errors?

Generated ApiView

Language Package Name ApiView Link
Go sdk/resourcemanager/hdinsightcontainers/armhdinsightcontainers https://apiview.dev/Assemblies/Review/56c01c4c38904f6a9ca2d06afd38091a?revisionId=2d3a1c4bf2a54ec5a8553ac8a3aad945
Java azure-resourcemanager-hdinsight-containers Create ApiView timeout. Package is too large and we cannot create ApiView for it.
JavaScript @azure/arm-hdinsightcontainers https://apiview.dev/Assemblies/Review/8b1ae08f10954394bbd5d5550b4fad70?revisionId=870838d0cd2c4b5bacfd3a7cab552c56
Swagger Microsoft.HDInsight https://apiview.dev/Assemblies/Review/1b6d98d324fa4eafa44ce2a4c8f25ec2?revisionId=41a76316f0ad48509cd4ca94d3c53e33

Hi @dw511214992! For review efficiency consideration, when creating a new API version, it is required to place API specs of the base version in the first commit, and push new version updates into successive commits. You can use OpenAPIHub to initialize the PR for adding a new version.
For more details refer to the wiki.

This new apiversion is moved from RPSaaSMaster of private swagger repository. All the changes have been reviewed and approved before. Please help merge it. Thanks

dw511214992 avatar Jan 09 '24 07:01 dw511214992

This new apiversion is moved from RPSaaSMaster of private swagger repository. All the changes have been reviewed and approved before. Please help merge it. Thanks

Couple of things:

  1. Please provide PR link(s) for the previously reviewed APIs. We don't want/need to re-review APIs that were previously reviewed.
  2. Create your PR with a base commit of files from the current API version spec as described in this comment: https://github.com/Azure/azure-rest-api-specs/pull/27306#issuecomment-1882493516. This is needed so we can see what's changing vs. current API.
  3. Fill out the intake form so your PR is properly handled.

mentat9 avatar Jan 11 '24 22:01 mentat9

Please address or respond to feedback from the ARM API reviewer.
When you are ready to continue the ARM API review, please remove the ARMChangesRequested label.
This will notify the reviewer to have another look.
If the feedback provided needs further discussion, please use this Teams channel to post your questions - aka.ms/azsdk/support/specreview-channel.
Please include [ARM Query] in the title of your question to indicate that it is ARM-related.

This new apiversion is moved from RPSaaSMaster of private swagger repository. All the changes have been reviewed and approved before. Please help merge it. Thanks

Couple of things:

  1. Please provide PR link(s) for the previously reviewed APIs. We don't want/need to re-review APIs that were previously reviewed.
  2. Create your PR with a base commit of files from the current API version spec as described in this comment: HDInsight: onboard new apiversion 2023-11-01-preview #27306 (comment). This is needed so we can see what's changing vs. current API.
  3. Fill out the intake form so your PR is properly handled.

Hi @mentat9

  1. Previous approved PR links: 16379, 16346, 16329, 16249, 16201, 16060, 16050, 15942, 15709, 15688, 15468, 16616

  2. Done.

  3. Done.

Have an issue here: It seems the CI checks' results are not updated in the comment. I have tried to rerun it by /azp run, but it doesn't work. Please check it. Thanks Thanks

dw511214992 avatar Jan 15 '24 02:01 dw511214992

/azp run

dw511214992 avatar Jan 15 '24 02:01 dw511214992

Azure Pipelines successfully started running 4 pipeline(s).

azure-pipelines[bot] avatar Jan 15 '24 02:01 azure-pipelines[bot]

/azp run

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

Azure Pipelines successfully started running 4 pipeline(s).

azure-pipelines[bot] avatar Jan 18 '24 20:01 azure-pipelines[bot]

      "description": "ClusterPool is based on AKS cluster. Aks cluster exposes the apiserver to public internet by default. If you set this property to true, a private aks cluster will be created, and it will use private apiserver, which is not exposed to public internet.",

AKS #Resolved


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1368 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "ClusterPool is based on AKS cluster. Aks cluster exposes the apiserver to public internet by default. If you set this property to true, a private aks cluster will be created, and it will use private apiserver, which is not exposed to public internet.",

AKS #Resolved


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1368 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "ClusterPool is based on AKS cluster. Aks cluster exposes the apiserver to public internet by default. If you set this property to true, a private aks cluster will be created, and it will use private apiserver, which is not exposed to public internet.",

API server (use normal capitalization of acronyms in docs) #Resolved


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1368 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

        "type": "string"

consider adding a pattern restriction #Resolved


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1377 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "Private link service resource id. Only when enableInternalIngress is true, this property will be returned."

ID


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1886 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "Whether to create cluster using private IP instead of public IP.",

This property must be set at create time.


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1869 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "type": "boolean",

booleans are discouraged, in favor of enums because they're harder to extend, and sometimes, to understand.


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1868 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "Private ssh connectivity endpoint. This property will only be returned when enableInternalIngress is true.",

SSH #Resolved


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1924 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "This property is required by Trino, Spark and Flink cluster but is optional for Kafka cluster.",

Just wondering, does it matter if you use plugins like Ranger?


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1947 in 0e6106f. [](commit_id = 0e6106f62ebd71051ca56e6b65925698481d3c61, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

    "rangerPluginProfile": {

Why is there both rangerProfile and rangerPluginProfile? Is Ranger only a plugin, or is it an either or choice compared to Kafka/Spark etc?


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:1982 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "Secret reference name from secretsProfile.secrets containing password for database connection.",

Does it require setting metastoreDbConnectionAuthenticationMode?


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2326 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "type": "string"

doc: is this string a keyvault secret URI? Or an actual secret password?


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2327 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "The secret name which contains the database user password."

does it support passing an explicit secret version, or only a name?


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2658 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

    }

You should use this format for URI properties "format": "uri"


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2667 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

    "keyVaultId": {

You should use this format for Azure resource ID properties "format": "arm-id"


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2660 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "The key vault resource id."

Azure resource ID


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2662 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith

      "description": "A string property that indicates the upgrade mode to be performed on the Flink job. It can have one of the following enum values => STATELESS_UPDATE, SAVEPOINT, LAST_STATE_UPDATE.",

if its optional, which is taken as the default?


Refers to: specification/hdinsight/resource-manager/Microsoft.HDInsight/HDInsightOnAks/preview/2023-11-01-preview/hdinsight.json:2749 in f445bb4. [](commit_id = f445bb4ad6904266e12322601e64b64d544dc60d, deletion_comment = False)

TimLovellSmith avatar Jan 18 '24 20:01 TimLovellSmith