azure-powershell icon indicating copy to clipboard operation
azure-powershell copied to clipboard

New-AzVMSS: Flexible orchestration mode fails to create VMSS in EdgeZone

Open viananth opened this issue 2 years ago • 3 comments

Description

EdgeZone now supports Flexible orchestration VMSS. But while using Azure PowerShell to create Flexible orchestration VMSS in EdgeZone, it fails with the following error:

New-AzVmss : Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Mic rosoft.Network/loadBalancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1. At line:1 char:1 New-AzVmss CategoryInfo : CloseError: (:) [New-AzVmss], CloudException FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.NewAzureRmVmss

Basically, LB creation does not carry EdgeZone during Flex VMSS orchestration.

https://github.com/Azure/azure-powershell/blob/404ae3b0f4a1c3501ff452b096d8be6ef978af73/src/Compute/Compute/Manual/VirtualMachineScaleSetCreateOrUpdateMethod.cs#L466

The following line should include EdgeZone: var loadBalancer = resourceGroup.CreateLoadBalancerConfig( name: _cmdlet.LoadBalancerName, //sku.Basic is not compatible with multiple placement groups sku: (noZones && _cmdlet.SinglePlacementGroup.IsPresent) ? LoadBalancerStrategy.Sku.Basic : LoadBalancerStrategy.Sku.Standard);

Issue script & Debug output

PS C:\Users\viananth> New-AzVmss `
>>    -ResourceGroupName $rg `
>>    -Location "EastUS2euap" `
>>    -VMScaleSetName "myScaleSet" `
>>    -VirtualNetworkName "myVnet" `
>>    -SubnetName "mySubnet" `
>>    -PublicIpAddressName "myPublicIPAddress" `
>>    -LoadBalancerName "MyLoadBalancer" `
>>    -InstanceCount 2 `
>>    -EdgeZone "microsoftrrdclab1" `
>>    -VmSize "Standard_D2_v2" `
>>    -AllocationMethod Dynamic `
>>    -Credential $creds `
>>    -OrchestrationMode Flexible -debug
>>
VERBOSE: VMScaleSetName = "myScaleSet"                                                                                  VERBOSE: UserData = $null                                                                                               VERBOSE: ImageName = "Win2016Datacenter"                                                                                VERBOSE: Credential = System.Management.Automation.PSCredential                                                         VERBOSE: InstanceCount = 2                                                                                              VERBOSE: VirtualNetworkName = "myVnet"                                                                                  VERBOSE: SubnetName = "mySubnet"                                                                                        VERBOSE: PublicIpAddressName = "myPublicIPAddress"                                                                      VERBOSE: DomainNameLabel = "myscaleset-d80dd8"                                                                          VERBOSE: SecurityGroupName = "myScaleSet"                                                                               VERBOSE: LoadBalancerName = "MyLoadBalancer"                                                                            VERBOSE: BackendPort = 80                                                                                               VERBOSE: Location = "EastUS2euap"                                                                                       VERBOSE: VmSize = "Standard_D2_v2"                                                                                      VERBOSE: UpgradePolicyMode = Automatic                                                                                  VERBOSE: AllocationMethod = "Dynamic"                                                                                   VERBOSE: VnetAddressPrefix = "192.168.0.0/16"                                                                           VERBOSE: SubnetAddressPrefix = "192.168.1.0/24"                                                                         VERBOSE: FrontendPoolName = "myScaleSet"                                                                                VERBOSE: BackendPoolName = "myScaleSet"                                                                                 VERBOSE: SystemAssignedIdentity = False                                                                                 VERBOSE: UserAssignedIdentity = $null
VERBOSE: EnableUltraSSD = False
VERBOSE: Zone = $null
VERBOSE: NatBackendPort = 3389,5985
VERBOSE: DataDiskSizeInGb = $null                                                                                       VERBOSE: ProximityPlacementGroupId = $null                                                                              VERBOSE: HostGroupId = $null                                                                                            VERBOSE: Priority = $null                                                                                               VERBOSE: EvictionPolicy = $null                                                                                         VERBOSE: MaxPrice = 0                                                                                                   VERBOSE: ScaleInPolicy = $null                                                                                          VERBOSE: SkipExtensionsOnOverprovisionedVMs = False                                                                     VERBOSE: EncryptionAtHost = False                                                                                       VERBOSE: PlatformFaultDomainCount = 0                                                                                   VERBOSE: OrchestrationMode = "Flexible"                                                                                 VERBOSE: CapacityReservationGroupId = $null                                                                                                                                                                                                                                                                                             DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide rs/Microsoft.Compute/images/Win2016Datacenter?api-version=2021-07-01                                                                                                                                                                            Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                   DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            NotFound                                                                                                                
Headers:
Pragma                        : no-cache
x-ms-failure-cause            : gateway
x-ms-request-id               : fe22bdec-e626-45d7-b929-e7afd77d9117                                                    x-ms-correlation-request-id   : fe22bdec-e626-45d7-b929-e7afd77d9117                                                    x-ms-routing-request-id       : WESTUS:20220713T173655Z:fe22bdec-e626-45d7-b929-e7afd77d9117                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:55 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "error": {                                                                                                                "code": "ResourceNotFound",                                                                                             "message": "The Resource 'Microsoft.Compute/images/Win2016Datacenter' under resource group 'viananth-testrr2' was   not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"                                           }                                                                                                                                                                                                    DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/providers/Microsoft.Network/locations/E astUS2euap/CheckDnsNameAvailability?domainNameLabel=myscaleset-d80dd8&api-version=2020-11-01                                                                                                                                                    Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                   DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:
OK

Headers:
Pragma                        : no-cache                                                                                x-ms-request-id               : a29599d0-bac5-4b34-b286-272214abe646                                                    x-ms-correlation-request-id   : 766828e3-0af8-4c66-b2b1-71c99f84cea7                                                    x-ms-arm-service-request-id   : 8745c4c4-3a12-4872-be16-bbfa7bff9272                                                    Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     Cache-Control                 : no-cache                                                                                Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0                                             x-ms-ratelimit-remaining-subscription-reads: 11998                                                                      x-ms-routing-request-id       : WESTUS:20220713T173656Z:766828e3-0af8-4c66-b2b1-71c99f84cea7                            X-Content-Type-Options        : nosniff                                                                                 Date                          : Wed, 13 Jul 2022 17:36:55 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "available": true                                                                                                     }                                                                                                                                                                                                                                                                                                                    DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide rs/Microsoft.Compute/virtualMachineScaleSets/myScaleSet?api-version=2021-03-01                                                                                                                                                                  Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                   DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            NotFound                                                                                                                
Headers:
Pragma                        : no-cache
x-ms-failure-cause            : gateway
x-ms-request-id               : 8e518f8b-3862-4552-94bd-a45cac4ea5d2                                                    x-ms-correlation-request-id   : 8e518f8b-3862-4552-94bd-a45cac4ea5d2                                                    x-ms-routing-request-id       : WESTUS:20220713T173657Z:8e518f8b-3862-4552-94bd-a45cac4ea5d2                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:56 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "error": {                                                                                                                "code": "ResourceNotFound",                                                                                             "message": "The Resource 'Microsoft.Compute/virtualMachineScaleSets/myScaleSet' under resource group                'viananth-testrr2' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"                    }                                                                                                                     }                                                                                                                                                                                                                                                                                                                            DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourcegroups/viananth-testrr2?api-ver sion=2016-09-01                                                                                                                                                                                                                                 Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                                                                                                          DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide rs/Microsoft.Network/loadBalancers/MyLoadBalancer?api-version=2020-11-01                                                                                                                                                                        Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US

Body:


                                                                           DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:
OK

Headers:
Pragma                        : no-cache
x-ms-ratelimit-remaining-subscription-reads: 11998
x-ms-request-id               : 33f2aa41-fe93-4482-8641-f5499f645397
x-ms-correlation-request-id   : 33f2aa41-fe93-4482-8641-f5499f645397
x-ms-routing-request-id       : WESTUS:20220713T173657Z:33f2aa41-fe93-4482-8641-f5499f645397                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:56 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "id": "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2",
  "name": "viananth-testrr2",
  "location": "eastus2euap",
  "properties": {
    "provisioningState": "Succeeded"
  }
}


DEBUG: ============================ HTTP REQUEST ============================

HTTP Method:
GET

Absolute Uri:
https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide
rs/Microsoft.Network/virtualNetworks/myVnet?api-version=2020-11-01

Headers:
x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30
accept-language               : en-US

Body:


DEBUG: ============================ HTTP RESPONSE ============================

Status Code:
OK

Headers:
Pragma                        : no-cache
x-ms-request-id               : 2856f43c-d732-45f4-af18-cb5ae4b7fe55
x-ms-correlation-request-id   : bf472f95-1d16-4d0d-8c58-86b77ce44920
x-ms-arm-service-request-id   : efd62bad-0a33-4fc4-a68a-01424d487bca
Strict-Transport-Security     : max-age=31536000; includeSubDomains
Cache-Control                 : no-cache
ETag                          : W/"edbbc4ec-cf23-4377-ac01-09976255f100"
Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
x-ms-ratelimit-remaining-subscription-reads: 11999
x-ms-routing-request-id       : WESTUS:20220713T173657Z:bf472f95-1d16-4d0d-8c58-86b77ce44920
X-Content-Type-Options        : nosniff
Date                          : Wed, 13 Jul 2022 17:36:56 GMT

Body:                                                                                                                   {                                                                                                                         "name": "myVnet",                                                                                                       "id":                                                                                                                 "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/virtua lNetworks/myVnet",                                                                                                        "etag": "W/\"edbbc4ec-cf23-4377-ac01-09976255f100\"",                                                                   "type": "Microsoft.Network/virtualNetworks",                                                                            "location": "eastus2euap",
  "extendedLocation": {
    "type": "EdgeZone",
    "name": "microsoftrrdclab1"
  },
  "properties": {
    "provisioningState": "Succeeded",
    "resourceGuid": "5439646e-8809-48fa-9dfe-f20baf12d55f",
    "addressSpace": {
      "addressPrefixes": [
        "192.168.0.0/16"
      ]
    },
    "subnets": [
      {
        "name": "mySubnet",
        "id":
"/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/virtua lNetworks/myVnet/subnets/mySubnet",                                                                                             "etag": "W/\"edbbc4ec-cf23-4377-ac01-09976255f100\"",                                                                   "properties": {                                                                                                           "provisioningState": "Succeeded",                                                                                       "addressPrefix": "192.168.1.0/24",                                                                                      "networkSecurityGroup": {                                                                                                 "id":                                                                                                       "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/networ kSecurityGroups/NRMS-gctysxtutypdimyVnet"                                                                                         },                                                                                                                      "delegations": [],                                                                                                      "privateEndpointNetworkPolicies": "Disabled",                                                                           "privateLinkServiceNetworkPolicies": "Enabled"                                                                        },                                                                                                                      "type": "Microsoft.Network/virtualNetworks/subnets"                                                                   }                                                                                                                     ],                                                                                                                      "virtualNetworkPeerings": [],                                                                                           "enableDdosProtection": false                                                                                         }                                                                                                                     }                                                                                                                                                                                                                                               DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            NotFound                                                                                                                
Headers:
Pragma                        : no-cache
x-ms-failure-cause            : gateway
x-ms-request-id               : bdbd44f2-d2c7-4fcb-89b6-d151d6b15dd8                                                    x-ms-correlation-request-id   : bdbd44f2-d2c7-4fcb-89b6-d151d6b15dd8                                                    x-ms-routing-request-id       : WESTUS:20220713T173658Z:bdbd44f2-d2c7-4fcb-89b6-d151d6b15dd8                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:57 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "error": {                                                                                                                "code": "ResourceNotFound",                                                                                             "message": "The Resource 'Microsoft.Network/loadBalancers/MyLoadBalancer' under resource group 'viananth-testrr2'   was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"                                       }                                                                                                                     }                                                                                                                                                                                                                                               
DEBUG: ============================ HTTP REQUEST ============================

HTTP Method:
GET

Absolute Uri:
https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide
rs/Microsoft.Network/publicIPAddresses/myPublicIPAddress?api-version=2020-11-01

Headers:
x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30
accept-language               : en-US

Body:

                                                                                                                        DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            OK                                                                                                                                                                                                                                              Headers:                                                                                                                Pragma                        : no-cache                                                                                x-ms-request-id               : 051526f4-5643-473b-abb4-854ce6afe918                                                    x-ms-correlation-request-id   : 19785e14-ed9f-4cd9-863c-48e1705982aa                                                    x-ms-arm-service-request-id   : bc08397f-8a7b-4671-8582-845dffd42dc4                                                    Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     Cache-Control                 : no-cache                                                                                ETag                          : W/"76b1064f-44a8-4bb2-a78c-60676b4c638c"                                                Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0                                             x-ms-ratelimit-remaining-subscription-reads: 11999                                                                      x-ms-routing-request-id       : WESTUS:20220713T173658Z:19785e14-ed9f-4cd9-863c-48e1705982aa                            X-Content-Type-Options        : nosniff                                                                                 Date                          : Wed, 13 Jul 2022 17:36:58 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "name": "myPublicIPAddress",                                                                                            "id":                                                                                                                 "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/public IPAddresses/myPublicIPAddress",                                                                                           "etag": "W/\"76b1064f-44a8-4bb2-a78c-60676b4c638c\"",                                                                   "location": "eastus2euap",
  "extendedLocation": {
    "type": "EdgeZone",
    "name": "microsoftrrdclab1"
  },                                                                                                                      "properties": {                                                                                                           "provisioningState": "Succeeded",                                                                                       "resourceGuid": "fa2aa363-11c0-49af-ab42-d4be69d4332a",                                                                 "ipAddress": "198.180.97.213",                                                                                          "publicIPAddressVersion": "IPv4",                                                                                       "publicIPAllocationMethod": "Static",                                                                                   "idleTimeoutInMinutes": 4,                                                                                              "ipTags": []                                                                                                          },                                                                                                                      "type": "Microsoft.Network/publicIPAddresses",                                                                          "sku": {                                                                                                                  "name": "Standard",                                                                                                     "tier": "Regional"                                                                                                    }                                                                                                                     }                                                                                                                                                                                                                                               
DEBUG: ============================ HTTP REQUEST ============================

HTTP Method:
PUT

Absolute Uri:
https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide
rs/Microsoft.Network/loadBalancers/MyLoadBalancer?api-version=2020-11-01

Headers:
x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30
accept-language               : en-US
                                                                                                                        Body:                                                                                                                   {                                                                                                                         "sku": {                                                                                                                  "name": "Standard"                                                                                                    },                                                                                                                      "properties": {                                                                                                           "frontendIPConfigurations": [                                                                                             {
        "properties": {
          "publicIPAddress": {
            "id":
"/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/public
IPAddresses/myPublicIPAddress"
          }
        },
        "name": "myScaleSet"
      }
    ],
    "backendAddressPools": [
      {
        "name": "myScaleSet"
      }
    ],
    "loadBalancingRules": [
      {
        "properties": {
          "frontendIPConfiguration": {
            "id":
"/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBa
lancers/MyLoadBalancer/frontendIPConfigurations/myScaleSet"
          },                                                                                                                      "backendAddressPool": {                                                                                                   "id":                                                                                                       "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBa lancers/MyLoadBalancer/backendAddressPools/myScaleSet"                                                                            },                                                                                                                      "protocol": "Tcp",                                                                                                      "frontendPort": 80,                                                                                                     "backendPort": 80                                                                                                     },                                                                                                                      "name": "MyLoadBalancer80"                                                                                            }                                                                                                                     ]                                                                                                                     },                                                                                                                      "location": "EastUS2euap"                                                                                             }                                                                                                                                                                                                                                               DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            BadRequest                                                                                                                                                                                                                                      Headers:                                                                                                                Pragma                        : no-cache                                                                                x-ms-request-id               : 97e45933-f8f6-425e-8d12-32c0d2fbb238                                                    x-ms-correlation-request-id   : 76f03a19-41e0-481c-aed3-e8ab918afdd9                                                    x-ms-arm-service-request-id   : 21f9f5a7-8f3a-441d-8a62-34bf18acc0a3                                                    Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     Cache-Control                 : no-cache                                                                                Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0                                             x-ms-ratelimit-remaining-subscription-writes: 1199                                                                      x-ms-routing-request-id       : WESTUS:20220713T173709Z:76f03a19-41e0-481c-aed3-e8ab918afdd9                            X-Content-Type-Options        : nosniff                                                                                 Date                          : Wed, 13 Jul 2022 17:37:09 GMT                                                           
Body:
{
  "error": {
    "code": "ResourceMayNotReferenceCrossLocationResource",
    "message": "Resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBal
ancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.",
    "details": []
  }
}


Confirm
Resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBal
ancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.
[Y] Yes  [A] Yes to All  [H] Halt Command  [S] Suspend  [?] Help (default is "Y"): a
New-AzVmss : Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Mic
rosoft.Network/loadBalancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.
At line:1 char:1
+ New-AzVmss `
+ ~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [New-AzVmss], CloudException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.NewAzureRmVmss

DEBUG: AzureQoSEvent: Module: Az.Compute:4.23.0; CommandName: New-AzVmss; PSVersion: 5.1.22000.653; IsSuccess: False;
Duration: 1.23:59:52.8610618; Exception: Resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBal
ancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.;
DEBUG: Finish sending metric.
DEBUG: 10:36:45 AM - NewAzureRmVmss end processing.
PS C:\Users\viananth>

Environment data

Name                           Value
----                           -----
PSVersion                      5.1.22000.653
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.22000.653
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1

Module versions

ModuleType Version    Name                                ExportedCommands
---------- -------    ----                                ----------------
Script     2.7.2      Az.Accounts                         {Add-AzEnvironment, Clear-AzContext, Clear-AzDefault, Conn...
Script     4.23.0     Az.Compute                          {Add-AzImageDataDisk, Add-AzVhd, Add-AzVMAdditionalUnatten...
Script     4.14.0     Az.Network                          {Add-AzApplicationGatewayAuthenticationCertificate, Add-Az...

Error output

RequestId      : 97e45933-f8f6-425e-8d12-32c0d2fbb238
Message        : Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/l
                 oadBalancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource /subscriptions/1d85
                 fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicIPAddresses/myPublicIPA
                 ddress in Extended Location EdgeZone:microsoftrrdclab1.
ServerMessage  : ResourceMayNotReferenceCrossLocationResource: Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/
                 viananth-testrr2/providers/Microsoft.Network/loadBalancers/MyLoadBalancer in Extended location None may not contain cross
                 zone reference to resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/M
                 icrosoft.Network/publicIPAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.
                 (System.Collections.Generic.List`1[Microsoft.Rest.Azure.CloudError])
ServerResponse : {BadRequest}
RequestMessage : {PUT https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provi
                 ders/Microsoft.Network/loadBalancers/MyLoadBalancer?api-version=2020-11-01}
InvocationInfo : {New-AzVmss}
Line           : New-AzVmss `

Position       : At line:1 char:1
                 + New-AzVmss `
                 + ~~~~~~~~~~~~
StackTrace     :    at Microsoft.Azure.Commands.Common.Strategies.SyncTaskScheduler.Wait(Task task, Action progressUpdate)
                    at Microsoft.Azure.Commands.Compute.Automation.NewAzureRmVmss.ExecuteCmdlet()
                    at Microsoft.WindowsAzure.Commands.Utilities.Common.AzurePSCmdlet.ProcessRecord()

viananth avatar Jul 15 '22 17:07 viananth

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Drewm3, @avirishuv.

Issue Details

Description

EdgeZone now supports Flexible orchestration VMSS. But while using Azure PowerShell to create Flexible orchestration VMSS in EdgeZone, it fails with the following error:

New-AzVmss : Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Mic rosoft.Network/loadBalancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1. At line:1 char:1 New-AzVmss CategoryInfo : CloseError: (:) [New-AzVmss], CloudException FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.NewAzureRmVmss

Basically, LB creation does not carry EdgeZone during Flex VMSS orchestration.

https://github.com/Azure/azure-powershell/blob/404ae3b0f4a1c3501ff452b096d8be6ef978af73/src/Compute/Compute/Manual/VirtualMachineScaleSetCreateOrUpdateMethod.cs#L466

The following line should include EdgeZone: var loadBalancer = resourceGroup.CreateLoadBalancerConfig( name: _cmdlet.LoadBalancerName, //sku.Basic is not compatible with multiple placement groups sku: (noZones && _cmdlet.SinglePlacementGroup.IsPresent) ? LoadBalancerStrategy.Sku.Basic : LoadBalancerStrategy.Sku.Standard);

Issue script & Debug output

PS C:\Users\viananth> New-AzVmss `
>>    -ResourceGroupName $rg `
>>    -Location "EastUS2euap" `
>>    -VMScaleSetName "myScaleSet" `
>>    -VirtualNetworkName "myVnet" `
>>    -SubnetName "mySubnet" `
>>    -PublicIpAddressName "myPublicIPAddress" `
>>    -LoadBalancerName "MyLoadBalancer" `
>>    -InstanceCount 2 `
>>    -EdgeZone "microsoftrrdclab1" `
>>    -VmSize "Standard_D2_v2" `
>>    -AllocationMethod Dynamic `
>>    -Credential $creds `
>>    -OrchestrationMode Flexible -debug
>>
VERBOSE: VMScaleSetName = "myScaleSet"                                                                                  VERBOSE: UserData = $null                                                                                               VERBOSE: ImageName = "Win2016Datacenter"                                                                                VERBOSE: Credential = System.Management.Automation.PSCredential                                                         VERBOSE: InstanceCount = 2                                                                                              VERBOSE: VirtualNetworkName = "myVnet"                                                                                  VERBOSE: SubnetName = "mySubnet"                                                                                        VERBOSE: PublicIpAddressName = "myPublicIPAddress"                                                                      VERBOSE: DomainNameLabel = "myscaleset-d80dd8"                                                                          VERBOSE: SecurityGroupName = "myScaleSet"                                                                               VERBOSE: LoadBalancerName = "MyLoadBalancer"                                                                            VERBOSE: BackendPort = 80                                                                                               VERBOSE: Location = "EastUS2euap"                                                                                       VERBOSE: VmSize = "Standard_D2_v2"                                                                                      VERBOSE: UpgradePolicyMode = Automatic                                                                                  VERBOSE: AllocationMethod = "Dynamic"                                                                                   VERBOSE: VnetAddressPrefix = "192.168.0.0/16"                                                                           VERBOSE: SubnetAddressPrefix = "192.168.1.0/24"                                                                         VERBOSE: FrontendPoolName = "myScaleSet"                                                                                VERBOSE: BackendPoolName = "myScaleSet"                                                                                 VERBOSE: SystemAssignedIdentity = False                                                                                 VERBOSE: UserAssignedIdentity = $null
VERBOSE: EnableUltraSSD = False
VERBOSE: Zone = $null
VERBOSE: NatBackendPort = 3389,5985
VERBOSE: DataDiskSizeInGb = $null                                                                                       VERBOSE: ProximityPlacementGroupId = $null                                                                              VERBOSE: HostGroupId = $null                                                                                            VERBOSE: Priority = $null                                                                                               VERBOSE: EvictionPolicy = $null                                                                                         VERBOSE: MaxPrice = 0                                                                                                   VERBOSE: ScaleInPolicy = $null                                                                                          VERBOSE: SkipExtensionsOnOverprovisionedVMs = False                                                                     VERBOSE: EncryptionAtHost = False                                                                                       VERBOSE: PlatformFaultDomainCount = 0                                                                                   VERBOSE: OrchestrationMode = "Flexible"                                                                                 VERBOSE: CapacityReservationGroupId = $null                                                                                                                                                                                                                                                                                             DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide rs/Microsoft.Compute/images/Win2016Datacenter?api-version=2021-07-01                                                                                                                                                                            Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                   DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            NotFound                                                                                                                
Headers:
Pragma                        : no-cache
x-ms-failure-cause            : gateway
x-ms-request-id               : fe22bdec-e626-45d7-b929-e7afd77d9117                                                    x-ms-correlation-request-id   : fe22bdec-e626-45d7-b929-e7afd77d9117                                                    x-ms-routing-request-id       : WESTUS:20220713T173655Z:fe22bdec-e626-45d7-b929-e7afd77d9117                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:55 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "error": {                                                                                                                "code": "ResourceNotFound",                                                                                             "message": "The Resource 'Microsoft.Compute/images/Win2016Datacenter' under resource group 'viananth-testrr2' was   not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"                                           }                                                                                                                                                                                                    DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/providers/Microsoft.Network/locations/E astUS2euap/CheckDnsNameAvailability?domainNameLabel=myscaleset-d80dd8&api-version=2020-11-01                                                                                                                                                    Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                   DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:
OK

Headers:
Pragma                        : no-cache                                                                                x-ms-request-id               : a29599d0-bac5-4b34-b286-272214abe646                                                    x-ms-correlation-request-id   : 766828e3-0af8-4c66-b2b1-71c99f84cea7                                                    x-ms-arm-service-request-id   : 8745c4c4-3a12-4872-be16-bbfa7bff9272                                                    Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     Cache-Control                 : no-cache                                                                                Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0                                             x-ms-ratelimit-remaining-subscription-reads: 11998                                                                      x-ms-routing-request-id       : WESTUS:20220713T173656Z:766828e3-0af8-4c66-b2b1-71c99f84cea7                            X-Content-Type-Options        : nosniff                                                                                 Date                          : Wed, 13 Jul 2022 17:36:55 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "available": true                                                                                                     }                                                                                                                                                                                                                                                                                                                    DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide rs/Microsoft.Compute/virtualMachineScaleSets/myScaleSet?api-version=2021-03-01                                                                                                                                                                  Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                   DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            NotFound                                                                                                                
Headers:
Pragma                        : no-cache
x-ms-failure-cause            : gateway
x-ms-request-id               : 8e518f8b-3862-4552-94bd-a45cac4ea5d2                                                    x-ms-correlation-request-id   : 8e518f8b-3862-4552-94bd-a45cac4ea5d2                                                    x-ms-routing-request-id       : WESTUS:20220713T173657Z:8e518f8b-3862-4552-94bd-a45cac4ea5d2                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:56 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "error": {                                                                                                                "code": "ResourceNotFound",                                                                                             "message": "The Resource 'Microsoft.Compute/virtualMachineScaleSets/myScaleSet' under resource group                'viananth-testrr2' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"                    }                                                                                                                     }                                                                                                                                                                                                                                                                                                                            DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourcegroups/viananth-testrr2?api-ver sion=2016-09-01                                                                                                                                                                                                                                 Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US                                                                                                                                                                                                           Body:                                                                                                                                                                                                                                                                                                                                                                                                                                                          DEBUG: ============================ HTTP REQUEST ============================                                                                                                                                                                   HTTP Method:                                                                                                            GET                                                                                                                                                                                                                                             Absolute Uri:                                                                                                           https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide rs/Microsoft.Network/loadBalancers/MyLoadBalancer?api-version=2020-11-01                                                                                                                                                                        Headers:                                                                                                                x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30                                                    accept-language               : en-US

Body:


                                                                           DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:
OK

Headers:
Pragma                        : no-cache
x-ms-ratelimit-remaining-subscription-reads: 11998
x-ms-request-id               : 33f2aa41-fe93-4482-8641-f5499f645397
x-ms-correlation-request-id   : 33f2aa41-fe93-4482-8641-f5499f645397
x-ms-routing-request-id       : WESTUS:20220713T173657Z:33f2aa41-fe93-4482-8641-f5499f645397                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:56 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "id": "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2",
  "name": "viananth-testrr2",
  "location": "eastus2euap",
  "properties": {
    "provisioningState": "Succeeded"
  }
}


DEBUG: ============================ HTTP REQUEST ============================

HTTP Method:
GET

Absolute Uri:
https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide
rs/Microsoft.Network/virtualNetworks/myVnet?api-version=2020-11-01

Headers:
x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30
accept-language               : en-US

Body:


DEBUG: ============================ HTTP RESPONSE ============================

Status Code:
OK

Headers:
Pragma                        : no-cache
x-ms-request-id               : 2856f43c-d732-45f4-af18-cb5ae4b7fe55
x-ms-correlation-request-id   : bf472f95-1d16-4d0d-8c58-86b77ce44920
x-ms-arm-service-request-id   : efd62bad-0a33-4fc4-a68a-01424d487bca
Strict-Transport-Security     : max-age=31536000; includeSubDomains
Cache-Control                 : no-cache
ETag                          : W/"edbbc4ec-cf23-4377-ac01-09976255f100"
Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0
x-ms-ratelimit-remaining-subscription-reads: 11999
x-ms-routing-request-id       : WESTUS:20220713T173657Z:bf472f95-1d16-4d0d-8c58-86b77ce44920
X-Content-Type-Options        : nosniff
Date                          : Wed, 13 Jul 2022 17:36:56 GMT

Body:                                                                                                                   {                                                                                                                         "name": "myVnet",                                                                                                       "id":                                                                                                                 "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/virtua lNetworks/myVnet",                                                                                                        "etag": "W/\"edbbc4ec-cf23-4377-ac01-09976255f100\"",                                                                   "type": "Microsoft.Network/virtualNetworks",                                                                            "location": "eastus2euap",
  "extendedLocation": {
    "type": "EdgeZone",
    "name": "microsoftrrdclab1"
  },
  "properties": {
    "provisioningState": "Succeeded",
    "resourceGuid": "5439646e-8809-48fa-9dfe-f20baf12d55f",
    "addressSpace": {
      "addressPrefixes": [
        "192.168.0.0/16"
      ]
    },
    "subnets": [
      {
        "name": "mySubnet",
        "id":
"/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/virtua lNetworks/myVnet/subnets/mySubnet",                                                                                             "etag": "W/\"edbbc4ec-cf23-4377-ac01-09976255f100\"",                                                                   "properties": {                                                                                                           "provisioningState": "Succeeded",                                                                                       "addressPrefix": "192.168.1.0/24",                                                                                      "networkSecurityGroup": {                                                                                                 "id":                                                                                                       "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/networ kSecurityGroups/NRMS-gctysxtutypdimyVnet"                                                                                         },                                                                                                                      "delegations": [],                                                                                                      "privateEndpointNetworkPolicies": "Disabled",                                                                           "privateLinkServiceNetworkPolicies": "Enabled"                                                                        },                                                                                                                      "type": "Microsoft.Network/virtualNetworks/subnets"                                                                   }                                                                                                                     ],                                                                                                                      "virtualNetworkPeerings": [],                                                                                           "enableDdosProtection": false                                                                                         }                                                                                                                     }                                                                                                                                                                                                                                               DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            NotFound                                                                                                                
Headers:
Pragma                        : no-cache
x-ms-failure-cause            : gateway
x-ms-request-id               : bdbd44f2-d2c7-4fcb-89b6-d151d6b15dd8                                                    x-ms-correlation-request-id   : bdbd44f2-d2c7-4fcb-89b6-d151d6b15dd8                                                    x-ms-routing-request-id       : WESTUS:20220713T173658Z:bdbd44f2-d2c7-4fcb-89b6-d151d6b15dd8                            Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     X-Content-Type-Options        : nosniff                                                                                 Cache-Control                 : no-cache                                                                                Date                          : Wed, 13 Jul 2022 17:36:57 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "error": {                                                                                                                "code": "ResourceNotFound",                                                                                             "message": "The Resource 'Microsoft.Network/loadBalancers/MyLoadBalancer' under resource group 'viananth-testrr2'   was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix"                                       }                                                                                                                     }                                                                                                                                                                                                                                               
DEBUG: ============================ HTTP REQUEST ============================

HTTP Method:
GET

Absolute Uri:
https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide
rs/Microsoft.Network/publicIPAddresses/myPublicIPAddress?api-version=2020-11-01

Headers:
x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30
accept-language               : en-US

Body:

                                                                                                                        DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            OK                                                                                                                                                                                                                                              Headers:                                                                                                                Pragma                        : no-cache                                                                                x-ms-request-id               : 051526f4-5643-473b-abb4-854ce6afe918                                                    x-ms-correlation-request-id   : 19785e14-ed9f-4cd9-863c-48e1705982aa                                                    x-ms-arm-service-request-id   : bc08397f-8a7b-4671-8582-845dffd42dc4                                                    Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     Cache-Control                 : no-cache                                                                                ETag                          : W/"76b1064f-44a8-4bb2-a78c-60676b4c638c"                                                Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0                                             x-ms-ratelimit-remaining-subscription-reads: 11999                                                                      x-ms-routing-request-id       : WESTUS:20220713T173658Z:19785e14-ed9f-4cd9-863c-48e1705982aa                            X-Content-Type-Options        : nosniff                                                                                 Date                          : Wed, 13 Jul 2022 17:36:58 GMT                                                                                                                                                                                   Body:                                                                                                                   {                                                                                                                         "name": "myPublicIPAddress",                                                                                            "id":                                                                                                                 "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/public IPAddresses/myPublicIPAddress",                                                                                           "etag": "W/\"76b1064f-44a8-4bb2-a78c-60676b4c638c\"",                                                                   "location": "eastus2euap",
  "extendedLocation": {
    "type": "EdgeZone",
    "name": "microsoftrrdclab1"
  },                                                                                                                      "properties": {                                                                                                           "provisioningState": "Succeeded",                                                                                       "resourceGuid": "fa2aa363-11c0-49af-ab42-d4be69d4332a",                                                                 "ipAddress": "198.180.97.213",                                                                                          "publicIPAddressVersion": "IPv4",                                                                                       "publicIPAllocationMethod": "Static",                                                                                   "idleTimeoutInMinutes": 4,                                                                                              "ipTags": []                                                                                                          },                                                                                                                      "type": "Microsoft.Network/publicIPAddresses",                                                                          "sku": {                                                                                                                  "name": "Standard",                                                                                                     "tier": "Regional"                                                                                                    }                                                                                                                     }                                                                                                                                                                                                                                               
DEBUG: ============================ HTTP REQUEST ============================

HTTP Method:
PUT

Absolute Uri:
https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provide
rs/Microsoft.Network/loadBalancers/MyLoadBalancer?api-version=2020-11-01

Headers:
x-ms-client-request-id        : 0aa71891-6a09-455f-a76a-853faeb69d30
accept-language               : en-US
                                                                                                                        Body:                                                                                                                   {                                                                                                                         "sku": {                                                                                                                  "name": "Standard"                                                                                                    },                                                                                                                      "properties": {                                                                                                           "frontendIPConfigurations": [                                                                                             {
        "properties": {
          "publicIPAddress": {
            "id":
"/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/public
IPAddresses/myPublicIPAddress"
          }
        },
        "name": "myScaleSet"
      }
    ],
    "backendAddressPools": [
      {
        "name": "myScaleSet"
      }
    ],
    "loadBalancingRules": [
      {
        "properties": {
          "frontendIPConfiguration": {
            "id":
"/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBa
lancers/MyLoadBalancer/frontendIPConfigurations/myScaleSet"
          },                                                                                                                      "backendAddressPool": {                                                                                                   "id":                                                                                                       "/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBa lancers/MyLoadBalancer/backendAddressPools/myScaleSet"                                                                            },                                                                                                                      "protocol": "Tcp",                                                                                                      "frontendPort": 80,                                                                                                     "backendPort": 80                                                                                                     },                                                                                                                      "name": "MyLoadBalancer80"                                                                                            }                                                                                                                     ]                                                                                                                     },                                                                                                                      "location": "EastUS2euap"                                                                                             }                                                                                                                                                                                                                                               DEBUG: ============================ HTTP RESPONSE ============================                                                                                                                                                                  Status Code:                                                                                                            BadRequest                                                                                                                                                                                                                                      Headers:                                                                                                                Pragma                        : no-cache                                                                                x-ms-request-id               : 97e45933-f8f6-425e-8d12-32c0d2fbb238                                                    x-ms-correlation-request-id   : 76f03a19-41e0-481c-aed3-e8ab918afdd9                                                    x-ms-arm-service-request-id   : 21f9f5a7-8f3a-441d-8a62-34bf18acc0a3                                                    Strict-Transport-Security     : max-age=31536000; includeSubDomains                                                     Cache-Control                 : no-cache                                                                                Server                        : Microsoft-HTTPAPI/2.0,Microsoft-HTTPAPI/2.0                                             x-ms-ratelimit-remaining-subscription-writes: 1199                                                                      x-ms-routing-request-id       : WESTUS:20220713T173709Z:76f03a19-41e0-481c-aed3-e8ab918afdd9                            X-Content-Type-Options        : nosniff                                                                                 Date                          : Wed, 13 Jul 2022 17:37:09 GMT                                                           
Body:
{
  "error": {
    "code": "ResourceMayNotReferenceCrossLocationResource",
    "message": "Resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBal
ancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.",
    "details": []
  }
}


Confirm
Resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBal
ancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.
[Y] Yes  [A] Yes to All  [H] Halt Command  [S] Suspend  [?] Help (default is "Y"): a
New-AzVmss : Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Mic
rosoft.Network/loadBalancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.
At line:1 char:1
+ New-AzVmss `
+ ~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [New-AzVmss], CloudException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.NewAzureRmVmss

DEBUG: AzureQoSEvent: Module: Az.Compute:4.23.0; CommandName: New-AzVmss; PSVersion: 5.1.22000.653; IsSuccess: False;
Duration: 1.23:59:52.8610618; Exception: Resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/loadBal
ancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource
/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicI
PAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.;
DEBUG: Finish sending metric.
DEBUG: 10:36:45 AM - NewAzureRmVmss end processing.
PS C:\Users\viananth>

Environment data

Name                           Value
----                           -----
PSVersion                      5.1.22000.653
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.22000.653
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1

Module versions

ModuleType Version    Name                                ExportedCommands
---------- -------    ----                                ----------------
Script     2.7.2      Az.Accounts                         {Add-AzEnvironment, Clear-AzContext, Clear-AzDefault, Conn...
Script     4.23.0     Az.Compute                          {Add-AzImageDataDisk, Add-AzVhd, Add-AzVMAdditionalUnatten...
Script     4.14.0     Az.Network                          {Add-AzApplicationGatewayAuthenticationCertificate, Add-Az...

Error output

RequestId      : 97e45933-f8f6-425e-8d12-32c0d2fbb238
Message        : Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/l
                 oadBalancers/MyLoadBalancer in Extended location None may not contain cross zone reference to resource /subscriptions/1d85
                 fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/Microsoft.Network/publicIPAddresses/myPublicIPA
                 ddress in Extended Location EdgeZone:microsoftrrdclab1.
ServerMessage  : ResourceMayNotReferenceCrossLocationResource: Resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/
                 viananth-testrr2/providers/Microsoft.Network/loadBalancers/MyLoadBalancer in Extended location None may not contain cross
                 zone reference to resource /subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/providers/M
                 icrosoft.Network/publicIPAddresses/myPublicIPAddress in Extended Location EdgeZone:microsoftrrdclab1.
                 (System.Collections.Generic.List`1[Microsoft.Rest.Azure.CloudError])
ServerResponse : {BadRequest}
RequestMessage : {PUT https://management.azure.com/subscriptions/1d85fdce-f71c-4ecd-a06d-ea46effcccd0/resourceGroups/viananth-testrr2/provi
                 ders/Microsoft.Network/loadBalancers/MyLoadBalancer?api-version=2020-11-01}
InvocationInfo : {New-AzVmss}
Line           : New-AzVmss `

Position       : At line:1 char:1
                 + New-AzVmss `
                 + ~~~~~~~~~~~~
StackTrace     :    at Microsoft.Azure.Commands.Common.Strategies.SyncTaskScheduler.Wait(Task task, Action progressUpdate)
                    at Microsoft.Azure.Commands.Compute.Automation.NewAzureRmVmss.ExecuteCmdlet()
                    at Microsoft.WindowsAzure.Commands.Utilities.Common.AzurePSCmdlet.ProcessRecord()
Author: viananth
Assignees: -
Labels:

Compute - VMSS, Service Attention, bug

Milestone: -

msftbot[bot] avatar Jul 17 '22 15:07 msftbot[bot]

Looking into this issue

jaylabell avatar Jul 21 '22 19:07 jaylabell

@jaylabell Any updates on this?

viananth avatar Aug 02 '22 19:08 viananth

@viananth - Hi, @Sandido is looking into this!

jaylabell avatar Oct 06 '22 14:10 jaylabell

Confirmed with @viananth that this issue does not repro anymore.

Sandido avatar Nov 01 '22 20:11 Sandido

@Sandido Adam, this issue does not repro in MicrosoftMiami1. But it repros in RR edgezones. I must have used MicrosoftMiami1 when you shared your script, so I thought it got fixed.

viananth avatar Jan 13 '23 23:01 viananth

Please let me know if you need more logs if you are not able to use RR edgezones to repro.

viananth avatar Jan 13 '23 23:01 viananth

Reached out to @viananth on email with questions.

Sandido avatar Jan 19 '23 20:01 Sandido

My team will revisit this this coming week for a new sprint.

Sandido avatar Sep 14 '23 19:09 Sandido

Verified that this issue is fixed with the above release. (AZ: 11.2.0)

viananth avatar Jan 10 '24 18:01 viananth