azure_arc icon indicating copy to clipboard operation
azure_arc copied to clipboard

[Bug / Issue]: ArcBox for IT Pros | Facing issue in ArcBox-Client VM, multiple automated scripts

Open cheeleongyap opened this issue 5 months ago • 9 comments

Jumpstart Solution

  • [x] Jumpstart ArcBox
  • [ ] Jumpstart LocalBox
  • [ ] Jumpstart Agora
  • [ ] A specific Jumpstart scenario
  • [ ] Jumpstart Drops
  • [ ] Something else

What happened?

  1. Deployment of ArcBox for IT Pros into southeast asia region completed without any issue.
  2. ArcBox-Client VM automated scripts giving the below error

Waiting for onboarding nested SQL VM as Azure Arc-enabled server ... Retry count: 5 Get-AzConnectedMachine_Get: C:\ArcBox\ArcServersLogonScript.ps1:261 Line | 261 | $ArcServer = Get-AzConnectedMachine -Name $SQLvmName -Resourc … | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | The Resource 'Microsoft.HybridCompute/machines/ArcBox-SQL' under resource group 'ArcRG' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix Get-AzConnectedMachine_Get: C:\ArcBox\ArcServersLogonScript.ps1:261

Logon into Hyper-V Manager, NO Windows and Linux VMs being deployed

ArcBox-Logs.zip

Appreciate your help as need to setup today for customer demo tomorrow.

Thank you very much

We need a URL from you

https://jumpstart.azure.com/azure_jumpstart_arcbox/ITPro

Deployment Method

Azure Portal

Relevant log output.

Waiting for onboarding nested SQL VM as Azure Arc-enabled server ... Retry count: 5
Get-AzConnectedMachine_Get: C:\ArcBox\ArcServersLogonScript.ps1:261
Line |
261 | $ArcServer = Get-AzConnectedMachine -Name $SQLvmName -Resourc …
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| The Resource 'Microsoft.HybridCompute/machines/ArcBox-SQL' under resource group 'ArcRG' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix
Get-AzConnectedMachine_Get: C:\ArcBox\ArcServersLogonScript.ps1:261

Code of Conduct and Licensing

  • [x] I agree to follow this project's Code of Conduct and Licensing terms.

cheeleongyap avatar Jun 10 '25 01:06 cheeleongyap

Image

Resource Group - ArcRG, all deployment completed

cheeleongyap avatar Jun 10 '25 01:06 cheeleongyap

@cheeleongyap Could you share the zip-file in the folder C:\ArcBox\Logs?

Also, could you verify that the Microsoft.HybridCompute resource provider is registered on the subscription?

Image

janegilring avatar Jun 10 '25 03:06 janegilring

@cheeleongyap Could you share the zip-file in the folder C:\ArcBox\Logs?

Also, could you verify that the Microsoft.HybridCompute resource provider is registered on the subscription?

Image

Hi @janegilring , the log files have been attached in the ticket earlier, I re-attached here again

ArcBox-Logs.zip

Image

I have run az provider register --namespace Microsoft.HybridCompute --wait but did not know it is not registered, could this be the root cause of it? thanks alot

cheeleongyap avatar Jun 10 '25 06:06 cheeleongyap

@cheeleongyap Oh, sorry I missed the logs was already uploaded. Yes, if the resource provider is not registered the onboarding of Arc-enabled Servers will fail.

If you ran the commands to register, it might be that the context for the Azure CLI was against another subscription. To make sure it is targeting the one you deploy ArcBox into: az account set -s "xxxxx-xxxx-xxxx-xxxx-xxxxxxxx"

Then run the registration commands again:

az provider register --namespace Microsoft.Compute --wait
az provider register --namespace Microsoft.HybridCompute --wait
az provider register --namespace Microsoft.GuestConfiguration --wait
az provider register --namespace Microsoft.AzureArcData --wait
az provider register --namespace Microsoft.OperationsManagement --wait
az provider register --namespace Microsoft.Insights --wait
az provider register --namespace Microsoft.HybridConnectivity --wait

After performing these steps, the easiest is to delete the resource group and trigger a new deployment.

janegilring avatar Jun 10 '25 07:06 janegilring

@cheeleongyap Oh, sorry I missed the logs was already uploaded. Yes, if the resource provider is not registered the onboarding of Arc-enabled Servers will fail.

If you ran the commands to register, it might be that the context for the Azure CLI was against another subscription. To make sure it is targeting the one you deploy ArcBox into: az account set -s "xxxxx-xxxx-xxxx-xxxx-xxxxxxxx"

Then run the registration commands again:

az provider register --namespace Microsoft.Compute --wait
az provider register --namespace Microsoft.HybridCompute --wait
az provider register --namespace Microsoft.GuestConfiguration --wait
az provider register --namespace Microsoft.AzureArcData --wait
az provider register --namespace Microsoft.OperationsManagement --wait
az provider register --namespace Microsoft.Insights --wait
az provider register --namespace Microsoft.HybridConnectivity --wait

After performing these steps, the easiest is to delete the resource group and trigger a new deployment.

Appreciate your swift response, I will re-try, thanks

cheeleongyap avatar Jun 10 '25 07:06 cheeleongyap

@cheeleongyap Oh, sorry I missed the logs was already uploaded. Yes, if the resource provider is not registered the onboarding of Arc-enabled Servers will fail.

If you ran the commands to register, it might be that the context for the Azure CLI was against another subscription. To make sure it is targeting the one you deploy ArcBox into: az account set -s "xxxxx-xxxx-xxxx-xxxx-xxxxxxxx"

Then run the registration commands again:

az provider register --namespace Microsoft.Compute --wait
az provider register --namespace Microsoft.HybridCompute --wait
az provider register --namespace Microsoft.GuestConfiguration --wait
az provider register --namespace Microsoft.AzureArcData --wait
az provider register --namespace Microsoft.OperationsManagement --wait
az provider register --namespace Microsoft.Insights --wait
az provider register --namespace Microsoft.HybridConnectivity --wait

After performing these steps, the easiest is to delete the resource group and trigger a new deployment.

Interesting, I got new errors now

{"code":"VMExtensionProvisioningTimeout","message":"Provisioning of VM extension Bootstrap has timed out. Extension provisioning has taken too long to complete. The extension did not report a message. More information on troubleshooting is available at https://aka.ms/VMExtensionCSEWindowsTroubleshoot"}

Image Image

cheeleongyap avatar Jun 11 '25 05:06 cheeleongyap

Could you login to the VM and look at C:\ArcBox\Logs\Bootstrap.log? That should reveal what the culprit is.

janegilring avatar Jun 11 '25 05:06 janegilring

Could you login to the VM and look at C:\ArcBox\Logs\Bootstrap.log? That should reveal what the culprit is.

Hi @janegilring , here you go, the Bootstrao log attached.

Bootstrap.log

Transcript started, output file is C:\ArcBox\Logs\Bootstrap.log Install-PackageProvider : No match was found for the specified search criteria for the provider 'NuGet'. The package provider requires 'PackageManagement' and 'Provider' tags. Please check if the specified package has the tags. At C:\Packages\Plugins\Microsoft.Compute.CustomScriptExtension\1.10.20\Downloads\0\Bootstrap.ps1:130 char:1

  • Install-PackageProvider -Name NuGet -MinimumVersion 2.8.5.201 -Force
  •   + CategoryInfo          : InvalidArgument: (Microsoft.Power...PackageProvider:InstallPackageProvider) [Install-Pac
     kageProvider], Exception
      + FullyQualifiedErrorId : NoMatchFoundForProvider,Microsoft.PowerShell.PackageManagement.Cmdlets.InstallPackagePro
     vider
    

cheeleongyap avatar Jun 11 '25 07:06 cheeleongyap

Thanks, this seems like an intermittent CDN/connectivity-issue from the VM to download required artifacts:

WARNING: MSG:UnableToDownload https://onegetcdn.azureedge.net/providers/nuget-2.8.5.208.package.swidtag

This happens from time to time with the PowerShell Gallery module downloads and PowerShellGet bootstrapping, although not very often. You could try to delete the Custom Script - extension from the VM and retry the deployment and it may succeed. If not, delete the resource group and try a fresh deployment.

janegilring avatar Jun 11 '25 12:06 janegilring

@cheeleongyap Were you able to do a successful deployment at the end?

janegilring avatar Jun 16 '25 17:06 janegilring

@cheeleongyap Were you able to do a successful deployment at the end?

Hi @janegilring, I'm currently re-deploying with new subscription and new RG but looks like still stuck there in the same place.

How do I delete the "Custom Script - extension from the VM" and how will this impact the overall deployment and demo?

Thanks

cheeleongyap avatar Jun 17 '25 07:06 cheeleongyap

@cheeleongyap Were you able to do a successful deployment at the end?

Hi @janegilring, I'm currently re-deploying with new subscription and new RG but looks like still stuck there in the same place.

How do I delete the "Custom Script - extension from the VM" and how will this impact the overall deployment and demo?

Thanks

Hi @janegilring , the deployment with new subs and new RG just completed, currently connected to the client VMs and executing the scripts, will keep you posted the result, thanks

cheeleongyap avatar Jun 17 '25 08:06 cheeleongyap

Great, thanks.

FYI for later, this is where you can uninstall the extension which runs the bootstrap script: Image

janegilring avatar Jun 17 '25 11:06 janegilring

Thanks @janegilring for your prompt response and support, the deployment all completed without error this round, appreciate your help!

cheeleongyap avatar Jun 17 '25 23:06 cheeleongyap

Glad to hear, have fun with ArcBox!

janegilring avatar Jun 18 '25 06:06 janegilring

👋 Hello @cheeleongyap,

We've closed this issue because it has been addressed. If you believe further discussion is needed, please add a comment "/unresolve" to reopen the issue.

Thank you for your collaboration!