contosotraders-cloudtesting icon indicating copy to clipboard operation
contosotraders-cloudtesting copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

products not loading

Open debs-obrien opened this issue 9 months ago • 1 comments

Products not loading again:

similar to previous issue: https://github.com/microsoft/contosotraders-cloudtesting/issues/333

debs-obrien avatar Apr 29 '24 19:04 debs-obrien

Sure, I'll take a look at this tomorrow morning (am currently out of office on a work-related trip).

mithunshanbhag avatar Apr 30 '24 13:04 mithunshanbhag

reminding you of this for if you have time this week @mithunshanbhag

debs-obrien avatar May 06 '24 14:05 debs-obrien

Looks like a couple of nodes are experiencing mem saturation. Investigating....

image

CC: @amalik99, @sumitmalik51

mithunshanbhag avatar May 07 '24 10:05 mithunshanbhag

Both the test (staging) and prod clusters were exhibiting this issue.

I've managed to revive the staging cluster by deleting it, and re-deploying it from the Azure Devops pipeline.

Now attempting the same with the prod cluster (redeploying via github actions)....

mithunshanbhag avatar May 07 '24 11:05 mithunshanbhag

@sumitmalik51, @amalik99 : Someone updated the service principal details last week.

Consequently, when the github worklow runs, the deployment happen in some other subscription (that I don't have access to).

Do you know what's happening?

image

mithunshanbhag avatar May 07 '24 13:05 mithunshanbhag

Aaaaand it's back online now.

PS: I've restored the following secrets & variables to their previous values:

  • SERVICEPRINCIPAL
  • SUFFIX
  • SQLPASSWORD

mithunshanbhag avatar May 07 '24 14:05 mithunshanbhag