117 instances in the West US 2 region experienced an 80-second outage

[calverp]

Team

• [X] I've assigned a team label to this issue

Severity

117 Octopus Cloud customer instances experienced a brief <2min outage without prior warning

Version

2022.4

Latest Version

No response

What happened?

During a Placement and Load Balancing (PLB) event at Azure, a large number of Octopus Cloud instances can experience a brief outage. This can occur outside of maintenance windows, and without warning, potentially resulting in failed deployments. The issue was first described here on our Status page - https://status.octopus.com/incidents/qstr2cfjvckq We're currently:

• monitoring this scenario, so that we can advise customers of recurrences (if any) via [status.octopus.com](https://status.octopus.com/)
• following up with Microsoft for details on why this 80-second outage occurred, and whether it's like to reoccur
• improving our cloud platform's resilience to brief, unexpected Azure outages

Reproduction

Slack thread

Error and Stacktrace

No response

More Information

No response

Workaround

No response