spicedb-operator icon indicating copy to clipboard operation
spicedb-operator copied to clipboard

Changing replicas during rollout can make cluster get stuck rolling out

Open ecordell opened this issue 3 years ago • 0 comments

If the SpiceDBCluster has the condition WaitingForDeploymentAvailability and the spec.config.replicas value is changed, then the cluster can get stuck in the waiting state:

  Conditions:
    Last Transition Time:  2022-11-09T18:38:05Z
    Message:               Waiting for deployment to be available: 3/2 available, 3/2 ready, 3/2 updated, 163/163 generation.
    Reason:                WaitingForDeploymentAvailability
    Status:                True
    Type:                  RollingDeployment

As a workaround, this can be fixed by changing the replicas to match the deployment's replicas, waiting for the rollout to finish, and then changing the replicas to the desired value.

ecordell avatar Nov 14 '22 21:11 ecordell