helm-charts icon indicating copy to clipboard operation
helm-charts copied to clipboard

Support Rolling Upgrades for the cockroachdb installed through helm chart

Open prafull01 opened this issue 2 years ago • 2 comments

Rolling Upgrade for cockroach db statefulset:

Every pod of statefulset should be upgraded one by one and it should wait for the cockroach db cluster to be ready state before upgrading to the new cluster. Currently, helm chart will upgrade the statefulset in rolling upgrade but it doesn't wait for cockroach cluster to be ready before it upgrades to the next replica.

Proposed Solution:

We already have self-signer utility for certificate management, we can expand that utility to do rolling start as well. This utility will have a sub command of rolling-restart and this will upgrade the statefulset into rolling restart fashion and wait for cockroach db cluster to be ready before upgrading the next pod. We are already doing this for the cockroach operator

This utility will be invoked as pre-upgrade command and can be enabled or disable through the values.yaml.

Jira issue: HELM-23

prafull01 avatar Mar 27 '23 18:03 prafull01

@udnay Please share your thoughts on this

prafull01 avatar Mar 27 '23 18:03 prafull01

This approach seems fine to me, @chrisseto @pseudomuto anything totally off with this before @prafull01 writes up a more detailed RFC?

udnay avatar Apr 04 '23 13:04 udnay