EKS: Upgrade to 1.27

[sj-williams]

Issue 2:

Update vpc-cni from v1.16.2-eksbuild.1 to the version needed for current k8s version

Check for the latest supported addon version for the current kubernetes version and update the clusters

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

See the Amazon EKS add-ons documentation for more information about addons, or find the latest versions for these EKS add-ons directly:

• coredns
• kube-proxy
• vpc-cni

Issue 3:

Update kube-proxy from v1.26.9-eksbuild.2 addon version for the current kubernetes version and update the clusters

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

See the Amazon EKS add-ons documentation for more information about addons, or find the latest versions for these EKS add-ons directly:

• coredns
• kube-proxy
• vpc-cni

Issue 4:

Update core-dns from v1.9.3-eksbuild.11 to the version needed for current k8s version

Check for the latest supported addon version for the current kubernetes version and update the clusters

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

See the Amazon EKS add-ons documentation for more information about addons, or find the latest versions for these EKS add-ons directly:

• coredns
• kube-proxy
• vpc-cni

Issue 5:

Test EKS 1.27 on test cluster

Follow instructions from Upgrade runbook: https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html#upgrade-eks-cluster

Issue 6:

Test EKS 1.27 on live-like cluster

Follow instructions from creating a live like cluster runbook: https://runbooks.cloud-platform.service.justice.gov.uk/creating-a-live-like.html#creating-a-live-like-cluster

Issue 7:

EKS: Upgrade Production clusters to Kubernetes 1.27

https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

Issue 8:

Update vpc-cni to the latest version for the upgraded k8s 1.27

Check for the latest supported addon version for the upgraded kubernetes version and update the clusters

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

See the Amazon EKS add-ons documentation for more information about addons, or find the latest versions for these EKS add-ons directly:

• coredns
• kube-proxy
• vpc-cni

Issue 9:

Update kube-proxy to the latest version for the upgraded k8s 1.27

Check for the latest supported addon version for the upgraded kubernetes version and update the clusters

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

See the Amazon EKS add-ons documentation for more information about addons, or find the latest versions for these EKS add-ons directly:

• coredns
• kube-proxy
• vpc-cni

Issue 10:

Update core-dns to the latest version for the upgraded k8s 1.27

Check for the latest supported addon version for the upgraded kubernetes version and update the clusters

Production Clusters Checklist:

• [ ] live-2
• [ ] manager
• [ ] live

See the Amazon EKS add-ons documentation for more information about addons, or find the latest versions for these EKS add-ons directly:

• coredns
• kube-proxy
• vpc-cni

Issue 11:

Review cluster components for upgrading

https://runbooks.cloud-platform.service.justice.gov.uk/container-images.html#container-images-used-by-cluster-components

Review the compatibility matrix for all cluster components and verify if the image is compatible with the upgraded kubernetes version

Issue 12:

Review and upgrade kube-state-metrics for the upgraded cluster version 1.27

https://runbooks.cloud-platform.service.justice.gov.uk/container-images.html#container-images-used-by-cluster-components

https://github.com/kubernetes/kube-state-metrics?tab=readme-ov-file#compatibility-matrix

Review the compatibility matrix of kube-state-metrics and verify if the image is compatible with the upgraded kuebrnetes version. If the version is mismatch, check if the whole kube-prometheus-chart needs updating to get the default version of kube-state-metrics from the chart-> values. Otherwise, pin the kube-state-metrics image to match the kubernetes-version

Issue 13:

Upgrade cluster autoscalar for k8s version 1.27

The Cloud Platform Cluster is in k8s version 1.27. Hence upgrade the cluster-autoscalar to match the k8s version.

https://github.com/kubernetes/autoscaler/tree/master/charts/cluster-autoscaler https://github.com/ministryofjustice/cloud-platform-terraform-cluster-autoscaler

Issue 14:

Upgrade cluster descheudler for k8s version 1.27

The Cloud Platform Cluster is in k8s version 1.27. Hence upgrade the descheduler to match the k8s version.

https://github.com/kubernetes-sigs/descheduler?tab=readme-ov-file#%EF%B8%8F--documentation-versions-by-release https://github.com/ministryofjustice/cloud-platform-terraform-descheduler

Issue 15:

Post k8s version 1.27 Cleanup

Following upgrade from EKS 1.26 to 1.27, there will be a number of cleanup activities that need addressing:

Update user guide / runbook references Update tools-image for kubectl version Update cloud-platform-cli for kubectl version Update concourse pipelines to use updated tools-image and cli

Issue 16:

Update Upgrade runbook and Issue template:

Update the runbook for

• any changes needed in the steps to perform the upgrade
• any lessons learnt that could be useful for next upgrade
• any changes to the upgrade issue template

Cluster upgrade Runbook: https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html