devtron icon indicating copy to clipboard operation
devtron copied to clipboard

Secret broken after helm delete and reinstall

Open murand78 opened this issue 3 years ago • 0 comments

Describe the bug

After removing an helm installation and install again in the same namespace secrets:

  • postgresql-migrator
  • postgresql-postgresql
  • devtron-secret

Contains base64 encoded data of previous secret data, preventing all new pod to init ( "err":"pq: password authentication failed for user "postgres")

To Reproduce

  • $ helm install devtron devtron/devtron-operator -f devtron.yaml ( wait sync applied )

  • `$ helm delete devtron These resources were kept due to the resource policy: [Service] dashboard-service [Service] devtron-service [Service] argocd-dex-server [Service] kubelink-service [Service] postgresql-postgresql-metrics [Service] postgresql-postgresql-headless [Service] postgresql-postgresql [CronJob] app-sync-cronjob [StatefulSet] postgresql-postgresql [Deployment] dashboard [Deployment] devtron [Deployment] argocd-dex-server [Deployment] kubelink [RoleBinding] argocd-dex-server [Role] argocd-dex-server [ClusterRoleBinding] devtron [ClusterRole] devtron [ConfigMap] argocd-cm [ConfigMap] dashboard-cm [ConfigMap] devtron-cm [Secret] argocd-secret [Secret] devtron-dashboard-secret [ServiceAccount] argocd-dex-server [ServiceAccount] devtron [ServiceMonitor] devtron-sm

release "devtron" uninstalled`

  • $ helm install devtron devtron/devtron-operator -f devtron.yaml

Expected behavior

Devtron is up again with previous configuration

Current behavior

Helm installation fails

** Environent

Amazon EKS v1.21.12-eks-a64ea69 Rancher 2.5.12 devtron-operator, chart_version = "0.22.28"

As a workaround:

  • backup secrets before helm delete
  • helm delete
  • helm install
  • delete secrets
  • apply backupped secrets

set in values.yaml autogenerated secret values like describe in https://docs.devtron.ai/devtron/setup/install/installation-configuration for POSTGRESQL_PASSWORD ACD_PASSWORD but take no effect

murand78 avatar Jul 20 '22 16:07 murand78