vault-secrets-operator icon indicating copy to clipboard operation
vault-secrets-operator copied to clipboard

Published 20 hours ago • verified publisher icon hashicorp

Sometime within the day the gcp key invalid and throw an invalid jwt error for the job.

Open duong-se opened this issue 1 year ago • 4 comments

Describe the bug Sometime within the day the gcp key invalid and throw an invalid jwt error for the job.

To Reproduce Steps to reproduce the behavior:

  1. Set up vault connection like below
path "gcp/key/backup-job" {
  capabilities = [ "read" ]
}

vault write gcp/roleset/backup-job \
  project="dev" \
  bindings=@./policy-gcp-bindings.hcl \
  secret_type="service_account_key"

vault policy write backup_job_policy policy.hcl

vault write auth/sandbox-kubernetes/role/backup-job-role\
  bound_service_account_names="backup_job"\
  bound_service_account_namespaces="default" \
  policies="backup_job_policy" \
  ttl="24h" \
  max_ttl="24h"

// vault-secrets.yaml
apiVersion: secrets.hashicorp.com/v1beta1
kind: VaultDynamicSecret
metadata:
  namespace: default
  name: backup-job
spec:
  vaultAuthRef: backup-job
  path: key/backup-job
  destination:
    create: true
    name: backup-job-secrets
  renewalPercent: 67
  rolloutRestartTargets:
    - kind: Deployment
      name:backup-job

apiVersion: secrets.hashicorp.com/v1beta1
kind: VaultAuth
metadata:
  namespace: default
  name: backup-job
spec:
  vaultConnectionRef: vault-connection
  method: kubernetes
  mount: kubernetes
  kubernetes:
    role: backup-job-role
    serviceAccount: backup_job


apiVersion: secrets.hashicorp.com/v1beta1
kind: VaultConnection
metadata:
  namespace: default
  name: vault-connection
spec:
  address: <vault-server-address>
  1. Any custom resources used for your secrets. N/A
  2. ...
  3. See error (vault-secrets-operator logs, application logs, etc.)
2023-11-29T02:18:12Z	DEBUG	events	Lease renewal duration was truncated from 86400s to 23192s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"default","name":"application_name","uid":"6789d53a-9c00-4ce8-8936-360cb85d6c27","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"1335067039"}, "reason": "SecretLeaseRenewal"}

2023-11-29T02:18:13Z	DEBUG	events	Secret synced, lease_id="gcp/key/****/*****", horizon=17h13m31.223998373s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"default","name":"application_name","uid":"6789d53a-9c00-4ce8-8936-360cb85d6c27","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"1335911803"}, "reason": "SecretRotated"}

2023-11-29T02:18:13Z	DEBUG	events	Rollout restart triggered for {Deployment application_name}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"default","name":"application_name","uid":"6789d53a-9c00-4ce8-8936-360cb85d6c27","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"1335911803"}, "reason": "RolloutRestartTriggered"}

OR you can follow this document for setting up https://developer.hashicorp.com/vault/tutorials/kubernetes/vault-secrets-operator#rotate-the-static-secret And the local logs

2023-11-29T14:21:24Z	DEBUG	events	Successfully handled VaultAuth resource request	{"type": "Warning", "object": {"kind":"VaultAuth","namespace":"vault-secrets-operator-system","name":"transit-auth","uid":"4d709e88-e124-47c9-aeeb-deb32f4df9be","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"2438"}, "reason": "Accepted"}
2023-11-29T14:21:39Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10302"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:21:39Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/zDBHNWuOAiqtXbTZNFyJla43", horizon=45.375603817s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10506"}, "reason": "SecretRotated"}
2023-11-29T14:21:39Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10506"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:21:41Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10350"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:21:41Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/HRXUforCVKTZEqyGoAyD8PuB", horizon=43.500121602s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10545"}, "reason": "SecretRotated"}
2023-11-29T14:21:41Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10545"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:21:45Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:22:09Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:22:24Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10545"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:22:24Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/QrqXCHtB3tnHoloADwmQcTjj", horizon=41.091757255s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10707"}, "reason": "SecretRotated"}
2023-11-29T14:22:24Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10707"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:22:24Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10506"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:22:24Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/RrwwiqsY5k2UZxzNDpOWiD19", horizon=42.620740298s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10739"}, "reason": "SecretRotated"}
2023-11-29T14:22:24Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10739"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:22:35Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:23:01Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:23:05Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10707"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:23:05Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/kF4assHr2SM72O0HvjWs1lT3", horizon=45.862288837s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10860"}, "reason": "SecretRotated"}
2023-11-29T14:23:05Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10860"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:23:07Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10739"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:23:07Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/NVjbSrNYdLSlCBXQUrcEAWhI", horizon=43.635961844s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10899"}, "reason": "SecretRotated"}
2023-11-29T14:23:07Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10899"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:23:27Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:23:51Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10899"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:23:51Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/OKB7nIV9alWPzpATWsgOy3ZI", horizon=44.103757892s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11063"}, "reason": "SecretRotated"}
2023-11-29T14:23:51Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11063"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:23:51Z	DEBUG	events	Lease renewal duration was truncated from 60s to 14s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"10860"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:23:51Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:23:51Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/hUqVclWHW50tfhZCZ2M5yhoq", horizon=45.394770194s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11096"}, "reason": "SecretRotated"}
2023-11-29T14:23:51Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11096"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:24:17Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:24:35Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11063"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:24:35Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/jchgPVDb9z8FDSjsEmebPwI3", horizon=43.382667831s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11218"}, "reason": "SecretRotated"}
2023-11-29T14:24:35Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11218"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:24:37Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11096"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:24:37Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/181RKse0vXYgTa6ZCLxRIzT6", horizon=42.132562781s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11258"}, "reason": "SecretRotated"}
2023-11-29T14:24:37Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11258"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:24:41Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:25:06Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:25:18Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11218"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:25:18Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/HduPfaTh1NXbNWPFXyBifpGA", horizon=40.67250693s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11418"}, "reason": "SecretRotated"}
2023-11-29T14:25:18Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11418"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:25:19Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11258"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:25:19Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/qFgl9vk1uSVIGbKO23SKZpB9", horizon=45.830108973s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11452"}, "reason": "SecretRotated"}
2023-11-29T14:25:19Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11452"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:25:30Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:25:56Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:25:59Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11418"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:25:59Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/N18rokb6FpDhR5IkduTwbUDS", horizon=41.666639897s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11616"}, "reason": "SecretRotated"}
2023-11-29T14:25:59Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11616"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:26:05Z	DEBUG	events	Lease renewal duration was truncated from 60s to 14s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11452"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:26:05Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/HmG0AUjCbkBNdz7eaNkF8uAq", horizon=41.953355425s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11712"}, "reason": "SecretRotated"}
2023-11-29T14:26:05Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11712"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:26:23Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:26:41Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11616"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:26:41Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/wPEO6xgcZQ6x9Iv2TuqWaRr6", horizon=41.502232733s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11851"}, "reason": "SecretRotated"}
2023-11-29T14:26:41Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11851"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:26:47Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11712"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:26:47Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/mCzhB2oHQIxTliM4rUI5Dc0q", horizon=41.235953475s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11946"}, "reason": "SecretRotated"}
2023-11-29T14:26:47Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11946"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:26:48Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:27:13Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:27:22Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11851"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:27:22Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/eRQwJqWRuFmBohy386hXNv3D", horizon=42.526910523s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12079"}, "reason": "SecretRotated"}
2023-11-29T14:27:22Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12079"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:27:28Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"11946"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:27:28Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/VeoS4w8IsZuhjwmjlDfAszJ2", horizon=40.252717947s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12171"}, "reason": "SecretRotated"}
2023-11-29T14:27:28Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12171"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:27:39Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:28:04Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:28:05Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12079"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:28:05Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/hB2Xo0nKyfdgTNercBcvXDMG", horizon=45.486130419s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12307"}, "reason": "SecretRotated"}
2023-11-29T14:28:05Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12307"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:28:08Z	DEBUG	events	Lease renewal duration was truncated from 60s to 20s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12171"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:28:08Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/XntPUk2Lq1R1NBtXl4y4GJRS", horizon=44.298187855s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12373"}, "reason": "SecretRotated"}
2023-11-29T14:28:08Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12373"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:28:30Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:28:50Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12307"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:28:50Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/zoLI1ff84kpSWzmSk0nitIP3", horizon=41.023997855s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12532"}, "reason": "SecretRotated"}
2023-11-29T14:28:50Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12532"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:28:52Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12373"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:28:52Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/bG343BeGmOh3TKpMsvBTabZy", horizon=44.537969894s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12571"}, "reason": "SecretRotated"}
2023-11-29T14:28:52Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12571"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:28:55Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:29:22Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:29:31Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12532"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:29:31Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/Zt8ZCIVWHNgQFQuSPnPkvCPT", horizon=41.432873481s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12723"}, "reason": "SecretRotated"}
2023-11-29T14:29:31Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12723"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:29:37Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12571"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:29:37Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/sWXQoWSIHnrpT3SBuJaJA38B", horizon=40.733092702s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12816"}, "reason": "SecretRotated"}
2023-11-29T14:29:37Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12816"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:29:48Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:30:13Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12723"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:30:13Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/3RSeogpTftbee3CUukRv211U", horizon=42.879956601s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12952"}, "reason": "SecretRotated"}
2023-11-29T14:30:13Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12952"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:30:15Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:30:18Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12816"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:30:18Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/7Hlxhhfg7n7jFydAst5nFh05", horizon=41.302181506s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13037"}, "reason": "SecretRotated"}
2023-11-29T14:30:18Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13037"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:30:40Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:30:56Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"12952"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:30:56Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/yao71J1Bgh4bvjbb7Fm3TJTz", horizon=42.460447896s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13179"}, "reason": "SecretRotated"}
2023-11-29T14:30:56Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13179"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:30:59Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13037"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:30:59Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/xSkMKOMGnqAaJzVoQzVgwv5o", horizon=42.406217642s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13250"}, "reason": "SecretRotated"}
2023-11-29T14:30:59Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13250"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:31:04Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:31:31Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:31:38Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13179"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:31:38Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/EAvrZYqSIUzaacovXW9fi1SS", horizon=45.623175833s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13403"}, "reason": "SecretRotated"}
2023-11-29T14:31:38Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13403"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:31:42Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13250"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:31:42Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/5GDY1HnSVfMETMSUG9TqmdLb", horizon=42.630429298s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13466"}, "reason": "SecretRotated"}
2023-11-29T14:31:42Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13466"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:31:57Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:32:21Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:32:24Z	DEBUG	events	Lease renewal duration was truncated from 60s to 14s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13403"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:32:24Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/LHe1150DZJdupC2u0APBhLKo", horizon=43.180775723s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13626"}, "reason": "SecretRotated"}
2023-11-29T14:32:24Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13626"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:32:24Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13466"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:32:24Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/0dfc5ywpTyHgmbQCwlcx0XyN", horizon=44.129688769s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13657"}, "reason": "SecretRotated"}
2023-11-29T14:32:24Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13657"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:32:48Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:33:07Z	DEBUG	events	Lease renewal duration was truncated from 60s to 17s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13626"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:33:07Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/2uOkSB8KsQmvlFCwbBI4diK7", horizon=44.678188625s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13773"}, "reason": "SecretRotated"}
2023-11-29T14:33:07Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13773"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:33:08Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13657"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:33:08Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/Er3ZiKSC6jZCtP1CPPdnsyQc", horizon=44.118420657s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13808"}, "reason": "SecretRotated"}
2023-11-29T14:33:08Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13808"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:33:13Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:33:39Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:33:52Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13773"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:33:52Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/z9vpgtU8NSnsIymaSa43h3r7", horizon=43.618120474s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13966"}, "reason": "SecretRotated"}
2023-11-29T14:33:52Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13966"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:33:52Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13808"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:33:52Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/iY4tkmttrJybnlJDQi3NETqF", horizon=44.105652582s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13997"}, "reason": "SecretRotated"}
2023-11-29T14:33:52Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13997"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:34:05Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:34:29Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:34:36Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13966"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:34:36Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/8YXFu39xGAuq1OGbR3LlW8ph", horizon=44.882723896s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14115"}, "reason": "SecretRotated"}
2023-11-29T14:34:36Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14115"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:34:37Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"13997"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:34:37Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/CgRbftJecFhs0xOWdhlkYq7z", horizon=41.076188852s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14150"}, "reason": "SecretRotated"}
2023-11-29T14:34:37Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14150"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:34:53Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:35:18Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14150"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:35:18Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/sNBeT3WZcWsaCC3XpBS3WGEt", horizon=40.352001079s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14309"}, "reason": "SecretRotated"}
2023-11-29T14:35:18Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14309"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:35:18Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:35:20Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14115"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:35:20Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/875ZWvYLoQdpP1baS2IZ067t", horizon=43.421430481s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14349"}, "reason": "SecretRotated"}
2023-11-29T14:35:20Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14349"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:35:44Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:35:58Z	DEBUG	events	Lease renewal duration was truncated from 60s to 20s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14309"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:35:58Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/dtvvjcqde2ZkrCGg8m74ABXc", horizon=44.459108576s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14499"}, "reason": "SecretRotated"}
2023-11-29T14:35:58Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14499"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:36:04Z	DEBUG	events	Lease renewal duration was truncated from 60s to 16s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14349"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:36:04Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/3iQ1a9Xv0dZ8oqpgmte6xRrd", horizon=42.316278941s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14584"}, "reason": "SecretRotated"}
2023-11-29T14:36:04Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14584"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:36:08Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:36:34Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:36:43Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14499"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:36:43Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/kCKjU8DbD8LWoeYcBDIZlqoG", horizon=41.143258952s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14728"}, "reason": "SecretRotated"}
2023-11-29T14:36:43Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14728"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:36:46Z	DEBUG	events	Lease renewal duration was truncated from 60s to 18s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14584"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:36:46Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/flOEdh9g8UYG7EvdbYjPFrkn", horizon=40.700845435s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14792"}, "reason": "SecretRotated"}
2023-11-29T14:36:46Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14792"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:36:59Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:37:23Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:37:24Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14728"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:37:24Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/T0JxbVGSg01ndV12imbvZsIy", horizon=44.742764432s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14947"}, "reason": "SecretRotated"}
2023-11-29T14:37:24Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14947"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:37:27Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14792"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:37:27Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/gxIATGFSJq47Beu6BKopfeji", horizon=40.474637741s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14988"}, "reason": "SecretRotated"}
2023-11-29T14:37:27Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14988"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:37:48Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:38:08Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14988"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:38:08Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/BQjMBgxNo7xIiLlFG8Z4dXAw", horizon=44.956760928s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15139"}, "reason": "SecretRotated"}
2023-11-29T14:38:08Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15139"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:38:09Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"14947"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:38:09Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/zYjS8M5KZuH0ywORLMJfYP2s", horizon=41.320373123s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15175"}, "reason": "SecretRotated"}
2023-11-29T14:38:09Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15175"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:38:14Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:38:39Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}
2023-11-29T14:38:50Z	DEBUG	events	Lease renewal duration was truncated from 60s to 19s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15175"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:38:50Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/ayUaeG72lKLDi05cfw2aYWU1", horizon=41.592291521s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15330"}, "reason": "SecretRotated"}
2023-11-29T14:38:50Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo-create","uid":"61490dbf-48f7-436d-8ca1-232651d85d04","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15330"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:38:53Z	DEBUG	events	Lease renewal duration was truncated from 60s to 15s, requesting new credentials	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15139"}, "reason": "SecretLeaseRenewal"}
2023-11-29T14:38:53Z	DEBUG	events	Secret synced, lease_id="demo-db/creds/dev-postgres/m3M0howaFeJCjwDeYsiYetJy", horizon=41.572478356s	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15393"}, "reason": "SecretRotated"}
2023-11-29T14:38:53Z	DEBUG	events	Rollout restart triggered for {Deployment vso-db-demo}	{"type": "Normal", "object": {"kind":"VaultDynamicSecret","namespace":"demo-ns","name":"vso-db-demo","uid":"4bbc7560-912b-4281-a14c-8dc2ad047695","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"15393"}, "reason": "RolloutRestartTriggered"}
2023-11-29T14:39:04Z	DEBUG	events	Secret sync not required	{"type": "Normal", "object": {"kind":"VaultStaticSecret","namespace":"app","name":"vault-kv-app","uid":"1ca2e662-5eef-46c1-a31e-2da09d571979","apiVersion":"secrets.hashicorp.com/v1beta1","resourceVersion":"9591"}, "reason": "SecretSync"}

Expected behavior The service using secret shouldn't throw GCP invalid JWT error

Environment

  • Kubernetes version: 1.26.7-gke.500
    • Distribution or cloud vendor (OpenShift, EKS, GKE, AKS, etc.): GKE
    • Other configuration options or runtime services (istio, etc.): N/A
  • vault-secrets-operator version: 0.4.0
  • Vault server version 14.1

Additional context For the token has ttl=24h and max_ttl=24h the backup service works, but sometimes the token invalid for some minutes or some hours before it get back and I don't know the reason why.

duong-se avatar Nov 29 '23 12:11 duong-se

@duong-se please let is know if this still an issue for you.

Just an FYI, VSO does not currently support Vault tokens that have a max_ttl set when syncing dynamic secrets. We recommend configuring the auth role using a token period in place of the max_ttl

benashz avatar Jan 18 '24 17:01 benashz

@duong-se please let is know if this still an issue for you.

Just an FYI, VSO does not currently support Vault tokens that have a max_ttl set when syncing dynamic secrets. We recommend configuring the auth role using a token period in place of the max_ttl

@benashz Yes, it's still our issue. So I'll check with the config auth role using the period as you recommend.

duong-se avatar Jan 19 '24 07:01 duong-se

Hi @benashz, does this PR solved the max_ttl problem?

duong-se avatar Mar 14 '24 09:03 duong-se

Hi @benashz, does this PR solved the max_ttl problem?

@duong-se I don't believe it does. Adding general support for max_ttl'd tokens is something that we are planning to do.

benashz avatar Mar 14 '24 17:03 benashz

@benashz I can use it without max_ttl for database role and kubernetes max_ttl role. So I'll let this issue for supporting max_ttl.

duong-se avatar May 23 '24 08:05 duong-se

@benashz I can use it without max_ttl for database role and kubernetes max_ttl role. So I'll let this issue for supporting max_ttl.

Hi @duong-se, as of v0.6.0, VSO supports Vault roles/auth with a max_ttl set, so I think we can probably close this issue out.

benashz avatar May 23 '24 17:05 benashz

In our case, we use an internal operator to control the deployments. When a rollout is restarted by adding the vso.secrets.hashicorp.com/restartedAt annotation to deployments, our controller detects the changes and re-syncs again by removing that annotation. This race condition sometimes causes services not to restart properly. So we need to whitelist the annotation for avoiding resync for our internal operator.

duong-se avatar Aug 08 '24 07:08 duong-se