k8s
k8s copied to clipboard
Published
20 hours ago •
ory
ory
Hydra fails to run migration when `helm --atomic` is used
Preflight checklist
- [X] I could not find a solution in the existing issues, docs, nor discussions.
- [X] I agree to follow this project's Code of Conduct.
- [X] I have read and am following this repository's Contribution Guidelines.
- [ ] This issue affects my Ory Cloud project.
- [ ] I have joined the Ory Community Slack.
- [ ] I am signed up to the Ory Security Patch Newsletter.
Describe the bug
Trying to install hydra with helm, postgres logs get a bunch of errors
Reproducing the bug
Create an empty database in postgres Run:
helm install \
--debug \
--atomic \
--namespace hydra \
--create-namespace \
--set 'hydra.autoMigrate=true' \
--set 'hydra.config.dsn=postgres://user:[email protected]/hydra?sslmode=require' \
hydra ory/hydra
Relevant log output
HELM OUTPUT
install.go:178: [debug] Original chart version: ""
install.go:195: [debug] CHART PATH: /home/osric/.cache/helm/repository/hydra-0.23.2.tgz
client.go:128: [debug] creating 1 resource(s)
install.go:151: [debug] CRD oauth2clients.hydra.ory.sh is already present. Skipping.
client.go:128: [debug] creating 1 resource(s)
client.go:299: [debug] Starting delete for "hydra" Secret
client.go:128: [debug] creating 1 resource(s)
client.go:299: [debug] Starting delete for "hydra-job" ServiceAccount
client.go:128: [debug] creating 1 resource(s)
client.go:299: [debug] Starting delete for "hydra-automigrate" Job
client.go:328: [debug] jobs.batch "hydra-automigrate" not found
client.go:128: [debug] creating 1 resource(s)
client.go:529: [debug] Watching for changes to Job hydra-automigrate with timeout of 5m0s
client.go:557: [debug] Add/Modify event for hydra-automigrate: ADDED
client.go:596: [debug] hydra-automigrate: Jobs active: 0, jobs failed: 0, jobs succeeded: 0
client.go:557: [debug] Add/Modify event for hydra-automigrate: MODIFIED
client.go:596: [debug] hydra-automigrate: Jobs active: 1, jobs failed: 0, jobs succeeded: 0
client.go:557: [debug] Add/Modify event for hydra-automigrate: MODIFIED
client.go:596: [debug] hydra-automigrate: Jobs active: 0, jobs failed: 0, jobs succeeded: 0
client.go:557: [debug] Add/Modify event for hydra-automigrate: MODIFIED
client.go:299: [debug] Starting delete for "hydra-automigrate" Job
client.go:128: [debug] creating 11 resource(s)
wait.go:48: [debug] beginning wait for 11 resources with timeout of 5m0s
ready.go:277: [debug] Deployment is not ready: hydra/hydra-hydra-maester. 0 out of 1 expected pods are ready
ready.go:277: [debug] Deployment is not ready: hydra/hydra-hydra-maester. 0 out of 1 expected pods are ready
ready.go:277: [debug] Deployment is not ready: hydra/hydra. 0 out of 1 expected pods are ready
ready.go:277: [debug] Deployment is not ready: hydra/hydra. 0 out of 1 expected pods are ready
ready.go:277: [debug] Deployment is not ready: hydra/hydra. 0 out of 1 expected pods are ready
POSTGRES LOG
2022-06-13 08:56:07.369 GMT [ 2 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra LOG: connection authenticated: identity="hydra_web" method=scram-sha-256 (/etc/postgresql/pg_hba.conf:4)
2022-06-13 08:56:07.369 GMT [ 3 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra LOG: connection authorized: user=hydra_web database=hydra SSL enabled (protocol=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384, bits=256)
2022-06-13 08:56:07.384 GMT [ 4 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "hydra_client_migration" does not exist at character 15
2022-06-13 08:56:07.384 GMT [ 5 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT * FROM hydra_client_migration
2022-06-13 08:56:07.393 GMT [ 6 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.393 GMT [ 7 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.395 GMT [ 8 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.395 GMT [ 9 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.397 GMT [ 10 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.397 GMT [ 11 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.398 GMT [ 12 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.398 GMT [ 13 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.400 GMT [ 14 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.400 GMT [ 15 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.400 GMT [ 16 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.400 GMT [ 17 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.401 GMT [ 18 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.401 GMT [ 19 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.402 GMT [ 20 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.402 GMT [ 21 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.403 GMT [ 22 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.403 GMT [ 23 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.404 GMT [ 24 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.404 GMT [ 25 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.404 GMT [ 26 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.404 GMT [ 27 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.405 GMT [ 28 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.405 GMT [ 29 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.407 GMT [ 30 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.407 GMT [ 31 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.408 GMT [ 32 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.408 GMT [ 33 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.408 GMT [ 34 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.408 GMT [ 35 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.409 GMT [ 36 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.409 GMT [ 37 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.410 GMT [ 38 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.410 GMT [ 39 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.410 GMT [ 40 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.410 GMT [ 41 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.411 GMT [ 42 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.411 GMT [ 43 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.412 GMT [ 44 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.412 GMT [ 45 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.413 GMT [ 46 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.413 GMT [ 47 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.413 GMT [ 48 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.413 GMT [ 49 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.414 GMT [ 50 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.414 GMT [ 51 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.414 GMT [ 52 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.414 GMT [ 53 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.415 GMT [ 54 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.415 GMT [ 55 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.416 GMT [ 56 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.416 GMT [ 57 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.416 GMT [ 58 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.416 GMT [ 59 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.416 GMT [ 60 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.416 GMT [ 61 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.417 GMT [ 62 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.417 GMT [ 63 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.417 GMT [ 64 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.417 GMT [ 65 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.421 GMT [ 66 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.421 GMT [ 67 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.422 GMT [ 68 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.422 GMT [ 69 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.423 GMT [ 70 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.423 GMT [ 71 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.425 GMT [ 72 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.425 GMT [ 73 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.427 GMT [ 74 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.427 GMT [ 75 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.428 GMT [ 76 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.428 GMT [ 77 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.428 GMT [ 78 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.428 GMT [ 79 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.429 GMT [ 80 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.429 GMT [ 81 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.431 GMT [ 82 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.431 GMT [ 83 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.432 GMT [ 84 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.432 GMT [ 85 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.433 GMT [ 86 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.433 GMT [ 87 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.434 GMT [ 88 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.434 GMT [ 89 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.434 GMT [ 90 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.434 GMT [ 91 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.434 GMT [ 92 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.434 GMT [ 93 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.434 GMT [ 94 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.434 GMT [ 95 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.434 GMT [ 96 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.434 GMT [ 97 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.435 GMT [ 98 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.435 GMT [ 99 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.435 GMT [100 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.435 GMT [101 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.436 GMT [102 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.436 GMT [103 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.436 GMT [104 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 47
2022-06-13 08:56:07.436 GMT [105 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT EXISTS (SELECT schema_migration.* FROM schema_migration AS schema_migration WHERE version = $1)
2022-06-13 08:56:07.438 GMT [106 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "hydra_client_migration" does not exist at character 15
2022-06-13 08:56:07.438 GMT [107 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: SELECT * FROM hydra_client_migration
2022-06-13 08:56:07.438 GMT [108 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra ERROR: relation "schema_migration" does not exist at character 21
2022-06-13 08:56:07.438 GMT [109 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra STATEMENT: select version from schema_migration
2022-06-13 08:56:08.294 GMT [110 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra LOG: could not receive data from client: Connection reset by peer
2022-06-13 08:56:08.296 GMT [111 62a6fba7.16f client backend] 10.42.0.60 hydra_web [unknown] hydra LOG: disconnection: session time: 0:00:00.957 user=hydra_web database=hydra host=10.42.0.60 port=33022
Relevant configuration
No response
Version
helm hydra-0.23.2
On which operating system are you observing this issue?
Linux
In which environment are you deploying?
Kubernetes with Helm
Additional Context
No response
Best I can grab (helm is eager to delete the migration job pod)
$ kubectl -n hydra logs -l job-name=hydra-automigrate --follow
20190400000010000000 oauth2 Applied
20190400000011000000 oauth2 Applied
20200521071434000000 consent Applied
20200527215731000000 client Applied
20200527215732000000 client Applied
20200819163013000000 add_client_id_subject_idx_to_access_and_refresh Applied
20200913192340000000 initial_sqlite Applied
20201110104000000000 drop_uq_oauth2 Applied
20201116133000000000 set_null_time Applied
Successfully applied migrations!
I'll add that removing the --atomic option from helm control seems to have fixed it. :shrug:
So omitting the --atomic flag worked? Is this encouraged somewhere in our docs?
Not obviously (no useful hits for 'atomic' searching in this repo and ory/k8s).
I'd still call failing under 'atomic' a bug - running helm uninstall -n hydra hydra isn't a terrible burden, but I forgot it more than once in this mornings 'tweak/test/tidy' cycle.
Hi there, this looks quite weird 🤔. I have added the --atomic flag to the testing suite we have in the k8s repo, and the installation progressed as expected without any issues with the postgres db we use.
https://github.com/ory/k8s/commit/f7ca31b45f2313f5e304abf4f45ed92a7ea65102
