swarmkit icon indicating copy to clipboard operation
swarmkit copied to clipboard
verified publisher icon moby

postgresql corrupted when scheduled via docker stack deploy

Open intelliIT opened this issue 10 months ago • 0 comments

i came across a weird issue, i am not even sure this is the right place to report. if not, please point me where to report.

i know that this setup is probably architecturally pretty stupid, but i am stuck with it for now.

i tried to run a postgresql with a pvc on cephfs via bind-mount. this db is not heavily loaded, just some userdata. this is working fine when using docker run or docker compose. as soon as i use docker stack deploy to run it across my swarm the postgresql container is not working properly; the database seems to be initialized but is not found/corrupt. the service starts 2 containers, one after the other terminates. the first one initializes the database-directory, terminates (i have no idea if it is supposed to, but it seems to be gracefully), a new container spawns, sees the directory-structure initialized, but cant find the database. if i initialize via docker run or docker compose the structure seems to be intact and the service via docker stack deploy can access the database.

logs/infos:


root@docker-node-1:~/postgres-debug# docker stack ps postgres-test
ID             NAME                              IMAGE                NODE            DESIRED STATE   CURRENT STATE            ERROR                              PORTS
256y77bjuzg0   postgres-test_postgres-db.1       postgres:17-alpine   docker-node-3   Running         Running 45 seconds ago
5nhagjokkh5m    \_ postgres-test_postgres-db.1   postgres:17-alpine   docker-node-3   Shutdown        Failed 56 seconds ago    "task: non-zero exit (137): do…"
debug_1.log 

postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | Running in debug mode.
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | The files belonging to this database system will be owned by user "postgres".
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | This user must also own the server process.
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | The database cluster will be initialized with locale "en_US.utf8".
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | The default database encoding has accordingly been set to "UTF8".
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | The default text search configuration will be set to "english".
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | Data page checksums are disabled.
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | fixing permissions on existing directory /var/lib/postgresql/data/pgdata ... ok
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | VERSION=17.2
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | PGDATA=/var/lib/postgresql/data/pgdata
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | share_path=/usr/local/share/postgresql
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | PGPATH=/usr/local/bin
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | POSTGRES_SUPERUSERNAME=postgres
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | POSTGRES_BKI=/usr/local/share/postgresql/postgres.bki
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | POSTGRESQL_CONF_SAMPLE=/usr/local/share/postgresql/postgresql.conf.sample
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | PG_HBA_SAMPLE=/usr/local/share/postgresql/pg_hba.conf.sample
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | PG_IDENT_SAMPLE=/usr/local/share/postgresql/pg_ident.conf.sample
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | creating subdirectories ... ok
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | selecting dynamic shared memory implementation ... posix
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | selecting default "max_connections" ... 100
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | selecting default "shared_buffers" ... 128MB
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | selecting default time zone ... UTC
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | creating configuration files ... ok
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.231 UTC [35] DEBUG:  invoking IpcMemoryCreate(size=149856256)
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.232 UTC [35] DEBUG:  mmap(150994944) with MAP_HUGETLB failed, huge pages disabled: Out of memory
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.251 UTC [35] DEBUG:  dynamic shared memory system will support 674 segments
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.251 UTC [35] DEBUG:  created dynamic shared memory control segment 46791814 (26976 bytes)
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.251 UTC [35] DEBUG:  transaction ID wrap limit is 2147483650, limited by database with OID 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.251 UTC [35] DEBUG:  MultiXactId wrap limit is 2147483648, limited by database with OID 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:42.251 UTC [35] DEBUG:  creating and filling new WAL file
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.009 UTC [35] DEBUG:  done creating and filling new WAL file
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  InitPostgres
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] NOTICE:  database system was shut down at 2025-02-04 14:24:42 UTC
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  checkpoint record is at 0/1000028
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  redo record is at 0/1000028; shutdown true
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  next transaction ID: 3; next OID: 10000
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  next MultiXactId: 1; next MultiXactOffset: 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  oldest unfrozen transaction ID: 3, in database 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  oldest MultiXactId: 1, in database 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  commit timestamp Xid oldest/newest: 0/0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  transaction ID wrap limit is 2147483650, limited by database with OID 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.100 UTC [35] DEBUG:  MultiXactId wrap limit is 2147483648, limited by database with OID 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.101 UTC [35] DEBUG:  starting up replication slots
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.101 UTC [35] DEBUG:  xmin required by slots: data 0, catalog 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.101 UTC [35] DEBUG:  starting up replication origin progress state
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.101 UTC [35] DEBUG:  reading stats file "pg_stat/pgstat.stat"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.101 UTC [35] DEBUG:  MultiXactId wrap limit is 2147483648, limited by database with OID 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.101 UTC [35] DEBUG:  MultiXact member stop limit is now 4294914944 based on MultiXact 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  cache state reset
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  StartTransaction(1) name: unnamed; blockState: DEFAULT; state: INPROGRESS, xid/subid/cid: 0/1/0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  creating bootstrap relation pg_proc 1255
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column oid oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proname name
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column pronamespace oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proowner oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prolang oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column procost float4
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prorows float4
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column provariadic oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prosupport regproc
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prokind char
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prosecdef bool
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proleakproof bool
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proisstrict bool
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proretset bool
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column provolatile char
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proparallel char
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column pronargs int2
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column pronargdefaults int2
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prorettype oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proargtypes oidvector
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proallargtypes _oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proargmodes _char
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proargnames _text
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proargdefaults pg_node_tree
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column protrftypes _oid
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prosrc text
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column probin text
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column prosqlbody pg_node_tree
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proconfig _text
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  column proacl _aclitem
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  bootstrap relation created
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting row
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting column 0 value "1242"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserted -> 1242
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting column 1 value "boolin"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserted -> boolin
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting column 2 value "11"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserted -> 11
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting column 3 value "10"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserted -> 10
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting column 4 value "12"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserted -> 12
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.114 UTC [35] DEBUG:  inserting column 5 value "1"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 6 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 7 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 8 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> -
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 9 value "f"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> f
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 10 value "f"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> f
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 11 value "f"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> f
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 12 value "t"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> t
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 13 value "f"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> f
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 14 value "i"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> i
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 15 value "s"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> s
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 16 value "1"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 17 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 18 value "16"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 16
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 19 value "2275"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> 2275
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 20 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 21 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 22 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 23 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 24 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 25 value "boolin"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserted -> boolin
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 26 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 27 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 28 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting column 29 NULL
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.115 UTC [35] DEBUG:  inserting row with 30 columns
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  row inserted
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting row
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 0 value "1243"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 1243
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 1 value "boolout"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> boolout
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 2 value "11"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 11
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 3 value "10"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 10
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 4 value "12"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 12
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 5 value "1"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 1
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 6 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 7 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> 0
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 8 value "0"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> -
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserting column 9 value "f"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:43.127 UTC [35] DEBUG:  inserted -> f

[..]

postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.690 UTC [35] DEBUG:  building index "pg_toast_2604_index" on table "pg_toast_2604" serially
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.690 UTC [35] DEBUG:  index "pg_toast_2604_index" can safely use deduplication
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.706 UTC [35] DEBUG:  building index "pg_toast_1247_index" on table "pg_toast_1247" serially
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.706 UTC [35] DEBUG:  index "pg_toast_1247_index" can safely use deduplication
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.720 UTC [35] DEBUG:  building index "pg_toast_1255_index" on table "pg_toast_1255" serially
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.720 UTC [35] DEBUG:  index "pg_toast_1255_index" can safely use deduplication
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.734 UTC [35] DEBUG:  CommitTransaction(1) name: unnamed; blockState: STARTED; state: INPROGRESS, xid/subid/cid: 1/1/256
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.776 UTC [35] DEBUG:  shmem_exit(0): 6 before_shmem_exit callbacks to make
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.776 UTC [35] NOTICE:  shutting down
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:49.792 UTC [35] DEBUG:  performing replication slot checkpoint
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.411 UTC [35] DEBUG:  attempting to remove WAL segments older than log file 000000000000000000000000
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.411 UTC [35] DEBUG:  SlruScanDirectory invoking callback on pg_subtrans/0000
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.411 UTC [35] DEBUG:  writing stats file "pg_stat/pgstat.stat"
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.606 UTC [35] DEBUG:  shmem_exit(0): 12 on_shmem_exit callbacks to make
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.606 UTC [35] DEBUG:  cleaning up orphaned dynamic shared memory with ID 2789182942
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.606 UTC [35] DEBUG:  cleaning up dynamic shared memory control segment with ID 46791814
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.608 UTC [35] DEBUG:  proc_exit(0): 2 callbacks to make
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.608 UTC [35] NOTICE:  database system is shut down
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.608 UTC [35] DEBUG:  exit(0)
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.608 UTC [35] DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.608 UTC [35] DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:52.608 UTC [35] DEBUG:  proc_exit(-1): 0 callbacks to make
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | running bootstrap script ... ok
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | sh: locale: not found
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | 2025-02-04 14:24:58.139 UTC [48] WARNING:  no usable system locales were found
postgres-test_postgres-db.1.mkmtmoakb2wb@docker-node-2    | performing post-bootstrap initialization ...
debug_2.log 

postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | PostgreSQL Database directory appears to contain a database; Skipping initialization
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.835 UTC [1] LOG:  starting PostgreSQL 17.2 on x86_64-pc-linux-musl, compiled by gcc (Alpine 14.2.0) 14.2.0, 64-bit
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.835 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.835 UTC [1] LOG:  listening on IPv6 address "::", port 5432
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.888 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.925 UTC [29] LOG:  database system was interrupted; last known up at 2025-02-04 14:25:17 UTC
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.959 UTC [29] LOG:  database system was not properly shut down; automatic recovery in progress
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.980 UTC [29] LOG:  redo starts at 0/14EA7B8
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.980 UTC [29] LOG:  invalid record length at 0/14EA888: expected at least 24, got 0
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.980 UTC [29] LOG:  redo done at 0/14EA810 system usage: CPU: user: 0.00 s, system: 0.00 s, elapsed: 0.00 s
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:25.998 UTC [27] LOG:  checkpoint starting: end-of-recovery immediate wait
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:26.109 UTC [27] LOG:  checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.039 s, sync=0.001 s, total=0.126 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB; lsn=0/14EA888, redo lsn=0/14EA888
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:26.125 UTC [1] LOG:  database system is ready to accept connections
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:30.860 UTC [39] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:35.895 UTC [46] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:40.931 UTC [53] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:45.964 UTC [60] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:51.002 UTC [67] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:25:56.034 UTC [74] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:01.071 UTC [81] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:06.114 UTC [88] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:11.149 UTC [95] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:16.185 UTC [102] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:21.217 UTC [109] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:26.254 UTC [116] FATAL:  database "postgres" does not exist
postgres-test_postgres-db.1.rg6r7hvlyplt@docker-node-2    | 2025-02-04 14:26:31.291 UTC [123] FATAL:  database "postgres" does not exist
debug_compose.log 

Starting postgres-debug_postgres-db_1 ... 
Starting postgres-debug_postgres-db_1 ... done
Attaching to postgres-debug_postgres-db_1
[36mpostgres-db_1  |[0m Running in debug mode.
[36mpostgres-db_1  |[0m The files belonging to this database system will be owned by user "postgres".
[36mpostgres-db_1  |[0m This user must also own the server process.
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m VERSION=17.2
[36mpostgres-db_1  |[0m PGDATA=/var/lib/postgresql/data/pgdata
[36mpostgres-db_1  |[0m share_path=/usr/local/share/postgresql
[36mpostgres-db_1  |[0m PGPATH=/usr/local/bin
[36mpostgres-db_1  |[0m POSTGRES_SUPERUSERNAME=postgres
[36mpostgres-db_1  |[0m POSTGRES_BKI=/usr/local/share/postgresql/postgres.bki
[36mpostgres-db_1  |[0m POSTGRESQL_CONF_SAMPLE=/usr/local/share/postgresql/postgresql.conf.sample
[36mpostgres-db_1  |[0m PG_HBA_SAMPLE=/usr/local/share/postgresql/pg_hba.conf.sample
[36mpostgres-db_1  |[0m PG_IDENT_SAMPLE=/usr/local/share/postgresql/pg_ident.conf.sample
[36mpostgres-db_1  |[0m The database cluster will be initialized with locale "en_US.utf8".
[36mpostgres-db_1  |[0m The default database encoding has accordingly been set to "UTF8".
[36mpostgres-db_1  |[0m The default text search configuration will be set to "english".
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m Data page checksums are disabled.
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m fixing permissions on existing directory /var/lib/postgresql/data/pgdata ... ok
[36mpostgres-db_1  |[0m creating subdirectories ... ok
[36mpostgres-db_1  |[0m selecting dynamic shared memory implementation ... posix
[36mpostgres-db_1  |[0m selecting default "max_connections" ... 100
[36mpostgres-db_1  |[0m selecting default "shared_buffers" ... 128MB
[36mpostgres-db_1  |[0m selecting default time zone ... UTC
[36mpostgres-db_1  |[0m creating configuration files ... ok
[36mpostgres-db_1  |[0m running bootstrap script ... 2025-02-04 15:14:54.344 UTC [35] DEBUG:  invoking IpcMemoryCreate(size=149856256)
[36mpostgres-db_1  |[0m 2025-02-04 15:14:54.344 UTC [35] DEBUG:  mmap(150994944) with MAP_HUGETLB failed, huge pages disabled: Out of memory
[36mpostgres-db_1  |[0m 2025-02-04 15:14:54.367 UTC [35] DEBUG:  dynamic shared memory system will support 674 segments
[36mpostgres-db_1  |[0m 2025-02-04 15:14:54.367 UTC [35] DEBUG:  created dynamic shared memory control segment 1017165568 (26976 bytes)
[36mpostgres-db_1  |[0m 2025-02-04 15:14:54.367 UTC [35] DEBUG:  transaction ID wrap limit is 2147483650, limited by database with OID 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:54.367 UTC [35] DEBUG:  MultiXactId wrap limit is 2147483648, limited by database with OID 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:54.368 UTC [35] DEBUG:  creating and filling new WAL file
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.195 UTC [35] DEBUG:  done creating and filling new WAL file
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  InitPostgres
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] NOTICE:  database system was shut down at 2025-02-04 15:14:54 UTC
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  checkpoint record is at 0/1000028
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  redo record is at 0/1000028; shutdown true
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  next transaction ID: 3; next OID: 10000
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  next MultiXactId: 1; next MultiXactOffset: 0
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  oldest unfrozen transaction ID: 3, in database 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  oldest MultiXactId: 1, in database 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  commit timestamp Xid oldest/newest: 0/0
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  transaction ID wrap limit is 2147483650, limited by database with OID 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  MultiXactId wrap limit is 2147483648, limited by database with OID 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.257 UTC [35] DEBUG:  starting up replication slots
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.258 UTC [35] DEBUG:  xmin required by slots: data 0, catalog 0
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.258 UTC [35] DEBUG:  starting up replication origin progress state
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.259 UTC [35] DEBUG:  reading stats file "pg_stat/pgstat.stat"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.259 UTC [35] DEBUG:  MultiXactId wrap limit is 2147483648, limited by database with OID 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.259 UTC [35] DEBUG:  MultiXact member stop limit is now 4294914944 based on MultiXact 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  cache state reset
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  StartTransaction(1) name: unnamed; blockState: DEFAULT; state: INPROGRESS, xid/subid/cid: 0/1/0
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  creating bootstrap relation pg_proc 1255
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column oid oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proname name
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column pronamespace oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proowner oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prolang oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column procost float4
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prorows float4
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column provariadic oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prosupport regproc
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prokind char
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prosecdef bool
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proleakproof bool
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proisstrict bool
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proretset bool
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column provolatile char
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proparallel char
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column pronargs int2
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column pronargdefaults int2
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prorettype oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proargtypes oidvector
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proallargtypes _oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proargmodes _char
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proargnames _text
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proargdefaults pg_node_tree
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column protrftypes _oid
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prosrc text
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column probin text
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column prosqlbody pg_node_tree
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proconfig _text
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  column proacl _aclitem
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  bootstrap relation created
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting row
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 0 value "1242"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 1242
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 1 value "boolin"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> boolin
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 2 value "11"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 11
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 3 value "10"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 10
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 4 value "12"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 12
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 5 value "1"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 1
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 6 value "0"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 0
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 7 value "0"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserted -> 0
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.270 UTC [35] DEBUG:  inserting column 8 value "0"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserted -> -
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserting column 9 value "f"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserted -> f
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserting column 10 value "f"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserted -> f
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserting column 11 value "f"
[36mpostgres-db_1  |[0m 2025-02-04 15:14:55.271 UTC [35] DEBUG:  inserted -> f

[..]

[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.585 UTC [35] DEBUG:  index "pg_toast_2600_index" can safely use deduplication
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.599 UTC [35] DEBUG:  building index "pg_toast_2612_index" on table "pg_toast_2612" serially
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.599 UTC [35] DEBUG:  index "pg_toast_2612_index" can safely use deduplication
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.616 UTC [35] DEBUG:  building index "pg_toast_2606_index" on table "pg_toast_2606" serially
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.616 UTC [35] DEBUG:  index "pg_toast_2606_index" can safely use deduplication
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.634 UTC [35] DEBUG:  building index "pg_toast_2604_index" on table "pg_toast_2604" serially
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.634 UTC [35] DEBUG:  index "pg_toast_2604_index" can safely use deduplication
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.650 UTC [35] DEBUG:  building index "pg_toast_1247_index" on table "pg_toast_1247" serially
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.650 UTC [35] DEBUG:  index "pg_toast_1247_index" can safely use deduplication
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.670 UTC [35] DEBUG:  building index "pg_toast_1255_index" on table "pg_toast_1255" serially
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.670 UTC [35] DEBUG:  index "pg_toast_1255_index" can safely use deduplication
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.687 UTC [35] DEBUG:  CommitTransaction(1) name: unnamed; blockState: STARTED; state: INPROGRESS, xid/subid/cid: 1/1/256
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.729 UTC [35] DEBUG:  shmem_exit(0): 6 before_shmem_exit callbacks to make
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.729 UTC [35] NOTICE:  shutting down
[36mpostgres-db_1  |[0m 2025-02-04 15:15:02.743 UTC [35] DEBUG:  performing replication slot checkpoint
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.037 UTC [35] DEBUG:  attempting to remove WAL segments older than log file 000000000000000000000000
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.037 UTC [35] DEBUG:  SlruScanDirectory invoking callback on pg_subtrans/0000
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.037 UTC [35] DEBUG:  writing stats file "pg_stat/pgstat.stat"
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.301 UTC [35] DEBUG:  shmem_exit(0): 12 on_shmem_exit callbacks to make
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.301 UTC [35] DEBUG:  cleaning up orphaned dynamic shared memory with ID 1211870414
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.301 UTC [35] DEBUG:  cleaning up dynamic shared memory control segment with ID 1017165568
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.303 UTC [35] DEBUG:  proc_exit(0): 2 callbacks to make
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.303 UTC [35] NOTICE:  database system is shut down
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.303 UTC [35] DEBUG:  exit(0)
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.303 UTC [35] DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.303 UTC [35] DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
[36mpostgres-db_1  |[0m 2025-02-04 15:15:06.303 UTC [35] DEBUG:  proc_exit(-1): 0 callbacks to make
[36mpostgres-db_1  |[0m ok
[36mpostgres-db_1  |[0m performing post-bootstrap initialization ... sh: locale: not found
[36mpostgres-db_1  |[0m 2025-02-04 15:15:12.438 UTC [48] WARNING:  no usable system locales were found
[36mpostgres-db_1  |[0m ok
[36mpostgres-db_1  |[0m syncing data to disk ... ok
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m Success. You can now start the database server using:
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m     pg_ctl -D /var/lib/postgresql/data/pgdata -l logfile start
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m initdb: warning: enabling "trust" authentication for local connections
[36mpostgres-db_1  |[0m initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.
[36mpostgres-db_1  |[0m waiting for server to start....2025-02-04 15:15:34.284 UTC [90] LOG:  starting PostgreSQL 17.2 on x86_64-pc-linux-musl, compiled by gcc (Alpine 14.2.0) 14.2.0, 64-bit
[36mpostgres-db_1  |[0m 2025-02-04 15:15:34.325 UTC [90] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
[36mpostgres-db_1  |[0m 2025-02-04 15:15:34.364 UTC [93] LOG:  database system was shut down at 2025-02-04 15:15:33 UTC
[36mpostgres-db_1  |[0m 2025-02-04 15:15:34.379 UTC [90] LOG:  database system is ready to accept connections
[36mpostgres-db_1  |[0m  done
[36mpostgres-db_1  |[0m server started
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/*
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m waiting for server to shut down...2025-02-04 15:15:36.206 UTC [90] LOG:  received fast shutdown request
[36mpostgres-db_1  |[0m .2025-02-04 15:15:36.212 UTC [90] LOG:  aborting any active transactions
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.215 UTC [90] LOG:  background worker "logical replication launcher" (PID 96) exited with exit code 1
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.216 UTC [91] LOG:  shutting down
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.228 UTC [91] LOG:  checkpoint starting: shutdown immediate
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.329 UTC [91] LOG:  checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.032 s, sync=0.001 s, total=0.113 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB; lsn=0/14EAC68, redo lsn=0/14EAC68
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.717 UTC [90] LOG:  database system is shut down
[36mpostgres-db_1  |[0m  done
[36mpostgres-db_1  |[0m server stopped
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m PostgreSQL init process complete; ready for start up.
[36mpostgres-db_1  |[0m 
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.863 UTC [1] LOG:  starting PostgreSQL 17.2 on x86_64-pc-linux-musl, compiled by gcc (Alpine 14.2.0) 14.2.0, 64-bit
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.863 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.863 UTC [1] LOG:  listening on IPv6 address "::", port 5432
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.904 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.958 UTC [104] LOG:  database system was shut down at 2025-02-04 15:15:36 UTC
[36mpostgres-db_1  |[0m 2025-02-04 15:15:36.974 UTC [1] LOG:  database system is ready to accept connections

reproduce:

  • 3 node ceph cluster with ceph version 18.2.4
  • 3 docker-swarm-manager with version 27.5.0
  • cephfs mounted on all manager-nodes

docker stack deploy -c minimal-compose.yml postgres-debug docker-compose up -f minimal-compose.yml

minimal-compose.yml 

version: '3.8'

services:
  postgres-db:
    image: postgres:17-alpine
    ports:
      - "5432:5432"
    healthcheck:
      test: ["CMD-SHELL", "pg_isready -U postgres -d postgres"]
      interval: 5s
      timeout: 5s
      retries: 5
    volumes:
      - type: bind
        source: /mnt/cephfs/postgres-test/
        target: /var/lib/postgresql/data
    environment:
      POSTGRES_PASSWORD: "changeme"
      POSTGRES_INITDB_ARGS: "--debug"
      PGDATA: "/var/lib/postgresql/data/pgdata"
    restart: "on-failure:5"

intelliIT avatar Feb 05 '25 15:02 intelliIT