kubeblocks
kubeblocks copied to clipboard
apecloud
[BUG] apecloud mysql create failed on ipv6 k8s
Describe the bug
kbcli version
Kubernetes: v1.21.0
KubeBlocks: 0.8.3-beta.2
kbcli: 0.8.2
To Reproduce Steps to reproduce the behavior:
- create cluster
kbcli cluster create mysql mysql-cluster --mode='raftGroup' --cpu=0.5 --memory=0.5 --storage=1 --availability-policy=none --termination-policy=WipeOut --monitoring-interval=0 --version=ac-mysql-8.0.30 --replicas=3 --proxy-enabled=false --namespace default
- See error
kubectl get cluster -A
NAMESPACE NAME CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS AGE
default mysql-cluster apecloud-mysql ac-mysql-8.0.30 WipeOut Failed 25m
kbcli cluster list-instances -n default mysql-cluster
NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME
mysql-cluster-mysql-0 default mysql-cluster mysql Running <none> <none> <none> 500m / 500m 512Mi / 512Mi data:1Gi izj6c0fefwrwyyuv03vpzvz/240b:4001:233:ff00:9e65:d8aa:6597:2a7a Mar 27,2024 17:46 UTC+0800
mysql-cluster-mysql-1 default mysql-cluster mysql Running <none> <none> <none> 500m / 500m 512Mi / 512Mi data:1Gi izj6c0fefwrwyyuv03vpzuz/240b:4001:233:ff00:9e65:d8aa:6597:2a79 Mar 27,2024 17:46 UTC+0800
mysql-cluster-mysql-2 default mysql-cluster mysql Running <none> <none> <none> 500m / 500m 512Mi / 512Mi data:1Gi izj6c0fefwrwyyuv03vpztz/240b:4001:233:ff00:9e65:d8aa:6597:2a7b Mar 27,2024 17:46 UTC+0800
logs pod lorry
kubectl logs -n default mysql-cluster-mysql-0 lorry --tail 30
2024-03-27T10:23:35Z INFO HA Initialize cluster.
2024-03-27T10:23:36Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:37Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:38Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:39Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:40Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:40Z ERROR WeSQL Cluster info query failed {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).GetClusterInfo
/src/pkg/lorry/engines/wesql/manager.go:223
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).IsClusterInitialized
/src/pkg/lorry/engines/wesql/manager.go:198
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:23:40Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:23:40Z INFO HA Initialize cluster.
2024-03-27T10:23:41Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:42Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:43Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:44Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:45Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:45Z ERROR WeSQL Cluster info query failed {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).GetClusterInfo
/src/pkg/lorry/engines/wesql/manager.go:223
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).IsClusterInitialized
/src/pkg/lorry/engines/wesql/manager.go:198
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:23:45Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:23:45Z INFO HA Initialize cluster.
2024-03-27T10:23:46Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
kubectl logs -n default mysql-cluster-mysql-1 lorry --tail 30
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:23:48Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:23:49Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:50Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:51Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:52Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:53Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:53Z ERROR WeSQL Cluster info query failed {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).GetClusterInfo
/src/pkg/lorry/engines/wesql/manager.go:223
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).IsClusterInitialized
/src/pkg/lorry/engines/wesql/manager.go:198
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:23:53Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:23:54Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:55Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:56Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:57Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:58Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:23:58Z ERROR WeSQL Cluster info query failed {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).GetClusterInfo
/src/pkg/lorry/engines/wesql/manager.go:223
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).IsClusterInitialized
/src/pkg/lorry/engines/wesql/manager.go:198
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:23:58Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:23:59Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
kubectl logs -n default mysql-cluster-mysql-2 lorry --tail 30
2024-03-27T10:24:01Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:02Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:03Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:04Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:05Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:05Z ERROR WeSQL Cluster info query failed {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).GetClusterInfo
/src/pkg/lorry/engines/wesql/manager.go:223
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).IsClusterInitialized
/src/pkg/lorry/engines/wesql/manager.go:198
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:24:05Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:24:06Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:07Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:08Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:09Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:10Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:10Z ERROR WeSQL Cluster info query failed {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).GetClusterInfo
/src/pkg/lorry/engines/wesql/manager.go:223
github.com/apecloud/kubeblocks/pkg/lorry/engines/wesql.(*Manager).IsClusterInitialized
/src/pkg/lorry/engines/wesql/manager.go:198
github.com/apecloud/kubeblocks/pkg/lorry/highavailability.(*Ha).Start
/src/pkg/lorry/highavailability/ha.go:246
2024-03-27T10:24:10Z INFO HA Waiting for the database cluster to be initialized.
2024-03-27T10:24:11Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:12Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:13Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
2024-03-27T10:24:14Z INFO WeSQL DB is not ready {"error": "dial tcp 127.0.0.1:3306: connect: connection refused"}
logs pod mysql
kubectl logs -n default mysql-cluster-mysql-0 mysql --tail 30
2024-03-27 09:47:24+00:00 [Note] [KubeBlocks]: general_log=/data/mysql/data/mysql-cluster-mysql-0.log
2024-03-27 09:47:24+00:00 [Note] [KubeBlocks]: Switching to dedicated user 'mysql'
2024-03-27 09:47:24+00:00 [Note] [MySQL]: Entrypoint script for MySQL Server started.
2024-03-27 09:47:24+00:00 [Note] [MySQL]: KB_EMBEDDED_WESQL=1
2024-03-27 09:47:24+00:00 [Note] [KubeBlocks]: DATADIR=/data/mysql/data/
2024-03-27 09:47:24+00:00 [Note] [KubeBlocks]: PID_FILE=/var/run/mysqld/mysqld.pid
2024-03-27 09:47:25+00:00 [Note] [KubeBlocks]: SOCKET=/var/run/mysqld/mysqld.sock
2024-03-27 09:47:25+00:00 [Note] [KubeBlocks]: JEMALLOC_ENABLED=1
2024-03-27 09:47:25+00:00 [Note] [KubeBlocks]: Using jemalloc: LD_PRELOAD=/usr/local/lib/libjemalloc.so.2
2024-03-27 09:47:25+00:00 [Note] [KubeBlocks]: Initializing database files: 'mysqld --initialize-insecure --default-time-zone=SYSTEM --consensus-enabled=0 --disable-log-bin'
2024-03-27 09:47:30+00:00 [Note] [KubeBlocks]: Database files initialized
2024-03-27 09:47:30+00:00 [Note] [KubeBlocks]: Starting temporary server in background: 'mysqld --skip-grant-tables --consensus-enabled=0 --disable-log-bin'
2024-03-27 09:47:30+00:00 [Note] [KubeBlocks]: Waiting for server startup
2024-03-27 09:47:30+00:00 [Warn] [KubeBlocks]: The temporary server is still not started.
2024-03-27 09:47:31+00:00 [Note] [KubeBlocks]: Temporary server started.
'/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it.
2024-03-27 09:47:34+00:00 [Note] [KubeBlocks]: Creating database mydb
2024-03-27 09:47:34+00:00 [Note] [KubeBlocks]: Creating user u1
2024-03-27 09:47:34+00:00 [Note] [KubeBlocks]: Giving user u1 access to schema mydb
2024-03-27 09:47:34+00:00 [Note] [KubeBlocks]: Stopping temporary server(pid: 261).
2024-03-27 09:47:36+00:00 [Note] [KubeBlocks]: Temporary server stopped
2024-03-27 09:47:36+00:00 [Note] [KubeBlocks]: Initializing consensus meta: 'mysqld --cluster-info=mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306;mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306;mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306@1 --cluster-id=1 --cluster-start-index=1 --cluster-force-change-meta=ON --upgrade-wesql'
'/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
2024-03-27 09:47:39+00:00 [Note] [KubeBlocks]: Starting WeSQL server: 'mysqld'
kubectl logs -n default mysql-cluster-mysql-1 mysql --tail 30
2024-03-27 09:47:28+00:00 [Note] [KubeBlocks]: general_log=/data/mysql/data/mysql-cluster-mysql-1.log
2024-03-27 09:47:28+00:00 [Note] [KubeBlocks]: Switching to dedicated user 'mysql'
2024-03-27 09:47:28+00:00 [Note] [MySQL]: Entrypoint script for MySQL Server started.
2024-03-27 09:47:28+00:00 [Note] [MySQL]: KB_EMBEDDED_WESQL=1
2024-03-27 09:47:29+00:00 [Note] [KubeBlocks]: DATADIR=/data/mysql/data/
2024-03-27 09:47:29+00:00 [Note] [KubeBlocks]: PID_FILE=/var/run/mysqld/mysqld.pid
2024-03-27 09:47:29+00:00 [Note] [KubeBlocks]: SOCKET=/var/run/mysqld/mysqld.sock
2024-03-27 09:47:29+00:00 [Note] [KubeBlocks]: JEMALLOC_ENABLED=1
2024-03-27 09:47:29+00:00 [Note] [KubeBlocks]: Using jemalloc: LD_PRELOAD=/usr/local/lib/libjemalloc.so.2
2024-03-27 09:47:29+00:00 [Note] [KubeBlocks]: Initializing database files: 'mysqld --initialize-insecure --default-time-zone=SYSTEM --consensus-enabled=0 --disable-log-bin'
2024-03-27 09:47:35+00:00 [Note] [KubeBlocks]: Database files initialized
2024-03-27 09:47:35+00:00 [Note] [KubeBlocks]: Starting temporary server in background: 'mysqld --skip-grant-tables --consensus-enabled=0 --disable-log-bin'
2024-03-27 09:47:35+00:00 [Note] [KubeBlocks]: Waiting for server startup
2024-03-27 09:47:35+00:00 [Warn] [KubeBlocks]: The temporary server is still not started.
2024-03-27 09:47:36+00:00 [Note] [KubeBlocks]: Temporary server started.
'/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it.
2024-03-27 09:47:40+00:00 [Note] [KubeBlocks]: Creating database mydb
2024-03-27 09:47:40+00:00 [Note] [KubeBlocks]: Creating user u1
2024-03-27 09:47:40+00:00 [Note] [KubeBlocks]: Giving user u1 access to schema mydb
2024-03-27 09:47:40+00:00 [Note] [KubeBlocks]: Stopping temporary server(pid: 261).
2024-03-27 09:47:42+00:00 [Note] [KubeBlocks]: Temporary server stopped
2024-03-27 09:47:42+00:00 [Note] [KubeBlocks]: Initializing consensus meta: 'mysqld --cluster-info=mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306;mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306;mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306@2 --cluster-id=1 --cluster-start-index=1 --cluster-force-change-meta=ON --upgrade-wesql'
'/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
2024-03-27 09:47:45+00:00 [Note] [KubeBlocks]: Starting WeSQL server: 'mysqld'
kubectl logs -n default mysql-cluster-mysql-2 mysql --tail 30
2024-03-27 09:47:03+00:00 [Note] [KubeBlocks]: general_log=/data/mysql/data/mysql-cluster-mysql-2.log
2024-03-27 09:47:03+00:00 [Note] [KubeBlocks]: Switching to dedicated user 'mysql'
2024-03-27 09:47:03+00:00 [Note] [MySQL]: Entrypoint script for MySQL Server started.
2024-03-27 09:47:03+00:00 [Note] [MySQL]: KB_EMBEDDED_WESQL=1
2024-03-27 09:47:03+00:00 [Note] [KubeBlocks]: DATADIR=/data/mysql/data/
2024-03-27 09:47:03+00:00 [Note] [KubeBlocks]: PID_FILE=/var/run/mysqld/mysqld.pid
2024-03-27 09:47:04+00:00 [Note] [KubeBlocks]: SOCKET=/var/run/mysqld/mysqld.sock
2024-03-27 09:47:04+00:00 [Note] [KubeBlocks]: JEMALLOC_ENABLED=1
2024-03-27 09:47:04+00:00 [Note] [KubeBlocks]: Using jemalloc: LD_PRELOAD=/usr/local/lib/libjemalloc.so.2
2024-03-27 09:47:04+00:00 [Note] [KubeBlocks]: Initializing database files: 'mysqld --initialize-insecure --default-time-zone=SYSTEM --consensus-enabled=0 --disable-log-bin'
2024-03-27 09:47:10+00:00 [Note] [KubeBlocks]: Database files initialized
2024-03-27 09:47:10+00:00 [Note] [KubeBlocks]: Starting temporary server in background: 'mysqld --skip-grant-tables --consensus-enabled=0 --disable-log-bin'
2024-03-27 09:47:10+00:00 [Note] [KubeBlocks]: Waiting for server startup
2024-03-27 09:47:10+00:00 [Warn] [KubeBlocks]: The temporary server is still not started.
2024-03-27 09:47:11+00:00 [Note] [KubeBlocks]: Temporary server started.
'/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it.
2024-03-27 09:47:15+00:00 [Note] [KubeBlocks]: Creating database mydb
2024-03-27 09:47:15+00:00 [Note] [KubeBlocks]: Creating user u1
2024-03-27 09:47:15+00:00 [Note] [KubeBlocks]: Giving user u1 access to schema mydb
2024-03-27 09:47:15+00:00 [Note] [KubeBlocks]: Stopping temporary server(pid: 261).
2024-03-27 09:47:17+00:00 [Note] [KubeBlocks]: Temporary server stopped
2024-03-27 09:47:17+00:00 [Note] [KubeBlocks]: Initializing consensus meta: 'mysqld --cluster-info=mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306;mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306;mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306@3 --cluster-id=1 --cluster-start-index=1 --cluster-force-change-meta=ON --upgrade-wesql'
'/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
2024-03-27 09:47:19+00:00 [Note] [KubeBlocks]: Starting WeSQL server: 'mysqld'
kubectl exec -it -n default mysql-cluster-mysql-0 bash
curl 127.0.0.1:13306
curl: (52) Empty reply from server
curl 127.0.0.1:3306
curl: (7) Failed connect to 127.0.0.1:3306; Connection refused
[root@mysql-cluster-mysql-0 /]# cat /data/mysql/log/mysqld-error.log
[root@mysql-cluster-mysql-0 /]#
logs
cat /data/mysql/log/mysqld-error.log-2024032710_1711533601
2024-03-27T09:47:25.370091Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:25.370340Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.30) initializing of server in progress as process 213
2024-03-27T09:47:25.371860Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2024-03-27T09:47:25.371870Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-format work.
2024-03-27T09:47:25.378052Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:25.964915Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:26.904090Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2024-03-27T09:47:27.970795Z 5 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
2024-03-27T09:47:31.143734Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:31.144063Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 261
2024-03-27T09:47:31.145869Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2024-03-27T09:47:31.145878Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-format work.
2024-03-27T09:47:31.150211Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:31.478715Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:31.858701Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2024-03-27T09:47:31.859750Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2024-03-27T09:47:31.859783Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2024-03-27T09:47:31.883189Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.30' socket: '/var/run/mysqld/mysqld.sock' port: 0 WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:34.837836Z 12 [System] [MY-013172] [Server] Received SHUTDOWN from user root. Shutting down mysqld (Version: 8.0.30).
2024-03-27T09:47:36.292089Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.30) WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:36.983776Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:36.984103Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 345
2024-03-27T09:47:37.039979Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:37.336526Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:37.572647Z 4 [System] [MY-013381] [Server] Server upgrade from '80030' to '80030' started.
2024-03-27T09:47:37.630080Z 4 [System] [MY-013381] [Server] Server upgrade from '80030' to '80030' completed.
2024-03-27T09:47:37.693725Z 0 [Warning] [MY-000000] [Server] Force change meta to system table successfully.
2024-03-27T09:47:39.067700Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.30) WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:39.263676Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:39.263991Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 1
2024-03-27T09:47:39.270129Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:39.621438Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:39.874573Z 0 [System] [MY-010229] [Server] Starting XA crash recovery...
2024-03-27T09:47:39.880086Z 0 [System] [MY-010232] [Server] XA crash recovery finished.
[2024-03-27 09:47:39.902124] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:39.902137] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:39.905875] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:39.905886] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:41.326186] [Default] Server 1 : Enter startElectionCallback
[2024-03-27 09:47:41.326186] [Default] Server 1 : Paxos state change from FOLL to CAND !!
[2024-03-27 09:47:41.326186] [Default] Server 1 : Epoch task currentEpoch(0) during requestVote
[2024-03-27 09:47:41.326186] [Default] Server 1 : Start new requestVote: new term(2)
[2024-03-27 09:47:41.326186] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:41.326186] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:41.326186] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:41.326186] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:42.754004] [Default] Server 1 : Enter startElectionCallback
[2024-03-27 09:47:42.754004] [Default] Server 1 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:42.754004] [Default] Server 1 : Epoch task currentEpoch(2) during requestVote
[2024-03-27 09:47:42.754004] [Default] Server 1 : Start new requestVote: new term(3)
...
[2024-03-27 10:28:37.207736] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:37.207736] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:37.207736] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:38.705498] [Default] Server 1 : Enter startElectionCallback
[2024-03-27 10:28:38.705498] [Default] Server 1 : Paxos state change from CAND to CAND !!
[2024-03-27 10:28:38.705498] [Default] Server 1 : Epoch task currentEpoch(3377) during requestVote
[2024-03-27 10:28:38.705498] [Default] Server 1 : Start new requestVote: new term(1690)
[2024-03-27 10:28:38.705498] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:38.705498] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:38.705498] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:38.705498] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:40.119716] [Default] Server 1 : Enter startElectionCallback
[2024-03-27 10:28:40.119716] [Default] Server 1 : Paxos state change from CAND to CAND !!
[2024-03-27 10:28:40.119716] [Default] Server 1 : Epoch task currentEpoch(3379) during requestVote
[2024-03-27 10:28:40.119716] [Default] Server 1 : Start new requestVote: new term(1691)
[2024-03-27 10:28:40.119716] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:40.119716] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:40.119716] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:40.119716] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:41.546536] [Default] Server 1 : Enter startElectionCallback
[2024-03-27 10:28:41.546536] [Default] Server 1 : Paxos state change from CAND to CAND !!
[2024-03-27 10:28:41.546536] [Default] Server 1 : Epoch task currentEpoch(3381) during requestVote
[2024-03-27 10:28:41.546536] [Default] Server 1 : Start new requestVote: new term(1692)
[2024-03-27 10:28:41.546536] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:41.546536] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:41.546536] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:41.546536] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:42.970463] [Default] Server 1 : Enter startElectionCallback
[2024-03-27 10:28:42.970463] [Default] Server 1 : Paxos state change from CAND to CAND !!
[2024-03-27 10:28:42.970463] [Default] Server 1 : Epoch task currentEpoch(3383) during requestVote
[2024-03-27 10:28:42.970463] [Default] Server 1 : Start new requestVote: new term(1693)
[2024-03-27 10:28:42.970463] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:42.970463] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 10:28:42.970463] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 10:28:42.970463] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
cat /data/mysql/log/mysqld-error.log-2024032710_1711533601
2024-03-27T09:47:29.795595Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:29.795936Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.30) initializing of server in progress as process 213
2024-03-27T09:47:29.798274Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2024-03-27T09:47:29.798289Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-format work.
2024-03-27T09:47:29.808730Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:30.430513Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:31.519645Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2024-03-27T09:47:32.368027Z 5 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
2024-03-27T09:47:35.592739Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:35.593197Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 261
2024-03-27T09:47:35.595771Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2024-03-27T09:47:35.595782Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-format work.
2024-03-27T09:47:35.602199Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:35.969662Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:36.431625Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2024-03-27T09:47:36.433146Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2024-03-27T09:47:36.433187Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2024-03-27T09:47:36.456429Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.30' socket: '/var/run/mysqld/mysqld.sock' port: 0 WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:40.668886Z 12 [System] [MY-013172] [Server] Received SHUTDOWN from user root. Shutting down mysqld (Version: 8.0.30).
2024-03-27T09:47:41.875555Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.30) WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:42.862910Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:42.863346Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 345
2024-03-27T09:47:42.873913Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:43.240107Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:43.519275Z 4 [System] [MY-013381] [Server] Server upgrade from '80030' to '80030' started.
2024-03-27T09:47:43.580801Z 4 [System] [MY-013381] [Server] Server upgrade from '80030' to '80030' completed.
2024-03-27T09:47:43.662997Z 0 [Warning] [MY-000000] [Server] Force change meta to system table successfully.
2024-03-27T09:47:44.995858Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.30) WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:45.272417Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:45.272922Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 1
2024-03-27T09:47:45.281681Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:45.676349Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:45.972592Z 0 [System] [MY-010229] [Server] Starting XA crash recovery...
2024-03-27T09:47:45.980461Z 0 [System] [MY-010232] [Server] XA crash recovery finished.
[2024-03-27 09:47:46.011044] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:46.011071] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:46.013072] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:46.013087] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:47.434221] [Default] Server 2 : Enter startElectionCallback
[2024-03-27 09:47:47.434221] [Default] Server 2 : Paxos state change from FOLL to CAND !!
[2024-03-27 09:47:47.434221] [Default] Server 2 : Epoch task currentEpoch(0) during requestVote
[2024-03-27 09:47:47.434221] [Default] Server 2 : Start new requestVote: new term(2)
[2024-03-27 09:47:47.434221] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:47.434221] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:47.434221] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:47.434221] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:48.866833] [Default] Server 2 : Enter startElectionCallback
[2024-03-27 09:47:48.866833] [Default] Server 2 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:48.866833] [Default] Server 2 : Epoch task currentEpoch(2) during requestVote
[2024-03-27 09:47:48.866833] [Default] Server 2 : Start new requestVote: new term(3)
[2024-03-27 09:47:48.866833] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:48.866833] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:48.866833] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:48.866833] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:50.366653] [Default] Server 2 : Enter startElectionCallback
[2024-03-27 09:47:50.366653] [Default] Server 2 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:50.366653] [Default] Server 2 : Epoch task currentEpoch(4) during requestVote
[2024-03-27 09:47:50.366653] [Default] Server 2 : Start new requestVote: new term(4)
[2024-03-27 09:47:50.366653] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:50.366653] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:50.366653] [ERROR] failed to reconnect mysql-cluster-mysql-2.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:50.366653] [ERROR] failed to connect server 3, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:51.810621] [Default] Server 2 : Enter startElectionCallback
[2024-03-27 09:47:51.810621] [Default] Server 2 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:51.810621] [Default] Server 2 : Epoch task currentEpoch(6) during requestVote
[2024-03-27 09:47:51.810621] [Default] Server 2 : Start new requestVote: new term(5)
cat /data/mysql/log/mysqld-error.log-2024032710_1711533601
2024-03-27T09:47:04.498175Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:04.498465Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.30) initializing of server in progress as process 213
2024-03-27T09:47:04.500413Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2024-03-27T09:47:04.500423Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-format work.
2024-03-27T09:47:04.507651Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:05.126294Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:06.219448Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2024-03-27T09:47:07.105615Z 5 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
2024-03-27T09:47:10.374581Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:10.375058Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 261
2024-03-27T09:47:10.377339Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2024-03-27T09:47:10.377350Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-format work.
2024-03-27T09:47:10.383203Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:10.751716Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:11.180713Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2024-03-27T09:47:11.182042Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2024-03-27T09:47:11.182081Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2024-03-27T09:47:11.203253Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.30' socket: '/var/run/mysqld/mysqld.sock' port: 0 WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:15.172307Z 12 [System] [MY-013172] [Server] Received SHUTDOWN from user root. Shutting down mysqld (Version: 8.0.30).
2024-03-27T09:47:16.582015Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.30) WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:17.366931Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:17.367381Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 345
2024-03-27T09:47:17.376402Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:17.706749Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:17.980224Z 4 [System] [MY-013381] [Server] Server upgrade from '80030' to '80030' started.
2024-03-27T09:47:18.046324Z 4 [System] [MY-013381] [Server] Server upgrade from '80030' to '80030' completed.
2024-03-27T09:47:18.120106Z 0 [Warning] [MY-000000] [Server] Force change meta to system table successfully.
2024-03-27T09:47:19.472589Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.30) WeSQL Server - GPL, Release 5, Revision e77d836.
2024-03-27T09:47:19.764816Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.
2024-03-27T09:47:19.765301Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.30) starting as process 1
2024-03-27T09:47:19.773721Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2024-03-27T09:47:20.100477Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2024-03-27T09:47:20.391222Z 0 [System] [MY-010229] [Server] Starting XA crash recovery...
2024-03-27T09:47:20.399050Z 0 [System] [MY-010232] [Server] XA crash recovery finished.
[2024-03-27 09:47:20.431365] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:20.431389] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:20.435353] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:20.435376] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:21.828901] [Default] Server 3 : Enter startElectionCallback
[2024-03-27 09:47:21.828901] [Default] Server 3 : Paxos state change from FOLL to CAND !!
[2024-03-27 09:47:21.828901] [Default] Server 3 : Epoch task currentEpoch(0) during requestVote
[2024-03-27 09:47:21.828901] [Default] Server 3 : Start new requestVote: new term(2)
[2024-03-27 09:47:21.828901] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:21.828901] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:21.828901] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:21.828901] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:23.260535] [Default] Server 3 : Enter startElectionCallback
[2024-03-27 09:47:23.260535] [Default] Server 3 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:23.260535] [Default] Server 3 : Epoch task currentEpoch(2) during requestVote
[2024-03-27 09:47:23.260535] [Default] Server 3 : Start new requestVote: new term(3)
[2024-03-27 09:47:23.260535] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:23.260535] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:23.260535] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:23.260535] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:24.750545] [Default] Server 3 : Enter startElectionCallback
[2024-03-27 09:47:24.750545] [Default] Server 3 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:24.750545] [Default] Server 3 : Epoch task currentEpoch(4) during requestVote
[2024-03-27 09:47:24.750545] [Default] Server 3 : Start new requestVote: new term(4)
[2024-03-27 09:47:24.750545] [ERROR] failed to reconnect mysql-cluster-mysql-0.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:24.750545] [ERROR] failed to connect server 1, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:24.750545] [ERROR] failed to reconnect mysql-cluster-mysql-1.mysql-cluster-mysql-headless:13306 by invoking easy_connection_connect, error code: -1
[2024-03-27 09:47:24.750545] [ERROR] failed to connect server 2, now this server is disconnected, try to reconnect.
[2024-03-27 09:47:26.209134] [Default] Server 3 : Enter startElectionCallback
[2024-03-27 09:47:26.209134] [Default] Server 3 : Paxos state change from CAND to CAND !!
[2024-03-27 09:47:26.209134] [Default] Server 3 : Epoch task currentEpoch(6) during requestVote
[2024-03-27 09:47:26.209134] [Default] Server 3 : Start new requestVote: new term(5)
Expected behavior A clear and concise description of what you expected to happen.
Screenshots If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]
Additional context Add any other context about the problem here.
[root@mysql-zjfvxn-mysql-0 /]# ping -6 mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc
PING mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc(mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0)) 56 data bytes
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=1 ttl=64 time=0.013 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=2 ttl=64 time=0.037 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=3 ttl=64 time=0.036 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=4 ttl=64 time=0.030 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=5 ttl=64 time=0.027 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=6 ttl=64 time=0.034 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=7 ttl=64 time=0.036 ms
64 bytes from mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa0): icmp_seq=8 ttl=64 time=0.026 ms
^C
--- mysql-zjfvxn-mysql-0.mysql-zjfvxn-mysql-headless.default.svc ping statistics ---
8 packets transmitted, 8 received, 0% packet loss, time 7204ms
rtt min/avg/max/mdev = 0.013/0.029/0.037/0.010 ms
[root@mysql-zjfvxn-mysql-0 /]# ping -6 mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc
PING mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc(mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa7)) 56 data bytes
64 bytes from mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa7): icmp_seq=1 ttl=63 time=0.063 ms
64 bytes from mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa7): icmp_seq=2 ttl=63 time=0.126 ms
64 bytes from mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa7): icmp_seq=3 ttl=63 time=0.072 ms
64 bytes from mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfa7): icmp_seq=4 ttl=63 time=0.101 ms
^C
--- mysql-zjfvxn-mysql-1.mysql-zjfvxn-mysql-headless.default.svc ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3051ms
rtt min/avg/max/mdev = 0.063/0.090/0.126/0.026 ms
[root@mysql-zjfvxn-mysql-0 /]# ping -6 mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc
PING mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc(mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfaf)) 56 data bytes
64 bytes from mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfaf): icmp_seq=1 ttl=63 time=0.059 ms
64 bytes from mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfaf): icmp_seq=2 ttl=63 time=0.099 ms
64 bytes from mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfaf): icmp_seq=3 ttl=63 time=0.123 ms
64 bytes from mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfaf): icmp_seq=4 ttl=63 time=0.102 ms
64 bytes from mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc.cluster.local (2001:db8:42:76:11bb:3d87:8fb2:bfaf): icmp_seq=5 ttl=63 time=0.086 ms
^C
--- mysql-zjfvxn-mysql-2.mysql-zjfvxn-mysql-headless.default.svc ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4106ms
rtt min/avg/max/mdev = 0.059/0.093/0.123/0.024 ms
[root@mysql-zjfvxn-mysql-0 /]#
This issue has been marked as stale because it has been open for 30 days with no activity
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
