radondb-mysql-kubernetes icon indicating copy to clipboard operation
radondb-mysql-kubernetes copied to clipboard

定时备份到NFS失败

Open mainlaodao opened this issue 1 year ago • 5 comments

环境: k3s v1.23.8 radondb-mysql-kubenetes v2.2.0 mysql 8 nfs 服务镜像:coolersport/volume-nfs:0.8 主要配置: spec: replicas: 3 mysqlVersion: "8.0" restoreFrom: "hxzj-mysql_202272718119" nfsServerAddress: "10.43.151.159" backupSchedule: "0 0/10 * * * *"

其他大部分是默认值,10.43.151.159 为nfs SVC 的IP

错误如下: 集群状态: root@daoge:/home/daoge_note/radondb# kubectl get all -n hxzj NAME READY STATUS RESTARTS AGE pod/demo-mysql-operator-59b6fb597d-4pjff 2/2 Running 0 2d4h pod/hxzj-mysql-mysql-0 3/3 Running 0 9m20s pod/hxzj-mysql-mysql-1 3/3 Running 0 8m54s pod/hxzj-mysql-mysql-2 3/3 Running 0 8m28s pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-nffcp 0/1 Error 0 3m31s pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-6r5zt 0/1 Error 0 3m26s pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-nrhtx 0/1 Error 0 3m21s pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-ztzhz 0/1 Error 0 3m16s pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-zxzvz 0/1 Error 0 3m11s

NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE service/radondb-mysql-webhook ClusterIP 10.43.31.145 443/TCP 2d4h service/mysql-operator-metrics ClusterIP 10.43.15.33 8443/TCP 2d4h service/hxzj-mysql-svc NodePort 10.43.161.101 3306:32306/TCP 2d service/hxzj-mysql-mysql ClusterIP None 3306/TCP,8082/TCP 9m21s service/hxzj-mysql-leader ClusterIP 10.43.123.189 3306/TCP,8082/TCP 9m21s service/hxzj-mysql-follower ClusterIP 10.43.222.196 3306/TCP,8082/TCP 9m21s

NAME READY UP-TO-DATE AVAILABLE AGE deployment.apps/demo-mysql-operator 1/1 1 1 2d4h

NAME DESIRED CURRENT READY AGE replicaset.apps/demo-mysql-operator-59b6fb597d 1 1 1 2d4h

NAME READY AGE statefulset.apps/hxzj-mysql-mysql 3/3 9m21s

查看命令:kubectl logs --tail=100 pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-nffcp -n hxzj

root@daoge:/home/daoge_note/radondb# kubectl logs --tail=100 pod/hxzj-mysql-auto-2022-07-28t12-40-00-bak-nffcp -n hxzj 2022-07-28T12:40:00.592Z INFO sidecar initialize a backup {"host": "hxzj-mysql-mysql-0.hxzj-mysql-mysql.hxzj:8082", "endpoint": "/xbackup"} 2022-07-28T12:40:02.683Z ERROR sidecar run command failed {"error": "fail to get backup: %!s(<nil>), code: 500 Internal Server Error"} main.main.func3 /workspace/cmd/sidecar/main.go:84 github.com/spf13/cobra.(*Command).execute /go/pkg/mod/github.com/spf13/[email protected]/command.go:856 github.com/spf13/cobra.(*Command).ExecuteC /go/pkg/mod/github.com/spf13/[email protected]/command.go:960 github.com/spf13/cobra.(*Command).Execute /go/pkg/mod/github.com/spf13/[email protected]/command.go:897 main.main /workspace/cmd/sidecar/main.go:96 runtime.main /usr/local/go/src/runtime/proc.go:225 root@daoge:/home/daoge_note/radondb#

定时任务失败重试多次,都是一样的错误。 多谢各位!

mainlaodao avatar Jul 28 '22 12:07 mainlaodao

能贴一下 hxzj-mysql-mysql-0 这个pod 的 backup 容器的日志吗?

acekingke avatar Jul 28 '22 13:07 acekingke

@acekingke 日志:

2022-07-28T15:56:02.510Z	INFO	sidecar	environment is not set	{"key": "S3_ENDPOINT"}
2022-07-28T15:56:02.510Z	INFO	sidecar	environment is not set	{"key": "S3_ACCESSKEY"}
2022-07-28T15:56:02.510Z	INFO	sidecar	environment is not set	{"key": "S3_SECRETKEY"}
2022-07-28T15:56:02.510Z	INFO	sidecar	environment is not set	{"key": "S3_BUCKET"}
2022-07-28T16:00:00.546Z	INFO	sidecar	xargs 	{"xargs": "put --storage=S3 --s3-endpoint= --s3-access-key= --s3-secret-key= --s3-bucket= --parallel=10 hxzj-mysql_20227281600 --insecure"}
error: http request failed: Couldn't resolve host name
error: http request failed: Couldn't resolve host name
2022-07-28T16:00:00.554345-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized server arguments: --innodb_open_files=655360 --log_bin=/var/lib/mysql/mysql-bin --open_files_limit=655360 --tmpdir=/var/lib/mysql --innodb_adaptive_hash_index=0 --innodb_flush_method=O_DIRECT --innodb_log_buffer_size=16777216 --innodb_log_files_in_group=2 --innodb_use_native_aio=1 --server-id=100 --innodb_buffer_pool_size=134217728 --innodb_log_file_size=536870912 
2022-07-28T16:00:00.554511-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized client arguments: --backup=1 --stream=xbstream --host=127.0.0.1 --user=root --password=* --target-dir=/root/backup/ 
xtrabackup version 8.0.28-21 based on MySQL server 8.0.28 Linux (x86_64) (revision id: 78878e9b608)
220728 16:00:00  version_check Connecting to MySQL server with DSN 'dbi:mysql:;mysql_read_default_group=xtrabackup;host=127.0.0.1' as 'root'  (using password: YES).
220728 16:00:00  version_check Connected to MySQL server
220728 16:00:00  version_check Executing a version check against the server...
220728 16:00:00  version_check Done.
2022-07-28T16:00:00.623007-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:00.635140-00:00 0 [Note] [MY-011825] [Xtrabackup] Using server version 8.0.25-15
2022-07-28T16:00:00.644538-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing LOCK TABLES FOR BACKUP ...
2022-07-28T16:00:00.648846-00:00 0 [Note] [MY-011825] [Xtrabackup] uses posix_fadvise().
2022-07-28T16:00:00.648925-00:00 0 [Note] [MY-011825] [Xtrabackup] cd to /var/lib/mysql/
2022-07-28T16:00:00.648967-00:00 0 [Note] [MY-011825] [Xtrabackup] open files limit requested 655360, set to 1048576
2022-07-28T16:00:00.649047-00:00 0 [Note] [MY-011825] [Xtrabackup] using the following InnoDB configuration:
2022-07-28T16:00:00.649062-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_home_dir = .
2022-07-28T16:00:00.649069-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_file_path = ibdata1:12M:autoextend
2022-07-28T16:00:00.649096-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_group_home_dir = ./
2022-07-28T16:00:00.649104-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_files_in_group = 2
2022-07-28T16:00:00.649113-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_file_size = 536870912
2022-07-28 16:00:00 1402898132265602022-07-28T16:00:00.649137-00:00 0 [Note] [MY-011825] [InnoDB] Using Linux native AIO
2022-07-28T16:00:00.649148-00:00 0 [Note] [MY-011825] [Xtrabackup] using O_DIRECT
2022-07-28T16:00:00.649507-00:00 0 [Note] [MY-013251] [InnoDB] Number of pools: 1
2022-07-28T16:00:00.651007-00:00 0 [Note] [MY-011825] [Xtrabackup] inititialize_service_handles suceeded
2022-07-28T16:00:00.737321-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:00.742559-00:00 0 [Note] [MY-011825] [Xtrabackup] Redo Log Archiving is not set up.
2022-07-28T16:00:00.837948-00:00 0 [Note] [MY-011825] [Xtrabackup] Starting to parse redo log at lsn = 28901404
2022-07-28T16:00:00.838107-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:01.042834-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:01.042903-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:01.042917-00:00 0 [Note] [MY-012204] [InnoDB] Scanning './'
2022-07-28T16:00:01.044344-00:00 0 [Note] [MY-012208] [InnoDB] Completed space ID check of 2 files.
2022-07-28T16:00:01.044540-00:00 0 [Warning] [MY-012091] [InnoDB] Allocated tablespace ID 2 for radondb/my_user, old maximum was 0
2022-07-28T16:00:01.044685-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_001'.
2022-07-28T16:00:01.045181-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_002'.
2022-07-28T16:00:01.045617-00:00 0 [Note] [MY-012910] [InnoDB] Opened 2 existing undo tablespaces.
2022-07-28T16:00:01.046529-00:00 2 [Note] [MY-011825] [Xtrabackup] Streaming ./ibdata1
2022-07-28T16:00:01.838290-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:02.838459-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:03.838631-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:04.838790-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:05.838966-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:06.839151-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
220728 16:00:06 xbcloud: Probe failed. Please check your credentials and endpoint settings.
2022-07-28T16:00:07.839304-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:08.839476-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:09.755Z	INFO	sidecar	xargs 	{"xargs": "put --storage=S3 --s3-endpoint= --s3-access-key= --s3-secret-key= --s3-bucket= --parallel=10 hxzj-mysql_20227281609 --insecure"}
error: http request failed: Couldn't resolve host name
error: http request failed: Couldn't resolve host name
2022-07-28T16:00:09.763537-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized server arguments: --innodb_open_files=655360 --log_bin=/var/lib/mysql/mysql-bin --open_files_limit=655360 --tmpdir=/var/lib/mysql --innodb_adaptive_hash_index=0 --innodb_flush_method=O_DIRECT --innodb_log_buffer_size=16777216 --innodb_log_files_in_group=2 --innodb_use_native_aio=1 --server-id=100 --innodb_buffer_pool_size=134217728 --innodb_log_file_size=536870912 
2022-07-28T16:00:09.763765-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized client arguments: --backup=1 --stream=xbstream --host=127.0.0.1 --user=root --password=* --target-dir=/root/backup/ 
xtrabackup version 8.0.28-21 based on MySQL server 8.0.28 Linux (x86_64) (revision id: 78878e9b608)
220728 16:00:09  version_check Connecting to MySQL server with DSN 'dbi:mysql:;mysql_read_default_group=xtrabackup;host=127.0.0.1' as 'root'  (using password: YES).
220728 16:00:09  version_check Connected to MySQL server
220728 16:00:09  version_check Executing a version check against the server...
220728 16:00:09  version_check Done.
2022-07-28T16:00:09.833037-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:09.837757-00:00 0 [Note] [MY-011825] [Xtrabackup] Using server version 8.0.25-15
2022-07-28T16:00:09.839604-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901983)
2022-07-28T16:00:09.840040-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing LOCK TABLES FOR BACKUP ...
2022-07-28T16:00:09.841670-00:00 0 [Note] [MY-011825] [Xtrabackup] uses posix_fadvise().
2022-07-28T16:00:09.841698-00:00 0 [Note] [MY-011825] [Xtrabackup] cd to /var/lib/mysql/
2022-07-28T16:00:09.841709-00:00 0 [Note] [MY-011825] [Xtrabackup] open files limit requested 655360, set to 1048576
2022-07-28T16:00:09.841739-00:00 0 [Note] [MY-011825] [Xtrabackup] using the following InnoDB configuration:
2022-07-28T16:00:09.841747-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_home_dir = .
2022-07-28T16:00:09.841753-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_file_path = ibdata1:12M:autoextend
2022-07-28T16:00:09.841774-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_group_home_dir = ./
2022-07-28T16:00:09.841782-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_files_in_group = 2
2022-07-28T16:00:09.841789-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_file_size = 536870912
2022-07-28 16:00:09 1406541848300162022-07-28T16:00:09.841807-00:00 0 [Note] [MY-011825] [InnoDB] Using Linux native AIO
2022-07-28T16:00:09.841817-00:00 0 [Note] [MY-011825] [Xtrabackup] using O_DIRECT
2022-07-28T16:00:09.842151-00:00 0 [Note] [MY-013251] [InnoDB] Number of pools: 1
2022-07-28T16:00:09.842972-00:00 0 [Note] [MY-011825] [Xtrabackup] inititialize_service_handles suceeded
2022-07-28T16:00:09.917718-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:09.922999-00:00 0 [Note] [MY-011825] [Xtrabackup] Redo Log Archiving is not set up.
2022-07-28T16:00:10.018262-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:10.222246-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:10.222301-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:10.222311-00:00 0 [Note] [MY-012204] [InnoDB] Scanning './'
2022-07-28T16:00:10.223129-00:00 0 [Note] [MY-012208] [InnoDB] Completed space ID check of 2 files.
2022-07-28T16:00:10.223250-00:00 0 [Warning] [MY-012091] [InnoDB] Allocated tablespace ID 2 for radondb/my_user, old maximum was 0
2022-07-28T16:00:10.223347-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_001'.
2022-07-28T16:00:10.223555-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_002'.
2022-07-28T16:00:10.224259-00:00 0 [Note] [MY-012910] [InnoDB] Opened 2 existing undo tablespaces.
2022-07-28T16:00:10.225011-00:00 2 [Note] [MY-011825] [Xtrabackup] Streaming ./ibdata1
2022-07-28T16:00:10.839756-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:11.018437-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:11.839943-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:12.018619-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
220728 16:00:12 xbcloud: Probe failed. Please check your credentials and endpoint settings.
2022-07-28T16:00:12.840143-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:13.018808-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:13.840307-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:14.018971-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:14.840484-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:15.019165-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
2022-07-28T16:00:15.767Z	INFO	sidecar	xargs 	{"xargs": "put --storage=S3 --s3-endpoint= --s3-access-key= --s3-secret-key= --s3-bucket= --parallel=10 hxzj-mysql_202272816015 --insecure"}
error: http request failed: Couldn't resolve host name
error: http request failed: Couldn't resolve host name
2022-07-28T16:00:15.776049-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized server arguments: --innodb_open_files=655360 --log_bin=/var/lib/mysql/mysql-bin --open_files_limit=655360 --tmpdir=/var/lib/mysql --innodb_adaptive_hash_index=0 --innodb_flush_method=O_DIRECT --innodb_log_buffer_size=16777216 --innodb_log_files_in_group=2 --innodb_use_native_aio=1 --server-id=100 --innodb_buffer_pool_size=134217728 --innodb_log_file_size=536870912 
2022-07-28T16:00:15.776247-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized client arguments: --backup=1 --stream=xbstream --host=127.0.0.1 --user=root --password=* --target-dir=/root/backup/ 
xtrabackup version 8.0.28-21 based on MySQL server 8.0.28 Linux (x86_64) (revision id: 78878e9b608)
2022-07-28T16:00:15.840648-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28901993)
220728 16:00:15  version_check Connecting to MySQL server with DSN 'dbi:mysql:;mysql_read_default_group=xtrabackup;host=127.0.0.1' as 'root'  (using password: YES).
220728 16:00:15  version_check Connected to MySQL server
220728 16:00:15  version_check Executing a version check against the server...
220728 16:00:15  version_check Done.
2022-07-28T16:00:15.848981-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:15.857683-00:00 0 [Note] [MY-011825] [Xtrabackup] Using server version 8.0.25-15
2022-07-28T16:00:15.862722-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing LOCK TABLES FOR BACKUP ...
2022-07-28T16:00:15.864769-00:00 0 [Note] [MY-011825] [Xtrabackup] uses posix_fadvise().
2022-07-28T16:00:15.864807-00:00 0 [Note] [MY-011825] [Xtrabackup] cd to /var/lib/mysql/
2022-07-28T16:00:15.864822-00:00 0 [Note] [MY-011825] [Xtrabackup] open files limit requested 655360, set to 1048576
2022-07-28T16:00:15.864868-00:00 0 [Note] [MY-011825] [Xtrabackup] using the following InnoDB configuration:
2022-07-28T16:00:15.864890-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_home_dir = .
2022-07-28T16:00:15.864916-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_file_path = ibdata1:12M:autoextend
2022-07-28T16:00:15.864961-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_group_home_dir = ./
2022-07-28T16:00:15.864982-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_files_in_group = 2
2022-07-28T16:00:15.865003-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_file_size = 536870912
2022-07-28 16:00:15 1398650481552002022-07-28T16:00:15.865045-00:00 0 [Note] [MY-011825] [InnoDB] Using Linux native AIO
2022-07-28T16:00:15.865063-00:00 0 [Note] [MY-011825] [Xtrabackup] using O_DIRECT
2022-07-28T16:00:15.865420-00:00 0 [Note] [MY-013251] [InnoDB] Number of pools: 1
2022-07-28T16:00:15.866757-00:00 0 [Note] [MY-011825] [Xtrabackup] inititialize_service_handles suceeded
2022-07-28T16:00:15.952233-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:15.957881-00:00 0 [Note] [MY-011825] [Xtrabackup] Redo Log Archiving is not set up.
2022-07-28T16:00:16.019318-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:16.052803-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:16.255858-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:16.255919-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:16.255938-00:00 0 [Note] [MY-012204] [InnoDB] Scanning './'
2022-07-28T16:00:16.256781-00:00 0 [Note] [MY-012208] [InnoDB] Completed space ID check of 2 files.
2022-07-28T16:00:16.256930-00:00 0 [Warning] [MY-012091] [InnoDB] Allocated tablespace ID 2 for radondb/my_user, old maximum was 0
2022-07-28T16:00:16.257069-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_001'.
2022-07-28T16:00:16.257289-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_002'.
2022-07-28T16:00:16.257958-00:00 0 [Note] [MY-012910] [InnoDB] Opened 2 existing undo tablespaces.
2022-07-28T16:00:16.258624-00:00 2 [Note] [MY-011825] [Xtrabackup] Streaming ./ibdata1
2022-07-28T16:00:16.840803-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:17.019485-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:17.052943-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:17.840984-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
220728 16:00:17 xbcloud: Probe failed. Please check your credentials and endpoint settings.
2022-07-28T16:00:18.019675-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:18.053107-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:18.841164-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:19.019833-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:19.053269-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:19.841331-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:20.020017-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:20.053440-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:20.841488-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:20.860Z	INFO	sidecar	xargs 	{"xargs": "put --storage=S3 --s3-endpoint= --s3-access-key= --s3-secret-key= --s3-bucket= --parallel=10 hxzj-mysql_202272816020 --insecure"}
error: http request failed: Couldn't resolve host name
error: http request failed: Couldn't resolve host name
2022-07-28T16:00:20.868863-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized server arguments: --innodb_open_files=655360 --log_bin=/var/lib/mysql/mysql-bin --open_files_limit=655360 --tmpdir=/var/lib/mysql --innodb_adaptive_hash_index=0 --innodb_flush_method=O_DIRECT --innodb_log_buffer_size=16777216 --innodb_log_files_in_group=2 --innodb_use_native_aio=1 --server-id=100 --innodb_buffer_pool_size=134217728 --innodb_log_file_size=536870912 
2022-07-28T16:00:20.869040-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized client arguments: --backup=1 --stream=xbstream --host=127.0.0.1 --user=root --password=* --target-dir=/root/backup/ 
xtrabackup version 8.0.28-21 based on MySQL server 8.0.28 Linux (x86_64) (revision id: 78878e9b608)
220728 16:00:20  version_check Connecting to MySQL server with DSN 'dbi:mysql:;mysql_read_default_group=xtrabackup;host=127.0.0.1' as 'root'  (using password: YES).
220728 16:00:20  version_check Connected to MySQL server
220728 16:00:20  version_check Executing a version check against the server...
220728 16:00:20  version_check Done.
2022-07-28T16:00:20.937438-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:20.944260-00:00 0 [Note] [MY-011825] [Xtrabackup] Using server version 8.0.25-15
2022-07-28T16:00:20.946840-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing LOCK TABLES FOR BACKUP ...
2022-07-28T16:00:20.948505-00:00 0 [Note] [MY-011825] [Xtrabackup] uses posix_fadvise().
2022-07-28T16:00:20.948542-00:00 0 [Note] [MY-011825] [Xtrabackup] cd to /var/lib/mysql/
2022-07-28T16:00:20.948563-00:00 0 [Note] [MY-011825] [Xtrabackup] open files limit requested 655360, set to 1048576
2022-07-28T16:00:20.948605-00:00 0 [Note] [MY-011825] [Xtrabackup] using the following InnoDB configuration:
2022-07-28T16:00:20.948621-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_home_dir = .
2022-07-28T16:00:20.948631-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_file_path = ibdata1:12M:autoextend
2022-07-28T16:00:20.948664-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_group_home_dir = ./
2022-07-28T16:00:20.948679-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_files_in_group = 2
2022-07-28T16:00:20.948694-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_file_size = 536870912
2022-07-28 16:00:20 1398725527808642022-07-28T16:00:20.948727-00:00 0 [Note] [MY-011825] [InnoDB] Using Linux native AIO
2022-07-28T16:00:20.948746-00:00 0 [Note] [MY-011825] [Xtrabackup] using O_DIRECT
2022-07-28T16:00:20.949222-00:00 0 [Note] [MY-013251] [InnoDB] Number of pools: 1
2022-07-28T16:00:20.950512-00:00 0 [Note] [MY-011825] [Xtrabackup] inititialize_service_handles suceeded
2022-07-28T16:00:21.020175-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:21.028548-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:21.033890-00:00 0 [Note] [MY-011825] [Xtrabackup] Redo Log Archiving is not set up.
2022-07-28T16:00:21.053563-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902003)
2022-07-28T16:00:21.128929-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:21.331651-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:21.331714-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:21.331739-00:00 0 [Note] [MY-012204] [InnoDB] Scanning './'
2022-07-28T16:00:21.333123-00:00 0 [Note] [MY-012208] [InnoDB] Completed space ID check of 2 files.
2022-07-28T16:00:21.333287-00:00 0 [Warning] [MY-012091] [InnoDB] Allocated tablespace ID 2 for radondb/my_user, old maximum was 0
2022-07-28T16:00:21.333411-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_001'.
2022-07-28T16:00:21.333675-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_002'.
2022-07-28T16:00:21.334254-00:00 0 [Note] [MY-012910] [InnoDB] Opened 2 existing undo tablespaces.
2022-07-28T16:00:21.335272-00:00 2 [Note] [MY-011825] [Xtrabackup] Streaming ./ibdata1
2022-07-28T16:00:21.841627-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:22.020349-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:22.053716-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:22.129092-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
220728 16:00:22 xbcloud: Probe failed. Please check your credentials and endpoint settings.
2022-07-28T16:00:22.841760-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:23.020571-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:23.053882-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:23.129249-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:23.841927-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:24.020760-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:24.054057-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902013)
2022-07-28T16:00:24.129426-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902023)
2022-07-28T16:00:24.842106-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902023)
2022-07-28T16:00:25.020922-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902023)
2022-07-28T16:00:25.054208-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902023)
2022-07-28T16:00:25.129540-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902023)
2022-07-28T16:00:25.842256-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28902023)
2022-07-28T16:00:25.869Z	INFO	sidecar	xargs 	{"xargs": "put --storage=S3 --s3-endpoint= --s3-access-key= --s3-secret-key= --s3-bucket= --parallel=10 hxzj-mysql_202272816025 --insecure"}
error: http request failed: Couldn't resolve host name
error: http request failed: Couldn't resolve host name
2022-07-28T16:00:25.877113-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized server arguments: --innodb_open_files=655360 --log_bin=/var/lib/mysql/mysql-bin --open_files_limit=655360 --tmpdir=/var/lib/mysql --innodb_adaptive_hash_index=0 --innodb_flush_method=O_DIRECT --innodb_log_buffer_size=16777216 --innodb_log_files_in_group=2 --innodb_use_native_aio=1 --server-id=100 --innodb_buffer_pool_size=134217728 --innodb_log_file_size=536870912 
2022-07-28T16:00:25.877277-00:00 0 [Note] [MY-011825] [Xtrabackup] recognized client arguments: --backup=1 --stream=xbstream --host=127.0.0.1 --user=root --password=* --target-dir=/root/backup/ 
xtrabackup version 8.0.28-21 based on MySQL server 8.0.28 Linux (x86_64) (revision id: 78878e9b608)
220728 16:00:25  version_check Connecting to MySQL server with DSN 'dbi:mysql:;mysql_read_default_group=xtrabackup;host=127.0.0.1' as 'root'  (using password: YES).
220728 16:00:25  version_check Connected to MySQL server
220728 16:00:25  version_check Executing a version check against the server...
220728 16:00:25  version_check Done.
2022-07-28T16:00:25.943582-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:25.948601-00:00 0 [Note] [MY-011825] [Xtrabackup] Using server version 8.0.25-15
2022-07-28T16:00:25.950885-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing LOCK TABLES FOR BACKUP ...
2022-07-28T16:00:25.955383-00:00 0 [Note] [MY-011825] [Xtrabackup] uses posix_fadvise().
2022-07-28T16:00:25.955413-00:00 0 [Note] [MY-011825] [Xtrabackup] cd to /var/lib/mysql/
2022-07-28T16:00:25.955424-00:00 0 [Note] [MY-011825] [Xtrabackup] open files limit requested 655360, set to 1048576
2022-07-28T16:00:25.955460-00:00 0 [Note] [MY-011825] [Xtrabackup] using the following InnoDB configuration:
2022-07-28T16:00:25.955468-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_home_dir = .
2022-07-28T16:00:25.955474-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_data_file_path = ibdata1:12M:autoextend
2022-07-28T16:00:25.955494-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_group_home_dir = ./
2022-07-28T16:00:25.955521-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_files_in_group = 2
2022-07-28T16:00:25.955530-00:00 0 [Note] [MY-011825] [Xtrabackup] innodb_log_file_size = 536870912
2022-07-28 16:00:25 1397009292094082022-07-28T16:00:25.955545-00:00 0 [Note] [MY-011825] [InnoDB] Using Linux native AIO
2022-07-28T16:00:25.955560-00:00 0 [Note] [MY-011825] [Xtrabackup] using O_DIRECT
2022-07-28T16:00:25.955895-00:00 0 [Note] [MY-013251] [InnoDB] Number of pools: 1
2022-07-28T16:00:25.957132-00:00 0 [Note] [MY-011825] [Xtrabackup] inititialize_service_handles suceeded
2022-07-28T16:00:26.021080-00:00 1 [Note] [MY-011825] [Xtrabackup] Starting to parse redo log at lsn = 28901955
2022-07-28T16:00:26.021389-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905933)
2022-07-28T16:00:26.033046-00:00 0 [Note] [MY-011825] [Xtrabackup] Connecting to MySQL server host: 127.0.0.1, user: root, password: set, port: not set, socket: not set
2022-07-28T16:00:26.039108-00:00 0 [Note] [MY-011825] [Xtrabackup] Redo Log Archiving is not set up.
2022-07-28T16:00:26.054410-00:00 1 [Note] [MY-011825] [Xtrabackup] Starting to parse redo log at lsn = 28901955
2022-07-28T16:00:26.055012-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905933)
2022-07-28T16:00:26.129688-00:00 1 [Note] [MY-011825] [Xtrabackup] Starting to parse redo log at lsn = 28901955
2022-07-28T16:00:26.129814-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:26.133372-00:00 0 [Note] [MY-011825] [Xtrabackup] Starting to parse redo log at lsn = 28901955
2022-07-28T16:00:26.133580-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:26.336553-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:26.336625-00:00 0 [Note] [MY-011825] [Xtrabackup] Generating a list of tablespaces
2022-07-28T16:00:26.336643-00:00 0 [Note] [MY-012204] [InnoDB] Scanning './'
2022-07-28T16:00:26.337695-00:00 0 [Note] [MY-012208] [InnoDB] Completed space ID check of 2 files.
2022-07-28T16:00:26.337830-00:00 0 [Warning] [MY-012091] [InnoDB] Allocated tablespace ID 2 for radondb/my_user, old maximum was 0
2022-07-28T16:00:26.337927-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_001'.
2022-07-28T16:00:26.338124-00:00 0 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_002'.
2022-07-28T16:00:26.338851-00:00 0 [Note] [MY-012910] [InnoDB] Opened 2 existing undo tablespaces.
2022-07-28T16:00:26.339519-00:00 2 [Note] [MY-011825] [Xtrabackup] Streaming ./ibdata1
2022-07-28T16:00:26.842470-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:27.021522-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:27.055195-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:27.129919-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:27.133690-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
220728 16:00:27 xbcloud: Probe failed. Please check your credentials and endpoint settings.
2022-07-28T16:00:27.842588-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)
2022-07-28T16:00:28.021695-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (28905943)

后面都是log scanned up to ,没有其他日志了

mainlaodao avatar Jul 28 '22 16:07 mainlaodao

@acekingke

apiVersion: mysql.radondb.com/v1alpha1
kind: MysqlCluster
metadata:
  name: hxzj-mysql
  namespace: hxzj
spec:
  replicas: 3
  mysqlVersion: "8.0"
  
  # the backupSecretName specify the secret file name which store S3 information,
  # if you want S3 backup or restore, please create backup_secret.yaml, uncomment below and fill secret name:
  # backupSecretName: 
  
  # if you want create mysqlcluster from S3, uncomment and fill the directory in S3 bucket below:
  restoreFrom: "hxzj-mysql_202272718119"
  nfsServerAddress: "10.43.151.159"
  backupSchedule: "0 0/10 * * * *" 
  mysqlOpts:
    rootPassword: "hxzj@123"
    rootHost: "localhost"
    user: hxzj
    password: "hxzj@123"
    #database: radondb
    ## tokudb is not supported in mysql8.
    # initTokuDB: false

    # A simple map between string and string.
    # Such as:
    #    mysqlConf:
    #      expire_logs_days: "7"
    mysqlConf: {}

    resources:
      requests:
        cpu: 100m
        memory: 256Mi
      limits:
        cpu: 500m
        memory: 1Gi

  xenonOpts:
    image: radondb/xenon:1.1.5-alpha
    admitDefeatHearbeatCount: 5
    electionTimeout: 10000

    resources:
      requests:
        cpu: 50m
        memory: 128Mi
      limits:
        cpu: 100m
        memory: 256Mi

  metricsOpts:
    enabled: false
    image: prom/mysqld-exporter:v0.12.1

    resources:
      requests:
        cpu: 10m
        memory: 32Mi
      limits:
        cpu: 100m
        memory: 128Mi

  podPolicy:
    imagePullPolicy: IfNotPresent
    sidecarImage: radondb/mysql80-sidecar:v2.2.0
    busyboxImage: busybox:1.32

    slowLogTail: false
    auditLogTail: false

    labels: {}
    annotations: {}
    affinity: {}
    priorityClassName: ""
    tolerations: []
    schedulerName: ""
    # extraResources defines quotas for containers other than mysql or xenon.
    extraResources:
      requests:
        cpu: 10m
        memory: 32Mi

  persistence:
    enabled: true
    accessModes:
    - ReadWriteOnce
    #storageClass: ""
    size: 20Gi

定时备份到NFS,这是cluster文件。nfs 地址没错的。

mainlaodao avatar Jul 28 '22 16:07 mainlaodao

暂时不支持nfs的定时备份,将来会支持,nfs可以使用手动备份

acekingke avatar Jul 29 '22 08:07 acekingke

@acekingke 好吧。

mainlaodao avatar Jul 30 '22 09:07 mainlaodao