Tendis icon indicating copy to clipboard operation
Tendis copied to clipboard

slave dump error

Open phenix-gao opened this issue 4 years ago • 1 comments

Tendis集群3主3从,每slave节点运行一段时间会都进行dump操作 dump之前slave节点的数据量比master节点数据大一倍,dump之后slave节点db数据大小恢复正常, 手动删除slave的dump目录后新建dump目录,会导致下次dump的时候KVStore::createBinlogFile失败【见后面错误日志】。 建议生成binlog的时候判断下dump/{storeId}父目录是否存在,不存在创建下。

请问slave什么情况下会进行dump操作?如何关闭dump或者设置dump目录清理时间?

节点信息

redis_version:2.3.4-rocksdb-v5.13.4 redis_git_sha1:552a4365 redis_git_dirty:23 redis_build_id:4869811118804139172 redis_mode:cluster TENDIS_DEBUG:OFF os:Linux 4.4.226-1.el7.elrepo.x86_64 x86_64 arch_bits:64 multiplexing_api:asio gcc_version:5:5:0 process_id:15779 tcp_port:51002 uptime_in_seconds:84462 uptime_in_days:0 config_file:/data3/tendisplus02/scripts/tendisplus.conf

错误日志

E0722 15:54:55.841712 16220 kvstore.cpp:573] fs->is_open() failed:../dump/8/binlog-8-0000508-20210722131705.log E0722 15:54:55.841840 16220 repl_manager.cpp:777] getCurBinlogFs() store;8failed: E0722 15:54:56.123188 16221 kvstore.cpp:573] fs->is_open() failed:../dump/9/binlog-9-0000509-20210722131705.log E0722 15:54:56.123248 16221 repl_manager.cpp:777] getCurBinlogFs() store;9failed: E0722 15:54:56.274125 16222 kvstore.cpp:573] fs->is_open() failed:../dump/1/binlog-1-0000510-20210722131705.log E0722 15:54:56.274184 16222 repl_manager.cpp:777] getCurBinlogFs() store;1failed: E0722 15:54:56.334466 16220 kvstore.cpp:573] fs->is_open() failed:../dump/3/binlog-3-0000508-20210722131705.log E0722 15:54:56.334532 16220 repl_manager.cpp:777] getCurBinlogFs() store;3failed: E0722 15:54:56.596025 16223 kvstore.cpp:573] fs->is_open() failed:../dump/6/binlog-6-0000508-20210722131705.log E0722 15:54:56.596072 16223 repl_manager.cpp:777] getCurBinlogFs() store;6failed: E0722 15:54:56.686583 16222 kvstore.cpp:573] fs->is_open() failed:../dump/0/binlog-0-0000509-20210722131705.log E0722 15:54:56.686623 16222 repl_manager.cpp:777] getCurBinlogFs() store;0failed: E0722 15:54:56.706710 16220 kvstore.cpp:573] fs->is_open() failed:../dump/5/binlog-5-0000509-20210722131705.log E0722 15:54:56.706753 16220 repl_manager.cpp:777] getCurBinlogFs() store;5failed: E0722 15:54:56.736888 16221 kvstore.cpp:573] fs->is_open() failed:../dump/8/binlog-8-0000508-20210722131705.log E0722 15:54:56.736925 16221 repl_manager.cpp:777] getCurBinlogFs() store;8failed: E0722 15:54:56.867741 16223 kvstore.cpp:573] fs->is_open() failed:../dump/2/binlog-2-0000509-20210722131705.log E0722 15:54:56.867792 16223 repl_manager.cpp:777] getCurBinlogFs() store;2failed: E0722 15:54:56.968333 16222 kvstore.cpp:573] fs->is_open() failed:../dump/9/binlog-9-0000509-20210722131705.log E0722 15:54:56.968370 16222 repl_manager.cpp:777] getCurBinlogFs() store;9failed: E0722 15:54:57.280226 16220 kvstore.cpp:573] fs->is_open() failed:../dump/4/binlog-4-0000509-20210722131705.log E0722 15:54:57.280268 16220 repl_manager.cpp:777] getCurBinlogFs() store;4failed: E0722 15:54:57.310370 16221 kvstore.cpp:573] fs->is_open() failed:../dump/3/binlog-3-0000508-20210722131705.log E0722 15:54:57.310405 16221 repl_manager.cpp:777] getCurBinlogFs() store;3failed: E0722 15:54:57.350590 16223 kvstore.cpp:573] fs->is_open() failed:../dump/1/binlog-1-0000510-20210722131705.log E0722 15:54:57.350611 16223 repl_manager.cpp:777] getCurBinlogFs() store;1failed: E0722 15:54:57.511593 16222 kvstore.cpp:573] fs->is_open() failed:../dump/6/binlog-6-0000508-20210722131705.log E0722 15:54:57.511637 16222 repl_manager.cpp:777] getCurBinlogFs() store;6failed: E0722 15:54:57.521605 16220 kvstore.cpp:573] fs->is_open() failed:../dump/7/binlog-7-0000509-20210722131705.log E0722 15:54:57.521626 16220 repl_manager.cpp:777] getCurBinlogFs() store;7failed: E0722 15:54:57.652384 16221 kvstore.cpp:573] fs->is_open() failed:../dump/0/binlog-0-0000509-20210722131705.log E0722 15:54:57.652411 16221 repl_manager.cpp:777] getCurBinlogFs() store;0failed: E0722 15:54:57.863602 16223 kvstore.cpp:573] fs->is_open() failed:../dump/5/binlog-5-0000509-20210722131705.log

phenix-gao avatar Jul 23 '21 01:07 phenix-gao

可以尝试一下 2.5.0版本,新增了对dump功能的控制。

raffertyyu avatar Aug 02 '22 06:08 raffertyyu