hbase icon indicating copy to clipboard operation
hbase copied to clipboard
verified publisher icon apache

HBASE-27132 Log archiving fail cause regionserver abort

Open SiCheng-Zheng opened this issue 3 years ago • 6 comments

SiCheng-Zheng avatar Jun 23 '22 10:06 SiCheng-Zheng

:confetti_ball: +1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 1m 36s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
_ master Compile Tests _
+1 :green_heart: mvninstall 3m 2s master passed
+1 :green_heart: compile 3m 5s master passed
+1 :green_heart: checkstyle 0m 46s master passed
+1 :green_heart: spotless 1m 7s branch has no errors when running spotless:check.
+1 :green_heart: spotbugs 1m 58s master passed
_ Patch Compile Tests _
+1 :green_heart: mvninstall 3m 17s the patch passed
+1 :green_heart: compile 3m 15s the patch passed
+1 :green_heart: javac 3m 15s the patch passed
+1 :green_heart: checkstyle 0m 37s the patch passed
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: hadoopcheck 16m 33s Patch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 :green_heart: spotless 0m 58s patch has no errors when running spotless:check.
+1 :green_heart: spotbugs 1m 54s the patch passed
_ Other Tests _
+1 :green_heart: asflicense 0m 11s The patch does not generate ASF License warnings.
44m 57s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4570
Optional Tests dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
uname Linux 22789857ac1e 5.4.0-1025-aws #25~18.04.1-Ubuntu SMP Fri Sep 11 12:03:04 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 342183e596
Default Java AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count 64 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/console
versions git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 23 '22 11:06 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 0m 36s Docker mode activated.
-0 :warning: yetus 0m 2s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 2m 21s master passed
+1 :green_heart: compile 0m 34s master passed
+1 :green_heart: shadedjars 3m 51s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 25s master passed
_ Patch Compile Tests _
+1 :green_heart: mvninstall 2m 14s the patch passed
+1 :green_heart: compile 0m 33s the patch passed
+1 :green_heart: javac 0m 33s the patch passed
+1 :green_heart: shadedjars 3m 51s patch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 21s the patch passed
_ Other Tests _
-1 :x: unit 212m 2s hbase-server in the patch failed.
228m 29s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4570
Optional Tests javac javadoc unit shadedjars compile
uname Linux f8cb64367d40 5.4.0-1071-aws #76~18.04.1-Ubuntu SMP Mon Mar 28 17:49:57 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 342183e596
Default Java AdoptOpenJDK-1.8.0_282-b08
unit https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/testReport/
Max. process+thread count 2569 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 23 '22 14:06 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 1m 8s Docker mode activated.
-0 :warning: yetus 0m 2s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 3m 3s master passed
+1 :green_heart: compile 0m 48s master passed
+1 :green_heart: shadedjars 3m 56s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 28s master passed
_ Patch Compile Tests _
+1 :green_heart: mvninstall 2m 53s the patch passed
+1 :green_heart: compile 0m 49s the patch passed
+1 :green_heart: javac 0m 49s the patch passed
+1 :green_heart: shadedjars 3m 50s patch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 25s the patch passed
_ Other Tests _
-1 :x: unit 216m 30s hbase-server in the patch failed.
235m 30s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4570
Optional Tests javac javadoc unit shadedjars compile
uname Linux 4564fdc06912 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 342183e596
Default Java AdoptOpenJDK-11.0.10+9
unit https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/testReport/
Max. process+thread count 2713 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4570/1/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 23 '22 14:06 Apache-HBase

What is the jira issue for this PR? And mind explaining a bit about the problem?

Apache9 avatar Jun 25 '22 12:06 Apache9

What is the jira issue for this PR? And mind explaining a bit about the problem?

when "hbase.regionserver.logroll.period" set 600000 and "hbase.master.hfilecleaner.ttl" set 1800000 Under high concurrency, another thread deletes the parent directory of archiveLogFile before archiving, resulting in archiving failure. Finally, RS abort

SiCheng-Zheng avatar Jun 27 '22 12:06 SiCheng-Zheng

What is the jira issue for this PR? And mind explaining a bit about the problem?

when "hbase.regionserver.logroll.period" set 600000 and "hbase.master.hfilecleaner.ttl" set 1800000 Under high concurrency, another thread deletes the parent directory of archiveLogFile before archiving, resulting in archiving failure. Finally, RS abort

So you enabled archive dir per region server? And why is "hbase.master.hfilecleaner.ttl" related here? You mean logcleaner?

Apache9 avatar Jul 17 '22 13:07 Apache9