hbase icon indicating copy to clipboard operation
hbase copied to clipboard

HBASE-23723 Ensure MOB compaction works in optimized mode after snaps…

Open huaxiangsun opened this issue 3 years ago • 4 comments

…hot clone (#4617)

  • HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#1446)

  • Reorganize MOB compaction tests for more reuse.

  • Add tests for mob compaction after snapshot clone operations

  • note the original table used to write a given mob hfile and use that to find it later.

Signed-off-by: Esteban Gutierrez [email protected]

  • spotless:apply to fix HBaseTestingUtility

  • Fix error-prone errors

Signed-off-by: Esteban Gutierrez [email protected] Co-authored-by: Sean Busbey [email protected]

huaxiangsun avatar Aug 12 '22 21:08 huaxiangsun

A backport from branch-2 to branch-2.5.

huaxiangsun avatar Aug 12 '22 21:08 huaxiangsun

:confetti_ball: +1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 1m 12s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
_ branch-2.5 Compile Tests _
+0 :ok: mvndep 0m 11s Maven dependency ordering for branch
+1 :green_heart: mvninstall 2m 16s branch-2.5 passed
+1 :green_heart: compile 2m 46s branch-2.5 passed
+1 :green_heart: checkstyle 0m 46s branch-2.5 passed
+1 :green_heart: spotless 0m 46s branch has no errors when running spotless:check.
+1 :green_heart: spotbugs 1m 46s branch-2.5 passed
_ Patch Compile Tests _
+0 :ok: mvndep 0m 12s Maven dependency ordering for patch
+1 :green_heart: mvninstall 2m 8s the patch passed
+1 :green_heart: compile 2m 45s the patch passed
-0 :warning: javac 0m 31s hbase-common generated 2 new + 152 unchanged - 2 fixed = 154 total (was 154)
-0 :warning: javac 2m 14s hbase-server generated 4 new + 189 unchanged - 4 fixed = 193 total (was 193)
+1 :green_heart: checkstyle 0m 45s the patch passed
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: hadoopcheck 15m 27s Patch does not cause any errors with Hadoop 2.10.1 or 3.1.2 3.2.2 3.3.1.
+1 :green_heart: spotless 0m 41s patch has no errors when running spotless:check.
+1 :green_heart: spotbugs 1m 58s the patch passed
_ Other Tests _
+1 :green_heart: asflicense 0m 20s The patch does not generate ASF License warnings.
39m 21s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4704
Optional Tests dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
uname Linux 86d1affa1621 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.5 / da472aac06
Default Java AdoptOpenJDK-1.8.0_282-b08
javac https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-common.txt
javac https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-server.txt
Max. process+thread count 60 (vs. ulimit of 30000)
modules C: hbase-common hbase-server U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/console
versions git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 12 '22 22:08 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 3m 52s Docker mode activated.
-0 :warning: yetus 0m 5s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.5 Compile Tests _
+0 :ok: mvndep 0m 13s Maven dependency ordering for branch
+1 :green_heart: mvninstall 2m 28s branch-2.5 passed
+1 :green_heart: compile 0m 50s branch-2.5 passed
+1 :green_heart: shadedjars 4m 0s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 36s branch-2.5 passed
_ Patch Compile Tests _
+0 :ok: mvndep 0m 12s Maven dependency ordering for patch
+1 :green_heart: mvninstall 2m 9s the patch passed
+1 :green_heart: compile 0m 51s the patch passed
+1 :green_heart: javac 0m 51s the patch passed
+1 :green_heart: shadedjars 4m 0s patch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 35s the patch passed
_ Other Tests _
+1 :green_heart: unit 1m 41s hbase-common in the patch passed.
-1 :x: unit 187m 6s hbase-server in the patch failed.
210m 13s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4704
Optional Tests javac javadoc unit shadedjars compile
uname Linux 6775756d6dd4 5.4.0-1071-aws #76~18.04.1-Ubuntu SMP Mon Mar 28 17:49:57 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.5 / da472aac06
Default Java AdoptOpenJDK-1.8.0_282-b08
unit https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-server.txt
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/testReport/
Max. process+thread count 2160 (vs. ulimit of 30000)
modules C: hbase-common hbase-server U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 13 '22 01:08 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 1m 36s Docker mode activated.
-0 :warning: yetus 0m 5s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.5 Compile Tests _
+0 :ok: mvndep 0m 11s Maven dependency ordering for branch
+1 :green_heart: mvninstall 3m 22s branch-2.5 passed
+1 :green_heart: compile 1m 10s branch-2.5 passed
+1 :green_heart: shadedjars 4m 34s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 47s branch-2.5 passed
_ Patch Compile Tests _
+0 :ok: mvndep 0m 19s Maven dependency ordering for patch
+1 :green_heart: mvninstall 2m 59s the patch passed
+1 :green_heart: compile 1m 15s the patch passed
+1 :green_heart: javac 1m 15s the patch passed
+1 :green_heart: shadedjars 4m 41s patch has no errors when building our shaded downstream artifacts.
-0 :warning: javadoc 0m 28s hbase-server generated 1 new + 90 unchanged - 0 fixed = 91 total (was 90)
_ Other Tests _
+1 :green_heart: unit 1m 57s hbase-common in the patch passed.
+1 :green_heart: unit 216m 52s hbase-server in the patch passed.
242m 12s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4704
Optional Tests javac javadoc unit shadedjars compile
uname Linux 3fc95726a348 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.5 / da472aac06
Default Java AdoptOpenJDK-11.0.10+9
javadoc https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/testReport/
Max. process+thread count 2315 (vs. ulimit of 30000)
modules C: hbase-common hbase-server U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 13 '22 02:08 Apache-HBase

I run the failed test case TestSplitRegionWhileRSCrash locally, it passed.

huaxiangsun avatar Aug 15 '22 17:08 huaxiangsun