hbase
hbase copied to clipboard
apache
Update hadoop-3.2.4 to hadoop3.3.3 in apache hadoop pom.xml
Fixed the error: org. apache.hadoop.hbase.DoNotRetryIOException: java.lang.UnsatisfiedLinkError: org-apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z Set hbase.table.sanity.checks to false.The error happened when i create table compressed by snappy. The environment based on hadoop 3.3.3 and hbase2.5.10. But hbase-25.10 document said it is compatible with hadoop 3.3.x, I used the configuration: org.apache.hadoop.hbase.io.compress.aircompressor.SnappyCodec,org.apache.hadoop.hbase.io.compress.xerial.SnappyCodec, the error still occurs.So I changed the dependency hadoop3.1.2 to hadoop 3.3.3, the error fixed. this problem is same as hbase-2.4, to fixed the problem in hbase-2.5.10 is the same way in hbase-2.4
:confetti_ball: +1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 0m 40s | Docker mode activated. | |
| _ Prechecks _ | ||||
| +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
| +0 :ok: | codespell | 0m 0s | codespell was not available. | |
| +0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
| _ branch-2.5 Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 56s | branch-2.5 passed | |
| +1 :green_heart: | compile | 5m 9s | branch-2.5 passed | |
| +1 :green_heart: | spotless | 0m 43s | branch has no errors when running spotless:check. | |
| _ Patch Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 53s | the patch passed | |
| +1 :green_heart: | compile | 5m 13s | the patch passed | |
| +1 :green_heart: | javac | 5m 13s | the patch passed | |
| +1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
| +1 :green_heart: | xmllint | 0m 0s | No new issues. | |
| +1 :green_heart: | hadoopcheck | 20m 5s | Patch does not cause any errors with Hadoop 2.10.2 or 3.2.4 3.3.6 3.4.0. | |
| +1 :green_heart: | spotless | 0m 43s | patch has no errors when running spotless:check. | |
| _ Other Tests _ | ||||
| +1 :green_heart: | asflicense | 0m 14s | The patch does not generate ASF License warnings. | |
| 40m 0s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/artifact/yetus-general-check/output/Dockerfile |
| GITHUB PR | https://github.com/apache/hbase/pull/6178 |
| Optional Tests | dupname asflicense javac codespell detsecrets xmllint hadoopcheck spotless compile |
| uname | Linux fd633dfbe208 5.4.0-192-generic #212-Ubuntu SMP Fri Jul 5 09:47:39 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | branch-2.5 / 95d8f68be45c7ccb9d688c531ce79c34db2d0819 |
| Default Java | Eclipse Adoptium-11.0.23+9 |
| Max. process+thread count | 78 (vs. ulimit of 30000) |
| modules | C: . U: . |
| Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/console |
| versions | git=2.34.1 maven=3.9.8 xmllint=20913 |
| Powered by | Apache Yetus 0.15.0 https://yetus.apache.org |
This message was automatically generated.
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 0m 42s | Docker mode activated. | |
| -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck | |
| _ Prechecks _ | ||||
| _ branch-2.5 Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 58s | branch-2.5 passed | |
| +1 :green_heart: | compile | 2m 6s | branch-2.5 passed | |
| +1 :green_heart: | javadoc | 2m 10s | branch-2.5 passed | |
| +1 :green_heart: | shadedjars | 5m 5s | branch has no errors when building our shaded downstream artifacts. | |
| _ Patch Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 48s | the patch passed | |
| +1 :green_heart: | compile | 2m 5s | the patch passed | |
| +1 :green_heart: | javac | 2m 5s | the patch passed | |
| +1 :green_heart: | javadoc | 2m 6s | the patch passed | |
| +1 :green_heart: | shadedjars | 5m 12s | patch has no errors when building our shaded downstream artifacts. | |
| _ Other Tests _ | ||||
| -1 :x: | unit | 236m 55s | /patch-unit-root.txt | root in the patch failed. |
| 267m 15s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile |
| GITHUB PR | https://github.com/apache/hbase/pull/6178 |
| Optional Tests | javac javadoc unit shadedjars compile |
| uname | Linux 8a2bd96ebc6a 5.4.0-186-generic #206-Ubuntu SMP Fri Apr 26 12:31:10 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | branch-2.5 / 95d8f68be45c7ccb9d688c531ce79c34db2d0819 |
| Default Java | Eclipse Adoptium-17.0.11+9 |
| Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/testReport/ |
| Max. process+thread count | 4846 (vs. ulimit of 30000) |
| modules | C: . U: . |
| Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/console |
| versions | git=2.34.1 maven=3.9.8 |
| Powered by | Apache Yetus 0.15.0 https://yetus.apache.org |
This message was automatically generated.
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 0m 18s | Docker mode activated. | |
| -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck | |
| _ Prechecks _ | ||||
| _ branch-2.5 Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 56s | branch-2.5 passed | |
| +1 :green_heart: | compile | 2m 4s | branch-2.5 passed | |
| +1 :green_heart: | javadoc | 2m 4s | branch-2.5 passed | |
| +1 :green_heart: | shadedjars | 5m 4s | branch has no errors when building our shaded downstream artifacts. | |
| _ Patch Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 59s | the patch passed | |
| +1 :green_heart: | compile | 2m 3s | the patch passed | |
| +1 :green_heart: | javac | 2m 3s | the patch passed | |
| +1 :green_heart: | javadoc | 2m 1s | the patch passed | |
| +1 :green_heart: | shadedjars | 5m 12s | patch has no errors when building our shaded downstream artifacts. | |
| _ Other Tests _ | ||||
| -1 :x: | unit | 249m 6s | /patch-unit-root.txt | root in the patch failed. |
| 279m 38s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile |
| GITHUB PR | https://github.com/apache/hbase/pull/6178 |
| Optional Tests | javac javadoc unit shadedjars compile |
| uname | Linux a93dc898e4be 5.4.0-192-generic #212-Ubuntu SMP Fri Jul 5 09:47:39 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | branch-2.5 / 95d8f68be45c7ccb9d688c531ce79c34db2d0819 |
| Default Java | Eclipse Adoptium-11.0.23+9 |
| Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/testReport/ |
| Max. process+thread count | 8088 (vs. ulimit of 30000) |
| modules | C: . U: . |
| Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/console |
| versions | git=2.34.1 maven=3.9.8 |
| Powered by | Apache Yetus 0.15.0 https://yetus.apache.org |
This message was automatically generated.
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 0m 50s | Docker mode activated. | |
| -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck | |
| _ Prechecks _ | ||||
| _ branch-2.5 Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 31s | branch-2.5 passed | |
| +1 :green_heart: | compile | 1m 48s | branch-2.5 passed | |
| +1 :green_heart: | javadoc | 1m 40s | branch-2.5 passed | |
| +1 :green_heart: | shadedjars | 4m 46s | branch has no errors when building our shaded downstream artifacts. | |
| _ Patch Compile Tests _ | ||||
| +1 :green_heart: | mvninstall | 2m 18s | the patch passed | |
| +1 :green_heart: | compile | 1m 48s | the patch passed | |
| +1 :green_heart: | javac | 1m 48s | the patch passed | |
| +1 :green_heart: | javadoc | 1m 36s | the patch passed | |
| +1 :green_heart: | shadedjars | 4m 41s | patch has no errors when building our shaded downstream artifacts. | |
| _ Other Tests _ | ||||
| -1 :x: | unit | 292m 44s | /patch-unit-root.txt | root in the patch failed. |
| 320m 10s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile |
| GITHUB PR | https://github.com/apache/hbase/pull/6178 |
| Optional Tests | javac javadoc unit shadedjars compile |
| uname | Linux e43619a835b7 5.4.0-186-generic #206-Ubuntu SMP Fri Apr 26 12:31:10 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | branch-2.5 / 95d8f68be45c7ccb9d688c531ce79c34db2d0819 |
| Default Java | Temurin-1.8.0_412-b08 |
| Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/testReport/ |
| Max. process+thread count | 4601 (vs. ulimit of 30000) |
| modules | C: . U: . |
| Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6178/1/console |
| versions | git=2.34.1 maven=3.9.8 |
| Powered by | Apache Yetus 0.15.0 https://yetus.apache.org |
This message was automatically generated.
Could you please provide the jira issue number about which change in hadoop 3.x breaks HBase? We can not simply change hadoop to 3.3.x by default, as there are still users on 3.2.x, we should find other ways to make hbase work with both hadoop versions.
Thanks.
