hbase icon indicating copy to clipboard operation
hbase copied to clipboard

HBASE-27089 Add “commons.crypto.stream.buffer.size” configuration

Open wenwj0 opened this issue 3 years ago • 7 comments

Add “commons.crypto.stream.buffer.size” configuration in hbase when doing encryption through commonsCryptoAES.

wenwj0 avatar Jun 06 '22 12:06 wenwj0

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 1m 6s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
_ master Compile Tests _
+1 :green_heart: mvninstall 3m 3s master passed
+1 :green_heart: compile 0m 33s master passed
+1 :green_heart: checkstyle 0m 15s master passed
+1 :green_heart: spotless 0m 41s branch has no errors when running spotless:check.
+1 :green_heart: spotbugs 0m 32s master passed
_ Patch Compile Tests _
-1 :x: mvninstall 0m 40s root in the patch failed.
+1 :green_heart: compile 0m 30s the patch passed
+1 :green_heart: javac 0m 30s the patch passed
-0 :warning: checkstyle 0m 11s hbase-common: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
-1 :x: hadoopcheck 0m 44s The patch causes 34 errors with Hadoop v3.1.2.
-1 :x: hadoopcheck 1m 31s The patch causes 34 errors with Hadoop v3.2.2.
-1 :x: hadoopcheck 2m 19s The patch causes 34 errors with Hadoop v3.3.1.
-1 :x: spotless 0m 11s patch has 34 errors when running spotless:check, run spotless:apply to fix.
+1 :green_heart: spotbugs 0m 32s the patch passed
_ Other Tests _
+1 :green_heart: asflicense 0m 8s The patch does not generate ASF License warnings.
11m 57s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4491
Optional Tests dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
uname Linux f446cb3dc0a4 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / a060e71c53
Default Java AdoptOpenJDK-1.8.0_282-b08
mvninstall https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/patch-mvninstall-root.txt
checkstyle https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-common.txt
hadoopcheck https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/patch-javac-3.1.2.txt
hadoopcheck https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/patch-javac-3.2.2.txt
hadoopcheck https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/patch-javac-3.3.1.txt
spotless https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count 65 (vs. ulimit of 30000)
modules C: hbase-common U: hbase-common
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/console
versions git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 06 '22 12:06 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 2m 1s Docker mode activated.
-0 :warning: yetus 0m 4s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 4m 17s master passed
+1 :green_heart: compile 0m 22s master passed
+1 :green_heart: shadedjars 5m 7s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 16s master passed
_ Patch Compile Tests _
-1 :x: mvninstall 0m 51s root in the patch failed.
+1 :green_heart: compile 0m 21s the patch passed
+1 :green_heart: javac 0m 21s the patch passed
-1 :x: shadedjars 1m 8s patch has 34 errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 16s the patch passed
_ Other Tests _
+1 :green_heart: unit 2m 8s hbase-common in the patch passed.
18m 2s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4491
Optional Tests javac javadoc unit shadedjars compile
uname Linux 7e04f1a911e6 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / a060e71c53
Default Java AdoptOpenJDK-1.8.0_282-b08
mvninstall https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-jdk8-hadoop3-check/output/patch-mvninstall-root.txt
shadedjars https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-jdk8-hadoop3-check/output/patch-shadedjars.txt
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/testReport/
Max. process+thread count 161 (vs. ulimit of 30000)
modules C: hbase-common U: hbase-common
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 06 '22 12:06 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 2m 3s Docker mode activated.
-0 :warning: yetus 0m 2s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 4m 51s master passed
+1 :green_heart: compile 0m 26s master passed
+1 :green_heart: shadedjars 5m 6s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 26s master passed
_ Patch Compile Tests _
-1 :x: mvninstall 1m 8s root in the patch failed.
+1 :green_heart: compile 0m 21s the patch passed
+1 :green_heart: javac 0m 21s the patch passed
-1 :x: shadedjars 1m 36s patch has 34 errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 22s the patch passed
_ Other Tests _
+1 :green_heart: unit 2m 11s hbase-common in the patch passed.
19m 39s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4491
Optional Tests javac javadoc unit shadedjars compile
uname Linux 37a982df307a 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / a060e71c53
Default Java AdoptOpenJDK-11.0.10+9
mvninstall https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-jdk11-hadoop3-check/output/patch-mvninstall-root.txt
shadedjars https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/artifact/yetus-jdk11-hadoop3-check/output/patch-shadedjars.txt
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/testReport/
Max. process+thread count 183 (vs. ulimit of 30000)
modules C: hbase-common U: hbase-common
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/1/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 06 '22 12:06 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 4m 3s Docker mode activated.
-0 :warning: yetus 0m 2s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 3m 41s master passed
+1 :green_heart: compile 0m 14s master passed
+1 :green_heart: shadedjars 4m 18s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 15s master passed
_ Patch Compile Tests _
+1 :green_heart: mvninstall 2m 51s the patch passed
+1 :green_heart: compile 0m 14s the patch passed
+1 :green_heart: javac 0m 14s the patch passed
+1 :green_heart: shadedjars 4m 16s patch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 13s the patch passed
_ Other Tests _
+1 :green_heart: unit 1m 36s hbase-common in the patch passed.
22m 48s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4491
Optional Tests javac javadoc unit shadedjars compile
uname Linux 336b9e996888 5.4.0-1043-aws #45~18.04.1-Ubuntu SMP Fri Apr 9 23:32:25 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 176c43c5ad
Default Java AdoptOpenJDK-11.0.10+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/testReport/
Max. process+thread count 185 (vs. ulimit of 30000)
modules C: hbase-common U: hbase-common
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 07 '22 06:06 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 7m 4s Docker mode activated.
-0 :warning: yetus 0m 3s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 2m 38s master passed
+1 :green_heart: compile 0m 17s master passed
+1 :green_heart: shadedjars 4m 14s branch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 14s master passed
_ Patch Compile Tests _
+1 :green_heart: mvninstall 2m 42s the patch passed
+1 :green_heart: compile 0m 16s the patch passed
+1 :green_heart: javac 0m 16s the patch passed
+1 :green_heart: shadedjars 4m 13s patch has no errors when building our shaded downstream artifacts.
+1 :green_heart: javadoc 0m 13s the patch passed
_ Other Tests _
+1 :green_heart: unit 1m 37s hbase-common in the patch passed.
24m 35s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4491
Optional Tests javac javadoc unit shadedjars compile
uname Linux 8fd8b2e5b1b8 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 176c43c5ad
Default Java AdoptOpenJDK-1.8.0_282-b08
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/testReport/
Max. process+thread count 159 (vs. ulimit of 30000)
modules C: hbase-common U: hbase-common
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 07 '22 06:06 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 6m 25s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
_ master Compile Tests _
+1 :green_heart: mvninstall 2m 46s master passed
+1 :green_heart: compile 0m 31s master passed
+1 :green_heart: checkstyle 0m 14s master passed
+1 :green_heart: spotless 0m 41s branch has no errors when running spotless:check.
+1 :green_heart: spotbugs 0m 28s master passed
_ Patch Compile Tests _
+1 :green_heart: mvninstall 2m 37s the patch passed
+1 :green_heart: compile 0m 32s the patch passed
+1 :green_heart: javac 0m 32s the patch passed
+1 :green_heart: checkstyle 0m 14s the patch passed
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: hadoopcheck 13m 24s Patch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 :green_heart: spotless 0m 41s patch has no errors when running spotless:check.
+1 :green_heart: spotbugs 0m 34s the patch passed
_ Other Tests _
+1 :green_heart: asflicense 0m 10s The patch does not generate ASF License warnings.
35m 5s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/4491
Optional Tests dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
uname Linux c5c3223f5865 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 176c43c5ad
Default Java AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count 69 (vs. ulimit of 30000)
modules C: hbase-common U: hbase-common
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4491/2/console
versions git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Jun 07 '22 07:06 Apache-HBase

This is a configuration in Apache Commons-crypto and HBase use this library to do encryption. The default value of this buffer size is 8192. If we want to encrypt something more than 8192, such as 64*1024, setting the buffer size bigger is better. I think we can set this value to a configurable value.

wenwj0 avatar Jul 11 '22 12:07 wenwj0