hbase icon indicating copy to clipboard operation
hbase copied to clipboard
verified publisher icon apache

HBASE-29660 submittedRegionProcedures data leak in HRegionServer when…

Open chaijunjie0101 opened this issue 2 months ago • 9 comments

https://issues.apache.org/jira/browse/HBASE-29660

chaijunjie0101 avatar Oct 13 '25 15:10 chaijunjie0101

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 29s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
_ master Compile Tests _
+1 :green_heart: mvninstall 3m 55s master passed
+1 :green_heart: compile 3m 34s master passed
+1 :green_heart: checkstyle 0m 39s master passed
+1 :green_heart: spotbugs 1m 42s master passed
+1 :green_heart: spotless 0m 53s branch has no errors when running spotless:check.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 3m 15s the patch passed
+1 :green_heart: compile 3m 30s the patch passed
+1 :green_heart: javac 3m 30s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 0m 38s the patch passed
+1 :green_heart: spotbugs 1m 47s the patch passed
+1 :green_heart: hadoopcheck 12m 40s Patch does not cause any errors with Hadoop 3.3.6 3.4.1.
+1 :green_heart: spotless 0m 46s patch has no errors when running spotless:check.
_ Other Tests _
+1 :green_heart: asflicense 0m 12s The patch does not generate ASF License warnings.
42m 7s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7381
Optional Tests dupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
uname Linux 1d185061e95b 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 8c71b49aa9da20bd4aa97ecfa9044654ddea586a
Default Java Eclipse Adoptium-17.0.11+9
Max. process+thread count 85 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/1/console
versions git=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Oct 13 '25 17:10 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 32s Docker mode activated.
-0 :warning: yetus 0m 3s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 3m 53s master passed
+1 :green_heart: compile 1m 0s master passed
+1 :green_heart: javadoc 0m 30s master passed
+1 :green_heart: shadedjars 6m 24s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 3m 10s the patch passed
+1 :green_heart: compile 0m 59s the patch passed
+1 :green_heart: javac 0m 59s the patch passed
+1 :green_heart: javadoc 0m 28s the patch passed
+1 :green_heart: shadedjars 6m 18s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 :x: unit 229m 20s /patch-unit-hbase-server.txt hbase-server in the patch failed.
257m 28s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7381
Optional Tests javac javadoc unit compile shadedjars
uname Linux 5828e43c5f6c 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 8c71b49aa9da20bd4aa97ecfa9044654ddea586a
Default Java Eclipse Adoptium-17.0.11+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/1/testReport/
Max. process+thread count 3976 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/1/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Oct 13 '25 21:10 Apache-HBase

java.lang.IllegalArgumentException: Can't get Kerberos realm at org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:71) at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:314) at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:365) at org.apache.hadoop.hbase.security.HBaseKerberosUtils.setSecuredHadoopConfiguration(HBaseKerberosUtils.java:151) at org.apache.hadoop.hbase.security.HBaseKerberosUtils.setSecuredConfiguration(HBaseKerberosUtils.java:119) at org.apache.hadoop.hbase.ipc.TestSecureNettyRpcServer.setup(TestSecureNettyRpcServer.java:65) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: java.lang.IllegalArgumentException: KrbException: Cannot locate default realm at java.security.jgss/javax.security.auth.kerberos.KerberosPrincipal.<init>(KerberosPrincipal.java:199) at org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:120) at org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:69) ... 8 more

All failed tests because "Can't get Kerberos realm"....see https://issues.apache.org/jira/browse/HBASE-29275

chaijunjie0101 avatar Oct 14 '25 02:10 chaijunjie0101

I think we also need to add this call in other places where we return earlier in AssignRegionHandler.process?

Apache9 avatar Oct 15 '25 14:10 Apache9

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 2m 24s Docker mode activated.
-0 :warning: yetus 0m 3s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 6m 20s master passed
+1 :green_heart: compile 1m 28s master passed
+1 :green_heart: javadoc 0m 43s master passed
+1 :green_heart: shadedjars 8m 21s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 4m 58s the patch passed
+1 :green_heart: compile 1m 26s the patch passed
+1 :green_heart: javac 1m 26s the patch passed
+1 :green_heart: javadoc 0m 40s the patch passed
+1 :green_heart: shadedjars 8m 19s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 :x: unit 19m 28s /patch-unit-hbase-server.txt hbase-server in the patch failed.
56m 3s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/2/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7381
Optional Tests javac javadoc unit compile shadedjars
uname Linux b5193efb3ecc 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 205fd7cdc33d3cf6b4edbc6ac667aee3db689509
Default Java Eclipse Adoptium-17.0.11+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/2/testReport/
Max. process+thread count 772 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/2/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Oct 16 '25 14:10 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 2m 22s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
_ master Compile Tests _
+1 :green_heart: mvninstall 6m 55s master passed
+1 :green_heart: compile 5m 0s master passed
+1 :green_heart: checkstyle 0m 55s master passed
+1 :green_heart: spotbugs 2m 28s master passed
+1 :green_heart: spotless 1m 13s branch has no errors when running spotless:check.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 4m 58s the patch passed
+1 :green_heart: compile 4m 41s the patch passed
+1 :green_heart: javac 4m 41s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 0m 48s the patch passed
+1 :green_heart: spotbugs 2m 34s the patch passed
+1 :green_heart: hadoopcheck 15m 4s Patch does not cause any errors with Hadoop 3.3.6 3.4.1.
+1 :green_heart: spotless 1m 2s patch has no errors when running spotless:check.
_ Other Tests _
+1 :green_heart: asflicense 0m 16s The patch does not generate ASF License warnings.
57m 32s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7381
Optional Tests dupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
uname Linux b65349dd30bd 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 205fd7cdc33d3cf6b4edbc6ac667aee3db689509
Default Java Eclipse Adoptium-17.0.11+9
Max. process+thread count 71 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/2/console
versions git=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Oct 16 '25 14:10 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 29s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
_ master Compile Tests _
+1 :green_heart: mvninstall 4m 16s master passed
+1 :green_heart: compile 5m 27s master passed
+1 :green_heart: checkstyle 1m 15s master passed
+1 :green_heart: spotbugs 2m 47s master passed
+1 :green_heart: spotless 1m 29s branch has no errors when running spotless:check.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 4m 35s the patch passed
+1 :green_heart: compile 4m 48s the patch passed
+1 :green_heart: javac 4m 48s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 0m 45s the patch passed
+1 :green_heart: spotbugs 2m 3s the patch passed
+1 :green_heart: hadoopcheck 15m 55s Patch does not cause any errors with Hadoop 3.3.6 3.4.1.
+1 :green_heart: spotless 1m 12s patch has no errors when running spotless:check.
_ Other Tests _
+1 :green_heart: asflicense 0m 19s The patch does not generate ASF License warnings.
56m 39s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7381
Optional Tests dupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
uname Linux 985b02997b6b 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 39e0054c3a4eedc24e56c52b22b2537e1949c851
Default Java Eclipse Adoptium-17.0.11+9
Max. process+thread count 84 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/3/console
versions git=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Oct 16 '25 16:10 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 56s Docker mode activated.
-0 :warning: yetus 0m 3s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 :green_heart: mvninstall 5m 47s master passed
+1 :green_heart: compile 1m 29s master passed
+1 :green_heart: javadoc 0m 48s master passed
+1 :green_heart: shadedjars 9m 30s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 5m 0s the patch passed
+1 :green_heart: compile 1m 30s the patch passed
+1 :green_heart: javac 1m 30s the patch passed
+1 :green_heart: javadoc 0m 44s the patch passed
+1 :green_heart: shadedjars 9m 33s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 :green_heart: unit 264m 12s hbase-server in the patch passed.
304m 21s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/3/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7381
Optional Tests javac javadoc unit compile shadedjars
uname Linux 4ad5a4e1c27d 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 39e0054c3a4eedc24e56c52b22b2537e1949c851
Default Java Eclipse Adoptium-17.0.11+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/3/testReport/
Max. process+thread count 3475 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7381/3/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Oct 16 '25 20:10 Apache-HBase

I think we also need to add this call in other places where we return earlier in AssignRegionHandler.process?

yes, I added it before all "return" in AssignRegionHandler.process, just besides "rs.getExecutorService().delayedSubmit", it resubmit this assignRegionHandler, so it is in process, I think we should not call here, please review again, thanks sir. @Apache9

chaijunjie0101 avatar Oct 17 '25 03:10 chaijunjie0101