hadoop icon indicating copy to clipboard operation
hadoop copied to clipboard

YARN-11626. Optimize ResourceManager's operations on Zookeeper metadata

Open XbaoWu opened this issue 1 year ago • 12 comments

Description of PR

For more information about this PR, please refer to the following issue: YARN-11626 Optimization of the safeDelete operation in ZKRMStateStore

The NoNodeException clearly indicates that the Znode no longer exists, so if we check again and find that the node does not actually exist, we can safely ignore this exception to avoid triggering a larger impact on the cluster caused by ResourceManager failover.

How was this patch tested?

add TestCheckRemoveZKNodeRMStateStore.testSafeDeleteZKNode()

For code changes:

  • [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • [x] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • [x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • [ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

XbaoWu avatar Feb 23 '24 03:02 XbaoWu

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 4m 32s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
-1 :x: mvninstall 0m 20s /branch-mvninstall-root.txt root in branch-3.3 failed.
-1 :x: compile 0m 22s /branch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
-0 :warning: checkstyle 0m 20s /buildtool-branch-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt The patch fails to run checkstyle in hadoop-yarn-server-resourcemanager
-1 :x: mvnsite 0m 22s /branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
-1 :x: javadoc 0m 20s /branch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
-1 :x: spotbugs 0m 20s /branch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
+1 :green_heart: shadedclient 2m 5s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
-1 :x: mvninstall 0m 21s /patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: compile 0m 21s /patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: javac 0m 21s /patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 19s /buildtool-patch-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt The patch fails to run checkstyle in hadoop-yarn-server-resourcemanager
-1 :x: mvnsite 0m 20s /patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: javadoc 0m 20s /patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: spotbugs 0m 20s /patch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
+1 :green_heart: shadedclient 2m 57s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 0m 20s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
+0 :ok: asflicense 0m 20s ASF License check generated no output?
15m 16s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/1/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 9e6fee3b3760 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / 0251b58fe2617ccdb8a8a53b5980dd73f8569b92
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/1/testReport/
Max. process+thread count 9 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/1/console
versions git=2.17.1 maven=3.6.0
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 23 '24 04:02 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 1m 45s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 58m 19s branch-3.3 passed
+1 :green_heart: compile 0m 58s branch-3.3 passed
+1 :green_heart: checkstyle 0m 44s branch-3.3 passed
+1 :green_heart: mvnsite 1m 3s branch-3.3 passed
+1 :green_heart: javadoc 0m 50s branch-3.3 passed
+1 :green_heart: spotbugs 1m 59s branch-3.3 passed
+1 :green_heart: shadedclient 35m 52s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 1m 0s the patch passed
+1 :green_heart: compile 0m 49s the patch passed
+1 :green_heart: javac 0m 49s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 32s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 8 new + 5 unchanged - 0 fixed = 13 total (was 5)
+1 :green_heart: mvnsite 0m 54s the patch passed
+1 :green_heart: javadoc 0m 35s the patch passed
+1 :green_heart: spotbugs 1m 57s the patch passed
+1 :green_heart: shadedclient 36m 1s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 98m 43s hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 36s The patch does not generate ASF License warnings.
244m 37s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/2/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux f4c8ec9c4bde 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / baf56d632a0ee56dd9096b55e675129d71c4d5b2
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/2/testReport/
Max. process+thread count 949 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/2/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 24 '24 09:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 4m 50s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 59m 51s branch-3.3 passed
+1 :green_heart: compile 0m 36s branch-3.3 passed
+1 :green_heart: checkstyle 0m 29s branch-3.3 passed
+1 :green_heart: mvnsite 0m 41s branch-3.3 passed
+1 :green_heart: javadoc 0m 36s branch-3.3 passed
+1 :green_heart: spotbugs 1m 17s branch-3.3 passed
+1 :green_heart: shadedclient 23m 48s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 43s the patch passed
+1 :green_heart: compile 0m 30s the patch passed
+1 :green_heart: javac 0m 30s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 20s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 8 new + 5 unchanged - 0 fixed = 13 total (was 5)
+1 :green_heart: mvnsite 0m 33s the patch passed
+1 :green_heart: javadoc 0m 24s the patch passed
+1 :green_heart: spotbugs 1m 25s the patch passed
-1 :x: shadedclient 26m 52s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 30m 17s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch passed.
+0 :ok: asflicense 0m 25s ASF License check generated no output?
155m 30s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA
hadoop.yarn.server.resourcemanager.TestRMHA
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/3/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 9d0efe4fa13d 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / c4094ebd48ed921b6b60587827eea68aa28bfc29
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/3/testReport/
Max. process+thread count 706 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/3/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 25 '24 19:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 19s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 44m 40s branch-3.3 passed
+1 :green_heart: compile 0m 36s branch-3.3 passed
+1 :green_heart: checkstyle 0m 28s branch-3.3 passed
+1 :green_heart: mvnsite 0m 38s branch-3.3 passed
+1 :green_heart: javadoc 0m 32s branch-3.3 passed
+1 :green_heart: spotbugs 1m 14s branch-3.3 passed
+1 :green_heart: shadedclient 21m 45s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 38s the patch passed
+1 :green_heart: compile 0m 30s the patch passed
+1 :green_heart: javac 0m 30s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 18s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 2 new + 5 unchanged - 0 fixed = 7 total (was 5)
+1 :green_heart: mvnsite 0m 32s the patch passed
+1 :green_heart: javadoc 0m 21s the patch passed
+1 :green_heart: spotbugs 1m 9s the patch passed
+1 :green_heart: shadedclient 21m 26s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 80m 45s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 25s The patch does not generate ASF License warnings.
177m 30s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.recovery.TestCheckRemoveZKNodeRMStateStore
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/4/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 62f075e61cd1 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / 1d50dd5546633b2c9991ce3f847086397d95acc5
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/4/testReport/
Max. process+thread count 934 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/4/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 26 '24 06:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 49m 7s branch-3.3 passed
+1 :green_heart: compile 0m 34s branch-3.3 passed
+1 :green_heart: checkstyle 0m 28s branch-3.3 passed
+1 :green_heart: mvnsite 0m 41s branch-3.3 passed
+1 :green_heart: javadoc 0m 35s branch-3.3 passed
+1 :green_heart: spotbugs 1m 16s branch-3.3 passed
+1 :green_heart: shadedclient 21m 31s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 40s the patch passed
+1 :green_heart: compile 0m 29s the patch passed
+1 :green_heart: javac 0m 29s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 16s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 2 new + 5 unchanged - 0 fixed = 7 total (was 5)
+1 :green_heart: mvnsite 0m 30s the patch passed
+1 :green_heart: javadoc 0m 20s the patch passed
+1 :green_heart: spotbugs 1m 9s the patch passed
+1 :green_heart: shadedclient 21m 32s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 80m 42s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 26s The patch does not generate ASF License warnings.
181m 56s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.recovery.TestCheckRemoveZKNodeRMStateStore
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/5/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux bf6af790a69f 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / d27aa4a3fe290663dca1036447602bfcafe06d12
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/5/testReport/
Max. process+thread count 911 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/5/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 26 '24 10:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 33m 44s branch-3.3 passed
+1 :green_heart: compile 0m 35s branch-3.3 passed
+1 :green_heart: checkstyle 0m 27s branch-3.3 passed
+1 :green_heart: mvnsite 0m 39s branch-3.3 passed
+1 :green_heart: javadoc 0m 32s branch-3.3 passed
+1 :green_heart: spotbugs 1m 15s branch-3.3 passed
+1 :green_heart: shadedclient 21m 36s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 37s the patch passed
+1 :green_heart: compile 0m 31s the patch passed
+1 :green_heart: javac 0m 31s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 18s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 2 new + 5 unchanged - 0 fixed = 7 total (was 5)
+1 :green_heart: mvnsite 0m 33s the patch passed
+1 :green_heart: javadoc 0m 21s the patch passed
+1 :green_heart: spotbugs 1m 12s the patch passed
+1 :green_heart: shadedclient 21m 37s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 80m 24s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 26s The patch does not generate ASF License warnings.
166m 21s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.recovery.TestCheckRemoveZKNodeRMStateStore
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/6/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 863b191a11d6 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / 847f51117995f954fdc734fd295ff2fc7153ca52
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/6/testReport/
Max. process+thread count 937 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/6/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 26 '24 15:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 24s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
-1 :x: mvninstall 1m 4s /branch-mvninstall-root.txt root in branch-3.3 failed.
-1 :x: compile 0m 22s /branch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
-0 :warning: checkstyle 0m 20s /buildtool-branch-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt The patch fails to run checkstyle in hadoop-yarn-server-resourcemanager
-1 :x: mvnsite 4m 7s /branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
+1 :green_heart: javadoc 0m 30s branch-3.3 passed
-1 :x: spotbugs 0m 19s /branch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in branch-3.3 failed.
-1 :x: shadedclient 6m 8s branch has errors when building and testing our client artifacts.
_ Patch Compile Tests _
-1 :x: mvninstall 0m 22s /patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: compile 0m 22s /patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: javac 0m 22s /patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 20s /buildtool-patch-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt The patch fails to run checkstyle in hadoop-yarn-server-resourcemanager
-1 :x: mvnsite 0m 22s /patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: javadoc 0m 21s /patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
-1 :x: spotbugs 0m 21s /patch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
+1 :green_heart: shadedclient 3m 1s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 0m 20s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch failed.
+0 :ok: asflicense 0m 21s ASF License check generated no output?
16m 8s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/7/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 5c245fb89784 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / caa4a75c006fdec66844f940fda19c0fe7269e97
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/7/testReport/
Max. process+thread count 89 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/7/console
versions git=2.17.1 maven=3.6.0
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 27 '24 04:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 33m 12s branch-3.3 passed
+1 :green_heart: compile 0m 37s branch-3.3 passed
+1 :green_heart: checkstyle 0m 29s branch-3.3 passed
+1 :green_heart: mvnsite 0m 40s branch-3.3 passed
+1 :green_heart: javadoc 0m 33s branch-3.3 passed
+1 :green_heart: spotbugs 1m 16s branch-3.3 passed
+1 :green_heart: shadedclient 21m 42s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 37s the patch passed
+1 :green_heart: compile 0m 30s the patch passed
+1 :green_heart: javac 0m 30s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 19s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 2 new + 5 unchanged - 0 fixed = 7 total (was 5)
+1 :green_heart: mvnsite 0m 30s the patch passed
+1 :green_heart: javadoc 0m 21s the patch passed
+1 :green_heart: spotbugs 1m 11s the patch passed
+1 :green_heart: shadedclient 21m 10s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 80m 40s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 25s The patch does not generate ASF License warnings.
166m 5s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.recovery.TestCheckRemoveZKNodeRMStateStore
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/8/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 80a05f23c3c6 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / dd5be7c235ea01f2ddeb70ff8bc27687f2f31625
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/8/testReport/
Max. process+thread count 945 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/8/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 27 '24 10:02 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 3m 50s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 33m 58s branch-3.3 passed
+1 :green_heart: compile 0m 35s branch-3.3 passed
+1 :green_heart: checkstyle 0m 28s branch-3.3 passed
+1 :green_heart: mvnsite 0m 41s branch-3.3 passed
+1 :green_heart: javadoc 0m 32s branch-3.3 passed
+1 :green_heart: spotbugs 1m 20s branch-3.3 passed
+1 :green_heart: shadedclient 21m 51s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 36s the patch passed
+1 :green_heart: compile 0m 31s the patch passed
+1 :green_heart: javac 0m 31s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 17s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 2 new + 5 unchanged - 0 fixed = 7 total (was 5)
+1 :green_heart: mvnsite 0m 33s the patch passed
+1 :green_heart: javadoc 0m 22s the patch passed
+1 :green_heart: spotbugs 1m 16s the patch passed
+1 :green_heart: shadedclient 21m 21s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 81m 3s hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 25s The patch does not generate ASF License warnings.
170m 43s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/9/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux ebf28a942b8c 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / 97f7996875d5ca1f8ba369dcb54ed86e2429ad4c
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/9/testReport/
Max. process+thread count 926 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/9/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 03 '24 13:03 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 21s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.3 Compile Tests _
+1 :green_heart: mvninstall 36m 36s branch-3.3 passed
+1 :green_heart: compile 0m 30s branch-3.3 passed
+1 :green_heart: checkstyle 0m 25s branch-3.3 passed
+1 :green_heart: mvnsite 0m 36s branch-3.3 passed
+1 :green_heart: javadoc 0m 34s branch-3.3 passed
+1 :green_heart: spotbugs 1m 22s branch-3.3 passed
+1 :green_heart: shadedclient 25m 42s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 36s the patch passed
+1 :green_heart: compile 0m 31s the patch passed
+1 :green_heart: javac 0m 31s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 0m 21s /results-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 3 new + 5 unchanged - 0 fixed = 8 total (was 5)
+1 :green_heart: mvnsite 0m 34s the patch passed
+1 :green_heart: javadoc 0m 25s the patch passed
+1 :green_heart: spotbugs 1m 19s the patch passed
+1 :green_heart: shadedclient 25m 30s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 80m 12s hadoop-yarn-server-resourcemanager in the patch passed.
+1 :green_heart: asflicense 0m 23s The patch does not generate ASF License warnings.
177m 27s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/10/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/6577
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 460b1e90ebc9 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.3 / 0451694b8d0066271a5a500fdfcb9b2e318cc8bb
Default Java Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/10/testReport/
Max. process+thread count 950 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6577/10/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 06 '24 15:03 hadoop-yetus

Hi @XbaoWu Please submit PR to trunk first, if approved and committed to trunk, then backport to other active branches if necessary.

Hexiaoqiao avatar Mar 07 '24 09:03 Hexiaoqiao

Hi @XbaoWu Please submit PR to trunk first, if approved and committed to trunk, then backport to other active branches if necessary.

Okay, thank you for your reminder

XbaoWu avatar Mar 07 '24 11:03 XbaoWu