hadoop icon indicating copy to clipboard operation
hadoop copied to clipboard

HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored()

Open steveloughran opened this issue 5 months ago • 10 comments

Description of PR

  • Lets you turn off checksumming in local fs (but not hdfs!) with option file.verify-checksum
  • Has copy of Parquet's TrackingByteBufferAllocator, modified for Hadoop APIs and named TrackingByteBufferPool; not yet used in tests.
  • New capability "fs.capability.vectoredio.sliced" to declare that you slice buffers.

How was this patch tested?

no tests yet.

For code changes:

  • [X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • [ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

steveloughran avatar Jun 09 '25 18:06 steveloughran

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 40s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.4 Compile Tests _
+1 :green_heart: mvninstall 40m 9s branch-3.4 passed
+1 :green_heart: compile 19m 6s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 16m 52s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 16s branch-3.4 passed
+1 :green_heart: mvnsite 1m 36s branch-3.4 passed
+1 :green_heart: javadoc 1m 8s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 51s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 32s branch-3.4 passed
+1 :green_heart: shadedclient 37m 6s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 56s the patch passed
+1 :green_heart: compile 17m 47s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 17m 47s the patch passed
+1 :green_heart: compile 16m 15s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 16m 15s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 1 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 1m 8s /results-checkstyle-hadoop-common-project_hadoop-common.txt hadoop-common-project/hadoop-common: The patch generated 10 new + 71 unchanged - 0 fixed = 81 total (was 71)
+1 :green_heart: mvnsite 1m 34s the patch passed
+1 :green_heart: javadoc 1m 9s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 50s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 43s the patch passed
+1 :green_heart: shadedclient 38m 23s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 24s hadoop-common in the patch passed.
+1 :green_heart: asflicense 1m 5s The patch does not generate ASF License warnings.
223m 45s
Subsystem Report/Notes
Docker ClientAPI=1.50 ServerAPI=1.50 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/1/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint
uname Linux a0b236b49d33 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / a19a65f1d8c5aee0c792bf57fd61daf538af37ef
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/1/testReport/
Max. process+thread count 2093 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jun 09 '25 22:06 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 19m 10s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-3.4 Compile Tests _
+1 :green_heart: mvninstall 39m 7s branch-3.4 passed
+1 :green_heart: compile 19m 28s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 20m 30s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 26s branch-3.4 passed
+1 :green_heart: mvnsite 1m 54s branch-3.4 passed
+1 :green_heart: javadoc 1m 27s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 54s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 4s branch-3.4 passed
+1 :green_heart: shadedclient 42m 58s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 56s the patch passed
+1 :green_heart: compile 18m 20s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 18m 20s the patch passed
+1 :green_heart: compile 17m 52s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 17m 52s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 1m 16s /results-checkstyle-hadoop-common-project_hadoop-common.txt hadoop-common-project/hadoop-common: The patch generated 10 new + 71 unchanged - 0 fixed = 81 total (was 71)
+1 :green_heart: mvnsite 1m 36s the patch passed
+1 :green_heart: javadoc 1m 9s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 50s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 43s the patch passed
+1 :green_heart: shadedclient 39m 43s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 35s hadoop-common in the patch passed.
+1 :green_heart: asflicense 1m 4s The patch does not generate ASF License warnings.
256m 12s
Subsystem Report/Notes
Docker ClientAPI=1.50 ServerAPI=1.50 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/2/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint
uname Linux eae6368fc6d0 5.15.0-139-generic #149-Ubuntu SMP Fri Apr 11 22:06:13 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / 86d6bacafd412602e80e5085f33e906aa40d5a4c
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/2/testReport/
Max. process+thread count 1263 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/2/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jun 09 '25 23:06 hadoop-yetus

  • @mukund-thakur @ahmarsuhail @cnauroth

trying to put this together. No attempts to address, just

  • explicit ability to turn it off in localfs
  • capability to declare when slicing still takes place (which does nothing for older releases)

steveloughran avatar Jun 10 '25 12:06 steveloughran

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 57s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ branch-3.4 Compile Tests _
+1 :green_heart: mvninstall 35m 43s branch-3.4 passed
+1 :green_heart: compile 17m 48s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 16m 1s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 41s branch-3.4 passed
+1 :green_heart: mvnsite 1m 36s branch-3.4 passed
+1 :green_heart: javadoc 1m 9s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 48s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 31s branch-3.4 passed
+1 :green_heart: shadedclient 35m 22s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 53s the patch passed
+1 :green_heart: compile 17m 42s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 17m 42s the patch passed
+1 :green_heart: compile 16m 42s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 16m 42s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 1m 42s /results-checkstyle-hadoop-common-project_hadoop-common.txt hadoop-common-project/hadoop-common: The patch generated 7 new + 71 unchanged - 0 fixed = 78 total (was 71)
+1 :green_heart: mvnsite 1m 29s the patch passed
+1 :green_heart: javadoc 1m 2s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 46s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 35s the patch passed
+1 :green_heart: shadedclient 36m 59s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 9s hadoop-common in the patch passed.
+1 :green_heart: asflicense 1m 5s The patch does not generate ASF License warnings.
216m 46s
Subsystem Report/Notes
Docker ClientAPI=1.50 ServerAPI=1.50 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/3/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint
uname Linux 21d2d201a0b5 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / 1096112dc09f885a59185956ccd6e22da36b4b97
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/3/testReport/
Max. process+thread count 1257 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/3/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jun 10 '25 20:06 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 36s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ branch-3.4 Compile Tests _
+1 :green_heart: mvninstall 36m 35s branch-3.4 passed
+1 :green_heart: compile 19m 13s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 16m 21s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 1m 12s branch-3.4 passed
+1 :green_heart: mvnsite 1m 35s branch-3.4 passed
+1 :green_heart: javadoc 1m 11s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 48s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 31s branch-3.4 passed
+1 :green_heart: shadedclient 36m 2s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 0m 56s the patch passed
+1 :green_heart: compile 17m 36s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 17m 36s the patch passed
+1 :green_heart: compile 17m 13s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 17m 13s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 1m 5s /results-checkstyle-hadoop-common-project_hadoop-common.txt hadoop-common-project/hadoop-common: The patch generated 3 new + 71 unchanged - 0 fixed = 74 total (was 71)
+1 :green_heart: mvnsite 1m 30s the patch passed
+1 :green_heart: javadoc 1m 3s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 0m 45s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 2m 33s the patch passed
+1 :green_heart: shadedclient 37m 23s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 17s hadoop-common in the patch passed.
+1 :green_heart: asflicense 1m 7s The patch does not generate ASF License warnings.
218m 53s
Subsystem Report/Notes
Docker ClientAPI=1.50 ServerAPI=1.50 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/4/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint
uname Linux 8b18afeea3ae 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / 995fcc4b320aaf123fcb122ef908731804259dfa
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/4/testReport/
Max. process+thread count 3149 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/4/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jun 10 '25 20:06 hadoop-yetus

./hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/TrackingByteBufferPool.java:101:  public static class LeakDetectorHeapByteBufferPoolException extends RuntimeException {: Class LeakDetectorHeapByteBufferPoolException should be declared as final. [FinalClass]
./hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractVectoredReadTest.java:643:    TrackingByteBufferPool pool = TrackingByteBufferPool.wrap(getPool());:28: 'pool' hides a field. [HiddenField]
./hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractVectoredReadTest.java:679:      LOG.info("Slicing is enabled; we saw leaked buffers: {} after {} releases of unknown bufferfs",: Line is longer than 100 characters (found 101). [LineLength]

steveloughran avatar Jun 11 '25 14:06 steveloughran

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 57s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ branch-3.4 Compile Tests _
+0 :ok: mvndep 1m 56s Maven dependency ordering for branch
+1 :green_heart: mvninstall 39m 36s branch-3.4 passed
+1 :green_heart: compile 19m 16s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 17m 55s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 4m 40s branch-3.4 passed
+1 :green_heart: mvnsite 2m 36s branch-3.4 passed
+1 :green_heart: javadoc 1m 53s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 42s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 53s branch-3.4 passed
+1 :green_heart: shadedclient 38m 45s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 32s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 29s the patch passed
+1 :green_heart: compile 18m 39s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 18m 39s the patch passed
+1 :green_heart: compile 17m 42s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 17m 42s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 35s /results-checkstyle-root.txt root: The patch generated 1 new + 72 unchanged - 0 fixed = 73 total (was 72)
+1 :green_heart: mvnsite 2m 32s the patch passed
+1 :green_heart: javadoc 1m 50s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 36s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 4m 11s the patch passed
+1 :green_heart: shadedclient 38m 41s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 19m 39s /patch-unit-hadoop-common-project_hadoop-common.txt hadoop-common in the patch passed.
+1 :green_heart: unit 2m 59s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 6s The patch does not generate ASF License warnings.
253m 36s
Reason Tests
Failed junit tests hadoop.conf.TestCommonConfigurationFields
Subsystem Report/Notes
Docker ClientAPI=1.50 ServerAPI=1.50 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/5/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint markdownlint
uname Linux 2acec7f2cd0d 5.15.0-139-generic #149-Ubuntu SMP Fri Apr 11 22:06:13 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / 0ea6638067bf6800d37bdd284b61008bf5f6549e
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/5/testReport/
Max. process+thread count 1254 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/5/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jun 11 '25 19:06 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 12m 20s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ branch-3.4 Compile Tests _
+0 :ok: mvndep 1m 44s Maven dependency ordering for branch
+1 :green_heart: mvninstall 36m 15s branch-3.4 passed
+1 :green_heart: compile 17m 45s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 16m 8s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 4m 32s branch-3.4 passed
+1 :green_heart: mvnsite 2m 33s branch-3.4 passed
+1 :green_heart: javadoc 1m 51s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 45s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 56s branch-3.4 passed
+1 :green_heart: shadedclient 35m 56s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 32s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 28s the patch passed
+1 :green_heart: compile 17m 59s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 17m 59s the patch passed
+1 :green_heart: compile 16m 48s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 16m 48s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 29s /results-checkstyle-root.txt root: The patch generated 1 new + 72 unchanged - 0 fixed = 73 total (was 72)
+1 :green_heart: mvnsite 2m 30s the patch passed
+1 :green_heart: javadoc 1m 52s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 43s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 4m 12s the patch passed
+1 :green_heart: shadedclient 36m 6s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 30s hadoop-common in the patch passed.
+1 :green_heart: unit 3m 12s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 7s The patch does not generate ASF License warnings.
251m 9s
Subsystem Report/Notes
Docker ClientAPI=1.50 ServerAPI=1.50 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/6/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint markdownlint
uname Linux 9cb8ad193468 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / de78242f0ae51dc0cff0e5775270a011e0945ed0
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/6/testReport/
Max. process+thread count 3148 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/6/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jun 17 '25 17:06 hadoop-yetus

LGTM overall pending comments about typos.

The expected message was emitted on AbstractContractVectoredReadTest.

2025-06-18 22:19:40,235 [JUnit-testBufferSlicing[Buffer type : array]] INFO  contract.AbstractContractVectoredReadTest (AbstractContractVectoredReadTest.java:testBufferSlicing(679)) - Slicing is enabled; we saw leaked buffers: 16 after 8 releases of unknown buffers

The modified ITestS3AContractVectoredRead passed against Tokyo region without messages mentioning sliced/leaked buffers.

$ mvn verify -Dtest=x -Dit.test=ITestS3AContractVectoredRead
...
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead
[INFO] Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.202 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead

iwasakims avatar Jun 18 '25 22:06 iwasakims

The failure of TestCommonConfigurationFields looks caused by the property added to core-default.xml.

[ERROR] testCompareXmlAgainstConfigurationClass(org.apache.hadoop.conf.TestCommonConfigurationFields)  Time elapsed: 0.27 s  <<< FAILURE!
java.lang.AssertionError: core-default.xml has 1 properties missing in  class org.apache.hadoop.fs.CommonConfigurationKeys  class org.apache.hadoop.fs.CommonConfigurationKeysPublic  class org.apache.hadoop.fs.local.LocalConfigKeys  class org.apache.hadoop.fs.ftp.FtpConfigKeys  class org.apache.hadoop.ha.SshFenceByTcpPort  class org.apache.hadoop.security.LdapGroupsMapping  class org.apache.hadoop.ha.ZKFailoverController  class org.apache.hadoop.security.ssl.SSLFactory  class org.apache.hadoop.security.CompositeGroupsMapping  class org.apache.hadoop.io.erasurecode.CodecUtil  class org.apache.hadoop.security.RuleBasedLdapGroupsMapping Entries:   fs.file.checksum.verify expected:<0> but was:<1>

iwasakims avatar Jun 19 '25 00:06 iwasakims

.. will look at this asap

steveloughran avatar Jul 16 '25 12:07 steveloughran

latest pr tries to address comments, plus fixing failing test

manually run itests for s3, s3 + analytics and abfs

steveloughran avatar Jul 16 '25 18:07 steveloughran

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 11m 57s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ branch-3.4 Compile Tests _
+0 :ok: mvndep 14m 13s Maven dependency ordering for branch
+1 :green_heart: mvninstall 64m 39s branch-3.4 passed
+1 :green_heart: compile 16m 51s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 15m 16s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 4m 17s branch-3.4 passed
+1 :green_heart: mvnsite 2m 39s branch-3.4 passed
+1 :green_heart: javadoc 2m 0s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 46s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 50s branch-3.4 passed
+1 :green_heart: shadedclient 33m 22s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 33s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 25s the patch passed
+1 :green_heart: compile 16m 12s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 16m 12s the patch passed
+1 :green_heart: compile 15m 15s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 15m 15s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 9s /results-checkstyle-root.txt root: The patch generated 1 new + 142 unchanged - 0 fixed = 143 total (was 142)
+1 :green_heart: mvnsite 2m 35s the patch passed
+1 :green_heart: javadoc 1m 50s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 44s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 4m 12s the patch passed
+1 :green_heart: shadedclient 33m 32s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 16s hadoop-common in the patch passed.
+1 :green_heart: unit 3m 9s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 6s The patch does not generate ASF License warnings.
280m 26s
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/7/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint markdownlint
uname Linux 111934e6afe5 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / b66370163a1ccd4a44b28e68b08e1c9fe79b2f1a
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/7/testReport/
Max. process+thread count 2630 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/7/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 16 '25 23:07 hadoop-yetus

Checkstyle is mistaken, there is a subclass ByteBufferAllocationStacktraceException.

steveloughran avatar Jul 17 '25 09:07 steveloughran

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 37s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ branch-3.4 Compile Tests _
+0 :ok: mvndep 8m 36s Maven dependency ordering for branch
-1 :x: mvninstall 4m 18s /branch-mvninstall-root.txt root in branch-3.4 failed.
+1 :green_heart: compile 36m 8s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 17m 5s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
-0 :warning: checkstyle 1m 23s /buildtool-branch-checkstyle-root.txt The patch fails to run checkstyle in root
-1 :x: mvnsite 0m 42s /branch-mvnsite-hadoop-tools_hadoop-aws.txt hadoop-aws in branch-3.4 failed.
-1 :x: javadoc 0m 32s /branch-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt hadoop-aws in branch-3.4 failed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.
-1 :x: javadoc 0m 33s /branch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt hadoop-aws in branch-3.4 failed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.
-1 :x: spotbugs 0m 33s /branch-spotbugs-hadoop-tools_hadoop-aws.txt hadoop-aws in branch-3.4 failed.
+1 :green_heart: shadedclient 35m 6s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 17s Maven dependency ordering for patch
-1 :x: mvninstall 0m 25s /patch-mvninstall-hadoop-common-project_hadoop-common.txt hadoop-common in the patch failed.
-1 :x: mvninstall 0m 12s /patch-mvninstall-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: compile 0m 39s /patch-compile-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt root in the patch failed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.
-1 :x: javac 0m 39s /patch-compile-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt root in the patch failed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.
-1 :x: compile 0m 39s /patch-compile-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt root in the patch failed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.
-1 :x: javac 0m 39s /patch-compile-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt root in the patch failed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 1m 4s /buildtool-patch-checkstyle-root.txt The patch fails to run checkstyle in root
-1 :x: mvnsite 0m 27s /patch-mvnsite-hadoop-common-project_hadoop-common.txt hadoop-common in the patch failed.
-1 :x: mvnsite 0m 11s /patch-mvnsite-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: javadoc 0m 25s /patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt hadoop-common in the patch failed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.
-1 :x: javadoc 0m 12s /patch-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt hadoop-aws in the patch failed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.
-1 :x: javadoc 0m 24s /patch-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt hadoop-common in the patch failed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.
-1 :x: javadoc 0m 13s /patch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt hadoop-aws in the patch failed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.
-1 :x: spotbugs 0m 25s /patch-spotbugs-hadoop-common-project_hadoop-common.txt hadoop-common in the patch failed.
-1 :x: spotbugs 0m 12s /patch-spotbugs-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: shadedclient 7m 4s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 :x: unit 0m 24s /patch-unit-hadoop-common-project_hadoop-common.txt hadoop-common in the patch failed.
-1 :x: unit 0m 12s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
+1 :green_heart: asflicense 0m 29s The patch does not generate ASF License warnings.
121m 24s
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/8/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint markdownlint
uname Linux 264ac290045a 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / 6daf71bd02de8d916141f483d2e5145965f5b94a
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/8/testReport/
Max. process+thread count 552 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/8/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 17 '25 11:07 hadoop-yetus

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 38s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ branch-3.4 Compile Tests _
+0 :ok: mvndep 6m 12s Maven dependency ordering for branch
+1 :green_heart: mvninstall 45m 25s branch-3.4 passed
+1 :green_heart: compile 16m 56s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: compile 15m 25s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: checkstyle 4m 12s branch-3.4 passed
+1 :green_heart: mvnsite 2m 32s branch-3.4 passed
+1 :green_heart: javadoc 1m 57s branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 44s branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 3m 51s branch-3.4 passed
+1 :green_heart: shadedclient 33m 0s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 34s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 25s the patch passed
+1 :green_heart: compile 15m 57s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javac 15m 57s the patch passed
+1 :green_heart: compile 15m 14s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: javac 15m 14s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 9s /results-checkstyle-root.txt root: The patch generated 1 new + 142 unchanged - 0 fixed = 143 total (was 142)
+1 :green_heart: mvnsite 2m 34s the patch passed
+1 :green_heart: javadoc 1m 51s the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 :green_heart: javadoc 1m 41s the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
+1 :green_heart: spotbugs 4m 11s the patch passed
+1 :green_heart: shadedclient 33m 32s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 19m 47s hadoop-common in the patch passed.
+1 :green_heart: unit 3m 7s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 4s The patch does not generate ASF License warnings.
241m 48s
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/9/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7732
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint markdownlint
uname Linux bdb89350c86a 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-3.4 / f749eebb9f39f325478f800d8cad4ad31d219275
Default Java Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/9/testReport/
Max. process+thread count 1252 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7732/9/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Jul 18 '25 17:07 hadoop-yetus