hadoop icon indicating copy to clipboard operation
hadoop copied to clipboard

HADOOP-19399. S3A: support CRT client.

Open ahmarsuhail opened this issue 9 months ago • 22 comments

Description of PR

Adds support S3 CRT client.

  • Configuration mapping b/w clients is getting tricky, I moved endpoint/region resolution logic out so it can be re-used.

  • CRT does not support client level headers for user agent and requester pays, so those have to be added on a per request level. Only added for copyObject() and putObject() as those are the only two places CRT will be used in S3A.

How was this patch tested?

Tested in us-east-2 with mvn -Dparallel-tests -DtestsThreadCount=16 clean verify. All good, failures is ITestS3AEndpointRegion and ITestAwsSdkWorkarounds are related to SDK upgrade.

For code changes:

  • [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • [ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

ahmarsuhail avatar Feb 28 '25 15:02 ahmarsuhail

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 50s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 28s Maven dependency ordering for branch
+1 :green_heart: mvninstall 36m 5s trunk passed
+1 :green_heart: compile 17m 35s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 15m 40s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 36s trunk passed
+1 :green_heart: mvnsite 1m 34s trunk passed
+1 :green_heart: javadoc 1m 30s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 23s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 42s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 39m 42s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 34s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 48s the patch passed
+1 :green_heart: compile 17m 10s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 17m 10s the patch passed
+1 :green_heart: compile 15m 16s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 15m 16s the patch passed
+1 :green_heart: blanks 0m 1s The patch has no blanks issues.
-0 :warning: checkstyle 4m 39s /results-checkstyle-root.txt root: The patch generated 6 new + 12 unchanged - 0 fixed = 18 total (was 12)
+1 :green_heart: mvnsite 1m 31s the patch passed
-1 :x: javadoc 0m 50s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
-1 :x: javadoc 0m 47s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+0 :ok: spotbugs 0m 36s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 39m 49s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 33s hadoop-project in the patch passed.
-1 :x: unit 3m 21s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 2s The patch does not generate ASF License warnings.
221m 7s
Reason Tests
Failed junit tests hadoop.fs.s3a.impl.TestClientManager
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/1/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 7146247aa952 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 982826fbcd8c098bc2e24184e7b2e756b9044cf8
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/1/testReport/
Max. process+thread count 581 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Feb 28 '25 19:02 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 18m 57s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 41s Maven dependency ordering for branch
+1 :green_heart: mvninstall 36m 22s trunk passed
+1 :green_heart: compile 17m 33s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 15m 13s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 36s trunk passed
+1 :green_heart: mvnsite 1m 32s trunk passed
+1 :green_heart: javadoc 1m 29s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 20s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 40s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 39m 15s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 35s Maven dependency ordering for patch
-1 :x: mvninstall 0m 20s /patch-mvninstall-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: compile 16m 3s /patch-compile-root-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt root in the patch failed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.
-1 :x: javac 16m 3s /patch-compile-root-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt root in the patch failed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.
-1 :x: compile 14m 23s /patch-compile-root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt root in the patch failed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.
-1 :x: javac 14m 23s /patch-compile-root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt root in the patch failed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 33s /results-checkstyle-root.txt root: The patch generated 22 new + 21 unchanged - 3 fixed = 43 total (was 24)
-1 :x: mvnsite 0m 43s /patch-mvnsite-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: javadoc 0m 49s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
-1 :x: javadoc 0m 47s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+0 :ok: spotbugs 0m 36s hadoop-project has no data from spotbugs
-1 :x: spotbugs 0m 42s /patch-spotbugs-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
+1 :green_heart: shadedclient 38m 28s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 34s hadoop-project in the patch passed.
-1 :x: unit 0m 45s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: asflicense 1m 3s /results-asflicense.txt The patch generated 2 ASF License warnings.
231m 54s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/2/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname Linux 59e71f68690e 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 1e9f1437d96bac85f698bc2380f68cc37798eb6c
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/2/testReport/
Max. process+thread count 535 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/2/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 03 '25 20:03 hadoop-yetus

@steveloughran @mukund-thakur @shameersss1

Could you please review? Internal TPC-DS benchmarks for AAL seem to be consistently showing better numbers with CRT, possibly due to the CRT's enhanced connection management, so want to get this in for 3.4.2.

ahmarsuhail avatar Mar 07 '25 13:03 ahmarsuhail

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 21s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 5m 38s Maven dependency ordering for branch
+1 :green_heart: mvninstall 19m 16s trunk passed
+1 :green_heart: compile 8m 26s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 7m 23s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 1m 59s trunk passed
+1 :green_heart: mvnsite 1m 5s trunk passed
+1 :green_heart: javadoc 1m 1s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 0m 59s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 31s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 21m 26s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 24s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 32s the patch passed
+1 :green_heart: compile 9m 28s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 9m 28s the patch passed
+1 :green_heart: compile 8m 9s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 8m 9s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 10 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 2m 10s /results-checkstyle-root.txt root: The patch generated 12 new + 21 unchanged - 3 fixed = 33 total (was 24)
+1 :green_heart: mvnsite 0m 49s the patch passed
-1 :x: javadoc 0m 33s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-1 :x: javadoc 0m 34s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+0 :ok: spotbugs 0m 26s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 20m 43s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 24s hadoop-project in the patch passed.
+1 :green_heart: unit 2m 36s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 0m 36s The patch does not generate ASF License warnings.
120m 33s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/9/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 226abc4127b3 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 04f83c646e302ea7b5818d32d28d45c8e322e88f
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/9/testReport/
Max. process+thread count 555 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/9/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 07 '25 15:03 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 19m 4s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 5m 57s Maven dependency ordering for branch
+1 :green_heart: mvninstall 36m 40s trunk passed
+1 :green_heart: compile 17m 51s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 15m 13s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 34s trunk passed
+1 :green_heart: mvnsite 1m 35s trunk passed
+1 :green_heart: javadoc 1m 29s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 21s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 41s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 39m 34s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 35s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 47s the patch passed
+1 :green_heart: compile 16m 52s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 16m 52s the patch passed
+1 :green_heart: compile 15m 22s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 15m 22s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 9 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 4m 31s /results-checkstyle-root.txt root: The patch generated 13 new + 21 unchanged - 3 fixed = 34 total (was 24)
+1 :green_heart: mvnsite 1m 31s the patch passed
-1 :x: javadoc 0m 51s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-1 :x: javadoc 0m 47s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+0 :ok: spotbugs 0m 36s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 39m 30s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 34s hadoop-project in the patch passed.
-1 :x: unit 3m 21s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 3s The patch does not generate ASF License warnings.
238m 21s
Reason Tests
Failed junit tests hadoop.fs.s3a.impl.TestClientManager
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/8/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 7233acf0b060 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 032c9a8867964dcfaafb699f0987daeecec7ac10
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/8/testReport/
Max. process+thread count 525 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/8/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 07 '25 17:03 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 55s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 20s Maven dependency ordering for branch
+1 :green_heart: mvninstall 32m 45s trunk passed
+1 :green_heart: compile 15m 48s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 15m 1s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 31s trunk passed
+1 :green_heart: mvnsite 1m 32s trunk passed
+1 :green_heart: javadoc 1m 49s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 17s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 38s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 35m 23s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 35s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 43s the patch passed
+1 :green_heart: compile 15m 29s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 15m 29s the patch passed
+1 :green_heart: compile 15m 19s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 15m 19s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 9 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 4m 26s /results-checkstyle-root.txt root: The patch generated 13 new + 21 unchanged - 3 fixed = 34 total (was 24)
+1 :green_heart: mvnsite 1m 28s the patch passed
-1 :x: javadoc 0m 57s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-1 :x: javadoc 0m 41s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+0 :ok: spotbugs 0m 32s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 36m 57s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 32s hadoop-project in the patch passed.
+1 :green_heart: unit 3m 19s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 0m 57s The patch does not generate ASF License warnings.
205m 46s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/10/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 891171ec517d 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / f72e64a6af2848ad16ede5f46b1b729d1e7405ac
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/10/testReport/
Max. process+thread count 554 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/10/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 07 '25 18:03 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 56s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 4s Maven dependency ordering for branch
+1 :green_heart: mvninstall 32m 42s trunk passed
+1 :green_heart: compile 17m 34s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 14m 23s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 9s trunk passed
+1 :green_heart: mvnsite 1m 28s trunk passed
+1 :green_heart: javadoc 1m 23s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 16s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 38s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 36m 35s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 34s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 42s the patch passed
+1 :green_heart: compile 16m 26s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 16m 26s the patch passed
+1 :green_heart: compile 15m 12s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 15m 12s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 9 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 4m 7s /results-checkstyle-root.txt root: The patch generated 13 new + 21 unchanged - 3 fixed = 34 total (was 24)
+1 :green_heart: mvnsite 1m 25s the patch passed
-1 :x: javadoc 0m 49s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt hadoop-tools_hadoop-aws-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-1 :x: javadoc 0m 44s /results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+0 :ok: spotbugs 0m 33s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 38m 7s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 36s hadoop-project in the patch passed.
+1 :green_heart: unit 3m 26s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 5s The patch does not generate ASF License warnings.
208m 27s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/11/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux cf3296fc488f 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / cab8a416c4c2ad8a0db4f4611922759c8f864548
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/11/testReport/
Max. process+thread count 729 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/11/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 07 '25 18:03 hadoop-yetus

@steveloughran @mukund-thakur @shameersss1

Could you please review? Internal TPC-DS benchmarks for AAL seem to be consistently showing better numbers with CRT, possibly due to the CRT's enhanced connection management, so want to get this in for 3.4.2.

Great to hear we see improvements in the performance. Just curious, Was it for Parquet file format ? And % improvement ?

shameersss1 avatar Mar 10 '25 06:03 shameersss1

@ahmarsuhail : I see an effort to upgrade SDK V2 : https://issues.apache.org/jira/browse/HADOOP-19485

I am not sure will that cause any conflicts here. Wouldn't it be nice to start this after upgrade ? Is there any depedency between SDK version CRT version ?

shameersss1 avatar Mar 10 '25 07:03 shameersss1

thanks @shameersss1, yeah agreed makes sense to wait for the SDK upgrade to go in first. i just wanted to get the code up for review, but will test again after the upgrade

ahmarsuhail avatar Mar 10 '25 09:03 ahmarsuhail

This PR is dependent on the SDK upgrade: https://github.com/apache/hadoop/pull/7479

ahmarsuhail avatar Mar 31 '25 15:03 ahmarsuhail

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 8m 11s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 3s Maven dependency ordering for branch
+1 :green_heart: mvninstall 18m 59s trunk passed
+1 :green_heart: compile 8m 14s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 7m 17s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 1m 58s trunk passed
+1 :green_heart: mvnsite 0m 59s trunk passed
+1 :green_heart: javadoc 1m 1s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 0m 55s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 31s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 20m 46s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 24s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 32s the patch passed
+1 :green_heart: compile 7m 59s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 7m 59s the patch passed
+1 :green_heart: compile 7m 20s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 7m 20s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 13 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 1m 52s /results-checkstyle-root.txt root: The patch generated 18 new + 18 unchanged - 3 fixed = 36 total (was 21)
+1 :green_heart: mvnsite 1m 0s the patch passed
+1 :green_heart: javadoc 1m 0s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 0m 58s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 26s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 20m 47s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 26s hadoop-project in the patch passed.
+1 :green_heart: unit 2m 51s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 0m 40s The patch does not generate ASF License warnings.
125m 39s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/16/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 58c239697864 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / db44e058f1b1808750edc16d8944cf2903fa5aed
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/16/testReport/
Max. process+thread count 706 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/16/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 31 '25 18:03 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 20m 32s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 32s Maven dependency ordering for branch
+1 :green_heart: mvninstall 31m 35s trunk passed
+1 :green_heart: compile 15m 46s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 13m 38s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 14s trunk passed
+1 :green_heart: mvnsite 1m 38s trunk passed
+1 :green_heart: javadoc 1m 35s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 28s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 45s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 34m 57s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 36s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 44s the patch passed
+1 :green_heart: compile 14m 53s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 14m 53s the patch passed
+1 :green_heart: compile 13m 35s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 13m 35s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 13 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 4m 12s /results-checkstyle-root.txt root: The patch generated 18 new + 18 unchanged - 3 fixed = 36 total (was 21)
+1 :green_heart: mvnsite 1m 37s the patch passed
+1 :green_heart: javadoc 1m 33s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 28s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 39s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 35m 26s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 39s hadoop-project in the patch passed.
+1 :green_heart: unit 3m 43s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 3s The patch does not generate ASF License warnings.
219m 51s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/14/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 08d5473b5870 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 470b3dc129801241144f5b02ad97635368057681
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/14/testReport/
Max. process+thread count 546 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/14/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 31 '25 20:03 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 37m 10s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 1s codespell was not available.
+0 :ok: detsecrets 0m 1s detect-secrets was not available.
+0 :ok: xmllint 0m 1s xmllint was not available.
+0 :ok: markdownlint 0m 1s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 15s Maven dependency ordering for branch
+1 :green_heart: mvninstall 36m 30s trunk passed
+1 :green_heart: compile 17m 42s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 15m 11s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 35s trunk passed
+1 :green_heart: mvnsite 1m 33s trunk passed
+1 :green_heart: javadoc 1m 31s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 21s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 42s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 40m 4s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 34s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 43s the patch passed
+1 :green_heart: compile 16m 43s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 16m 43s the patch passed
+1 :green_heart: compile 15m 3s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 15m 3s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 13 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 4m 33s /results-checkstyle-root.txt root: The patch generated 18 new + 18 unchanged - 3 fixed = 36 total (was 21)
+1 :green_heart: mvnsite 1m 31s the patch passed
+1 :green_heart: javadoc 1m 25s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 22s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 36s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 39m 26s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 35s hadoop-project in the patch passed.
+1 :green_heart: unit 3m 35s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 0s The patch does not generate ASF License warnings.
256m 36s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/15/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 0c085e1c9780 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / db44e058f1b1808750edc16d8944cf2903fa5aed
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/15/testReport/
Max. process+thread count 531 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/15/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Mar 31 '25 21:03 hadoop-yetus

@ahmarsuhail givnen the SDK upgrade is still awaiting approval, maybe you'd want to look at it

steveloughran avatar Apr 01 '25 15:04 steveloughran

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 51s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 9m 7s Maven dependency ordering for branch
+1 :green_heart: mvninstall 36m 26s trunk passed
+1 :green_heart: compile 17m 34s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 15m 8s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 35s trunk passed
+1 :green_heart: mvnsite 1m 32s trunk passed
+1 :green_heart: javadoc 1m 30s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 25s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 43s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 39m 32s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 34s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 44s the patch passed
+1 :green_heart: compile 16m 39s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 16m 39s the patch passed
+1 :green_heart: compile 15m 3s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 15m 3s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 36s /results-checkstyle-root.txt root: The patch generated 10 new + 16 unchanged - 5 fixed = 26 total (was 21)
+1 :green_heart: mvnsite 1m 30s the patch passed
+1 :green_heart: javadoc 1m 27s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 22s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 37s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 40m 5s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 36s hadoop-project in the patch passed.
+1 :green_heart: unit 3m 37s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 3s The patch does not generate ASF License warnings.
222m 53s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/17/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux 3d7218b5c42d 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 73a478333ce853c3abfb07bdab5499868aaaf1f7
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/17/testReport/
Max. process+thread count 524 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/17/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Apr 01 '25 15:04 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 55s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 4s Maven dependency ordering for branch
+1 :green_heart: mvninstall 31m 56s trunk passed
+1 :green_heart: compile 15m 37s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 13m 40s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 4m 15s trunk passed
+1 :green_heart: mvnsite 1m 37s trunk passed
+1 :green_heart: javadoc 1m 36s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 26s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 41s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 34m 26s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 37s Maven dependency ordering for patch
-1 :x: mvninstall 0m 21s /patch-mvninstall-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
-1 :x: compile 13m 59s /patch-compile-root-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt root in the patch failed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.
-1 :x: javac 13m 59s /patch-compile-root-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt root in the patch failed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.
-1 :x: compile 12m 50s /patch-compile-root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt root in the patch failed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.
-1 :x: javac 12m 50s /patch-compile-root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt root in the patch failed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 6s /results-checkstyle-root.txt root: The patch generated 13 new + 17 unchanged - 5 fixed = 30 total (was 22)
-1 :x: mvnsite 0m 46s /patch-mvnsite-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
+1 :green_heart: javadoc 1m 31s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 27s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 37s hadoop-project has no data from spotbugs
-1 :x: spotbugs 0m 44s /patch-spotbugs-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
+1 :green_heart: shadedclient 34m 4s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 37s hadoop-project in the patch passed.
-1 :x: unit 0m 45s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch failed.
+1 :green_heart: asflicense 1m 1s The patch does not generate ASF License warnings.
192m 26s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/18/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux e110016c3b98 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 96fd7cb2e205ea13894b456778ad8c5edd22e005
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/18/testReport/
Max. process+thread count 563 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/18/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Apr 01 '25 17:04 hadoop-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 2m 27s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 1s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 1s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 7m 29s Maven dependency ordering for branch
+1 :green_heart: mvninstall 42m 3s trunk passed
-1 :x: compile 21m 30s /branch-compile-root-jdkUbuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.txt root in trunk failed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04.
-1 :x: compile 0m 47s /branch-compile-root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt root in trunk failed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.
-0 :warning: checkstyle 0m 29s /buildtool-branch-checkstyle-root.txt The patch fails to run checkstyle in root
+1 :green_heart: mvnsite 1m 38s trunk passed
+1 :green_heart: javadoc 1m 31s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 26s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 45s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
-1 :x: shadedclient 49m 14s branch has errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 37s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 44s the patch passed
+1 :green_heart: compile 15m 3s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 15m 3s the patch passed
+1 :green_heart: compile 13m 40s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
-1 :x: javac 13m 40s /results-compile-javac-root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06.txt root-jdkPrivateBuild-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06 generated 35 new + 0 unchanged - 0 fixed = 35 total (was 0)
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
-0 :warning: checkstyle 4m 10s /results-checkstyle-root.txt root: The patch generated 30 new + 0 unchanged - 0 fixed = 30 total (was 0)
+1 :green_heart: mvnsite 1m 38s the patch passed
+1 :green_heart: javadoc 1m 33s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 1m 27s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 38s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 35m 10s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 39s hadoop-project in the patch passed.
+1 :green_heart: unit 3m 40s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 1m 4s The patch does not generate ASF License warnings.
216m 29s
Subsystem Report/Notes
Docker ClientAPI=1.48 ServerAPI=1.48 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/19/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux e09a6191dbc1 5.15.0-130-generic #140-Ubuntu SMP Wed Dec 18 17:59:53 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / ea3ee792862909ff07abc0d13675f3cda96e65d1
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/19/testReport/
Max. process+thread count 544 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/19/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Apr 01 '25 18:04 hadoop-yetus

@steveloughran yeah those errors will go away once I rebase to the latest SDK.

will rebase and address your comments now. are you ok with getting this into 3.4.2?

i'm just starting the setup work for the release..going through https://github.com/apache/hadoop-release-support/tree/main

ahmarsuhail avatar Apr 30 '25 14:04 ahmarsuhail

If you can address those little nits and and are confident that the errors reported go away, then yes.

steveloughran avatar Apr 30 '25 14:04 steveloughran

rebased and addressed most comments (i think!), will test and double check tomorrow.

ahmarsuhail avatar Apr 30 '25 17:04 ahmarsuhail

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 21s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+0 :ok: xmllint 0m 0s xmllint was not available.
+0 :ok: markdownlint 0m 0s markdownlint was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+0 :ok: mvndep 6m 30s Maven dependency ordering for branch
+1 :green_heart: mvninstall 19m 13s trunk passed
+1 :green_heart: compile 8m 16s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: compile 7m 29s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: checkstyle 2m 2s trunk passed
+1 :green_heart: mvnsite 1m 5s trunk passed
+1 :green_heart: javadoc 1m 1s trunk passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 0m 52s trunk passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 32s branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+1 :green_heart: shadedclient 20m 27s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 :ok: mvndep 0m 24s Maven dependency ordering for patch
+1 :green_heart: mvninstall 0m 32s the patch passed
+1 :green_heart: compile 7m 57s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javac 7m 57s the patch passed
+1 :green_heart: compile 7m 25s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+1 :green_heart: javac 7m 25s the patch passed
-1 :x: blanks 0m 0s /blanks-eol.txt The patch has 6 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-0 :warning: checkstyle 1m 54s /results-checkstyle-root.txt root: The patch generated 14 new + 24 unchanged - 5 fixed = 38 total (was 29)
+1 :green_heart: mvnsite 1m 5s the patch passed
+1 :green_heart: javadoc 0m 58s the patch passed with JDK Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04
+1 :green_heart: javadoc 0m 58s the patch passed with JDK Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
+0 :ok: spotbugs 0m 26s hadoop-project has no data from spotbugs
+1 :green_heart: shadedclient 20m 56s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 :green_heart: unit 0m 21s hadoop-project in the patch passed.
+1 :green_heart: unit 2m 52s hadoop-aws in the patch passed.
+1 :green_heart: asflicense 0m 42s The patch does not generate ASF License warnings.
118m 44s
Subsystem Report/Notes
Docker ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/20/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/hadoop/pull/7443
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint
uname Linux f40c9e6c30d3 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 66e2b6590ef80a87d6552a4c2be18a3bc198c5c7
Default Java Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_442-8u442-b06~us1-0ubuntu1~20.04-b06
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/20/testReport/
Max. process+thread count 552 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-tools/hadoop-aws U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7443/20/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus avatar Apr 30 '25 19:04 hadoop-yetus