hadoop
hadoop copied to clipboard
Published
20 hours ago •
apache
apache
HADOOP-18682. Move hadoop docker scripts under the main source code
Description of PR
There are special branches for running hadoop in docker
docker-hadoop-runner-latest docker-hadoop-runner-jdk11 docker-hadoop-runner-jdk8 docker-hadoop-runner docker-hadoop-3 docker-hadoop-2
These branches, run specific versions of hadoop. For example, branch docker-hadoop-3 runs hadoop-3.3.6.
This patch is adding a similar setup under the main source code which will be running the latest trunk. This will be useful for testing code changes and debugging. It will also make it easier for new hadoop contributors to test the project and get familiar with it.
The files were originally copied from the branch hadoop-docker-3 and were modified so that the code comes from trunk and maven builds the docker image instead of the user.
More specifically, in branch hadoop-docker-3
- The Dockerfile downloads hadoop release 3.3.6 and then un-tars it inside the containers and sets it up
- The user has to build the Dockerfile image before starting the docker environment
With these changes, in trunk
- The user doesn't have to build the image, this is done by maven while packaging the project
- Maven generates a directory
hadoop-<version>underhadoop-dist/target- That directory contains the same files as a release
- The compose files are placed under that location
- The files from that dir are used as docker mounted volumes. That way these files are present in the containers when starting the environment and are also used for starting the services (namenode, etc.)
Jira: https://issues.apache.org/jira/browse/HADOOP-18682
How was this patch tested?
This patch was tested manually in a local env. It's adding a setup for running hadoop in docker. A README.md has been added with instruction for testing the changes locally.
I've also created a patch and tested it against trunk with dev-support/bin/test-patch /tmp/1.patch.
To test that the docker environment uses the latest code from trunk, I added a LOG prefix to this
2024-01-22 09:30:57 INFO NameNode:1846 - createNameNode []
and then built the project again, started the docker env and checked the logs
2024-01-22 09:58:44 INFO NameNode:1846 - xbis: createNameNode []
To test the patch locally
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade -Pdist,src
> cd hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/compose/hadoop
> docker-compose up -d --scale datanode=3
> docker exec -it hadoop_datanode_1 bash
bash-4.2$ hdfs dfs -mkdir /test
For code changes:
- [X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [X] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
- [ ] If applicable, have you updated the
LICENSE,LICENSE-binary,NOTICE-binaryfiles?
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 0m 20s | Docker mode activated. | |
| _ Prechecks _ | ||||
| +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | |
| +0 :ok: | codespell | 0m 0s | codespell was not available. | |
| +0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
| +0 :ok: | xmllint | 0m 0s | xmllint was not available. | |
| +0 :ok: | shelldocs | 0m 0s | Shelldocs was not available. | |
| +0 :ok: | yamllint | 0m 0s | yamllint was not available. | |
| +0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
| -1 :x: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | |
| _ trunk Compile Tests _ | ||||
| +0 :ok: | mvndep | 13m 55s | Maven dependency ordering for branch | |
| +1 :green_heart: | mvninstall | 19m 14s | trunk passed | |
| +1 :green_heart: | compile | 8m 19s | trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | compile | 7m 30s | trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | mvnsite | 11m 32s | trunk passed | |
| +1 :green_heart: | javadoc | 4m 39s | trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javadoc | 4m 51s | trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | shadedclient | 28m 12s | branch has no errors when building and testing our client artifacts. | |
| _ Patch Compile Tests _ | ||||
| +0 :ok: | mvndep | 0m 30s | Maven dependency ordering for patch | |
| +1 :green_heart: | mvninstall | 17m 0s | the patch passed | |
| +1 :green_heart: | compile | 8m 0s | the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javac | 8m 0s | the patch passed | |
| +1 :green_heart: | compile | 7m 32s | the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | javac | 7m 32s | the patch passed | |
| +1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
| -1 :x: | hadolint | 0m 1s | /results-hadolint.txt | The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) |
| +1 :green_heart: | mvnsite | 7m 15s | the patch passed | |
| +1 :green_heart: | shellcheck | 0m 0s | No new issues. | |
| +1 :green_heart: | javadoc | 4m 32s | the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javadoc | 4m 52s | the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | shadedclient | 28m 58s | patch has no errors when building and testing our client artifacts. | |
| _ Other Tests _ | ||||
| -1 :x: | unit | 638m 17s | /patch-unit-root.txt | root in the patch passed. |
| +1 :green_heart: | asflicense | 0m 52s | The patch does not generate ASF License warnings. | |
| 801m 5s |
| Reason | Tests |
|---|---|
| Failed junit tests | hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2 |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/6483 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs yamllint markdownlint hadolint |
| uname | Linux 97f22c0771dd 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 5810004edb3b85e9c3cfd63f935f3328ab59c37a |
| Default Java | Private Build-1.8.0_392-8u392-ga-1~20.04-b08 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~20.04-b08 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/1/testReport/ |
| Max. process+thread count | 4640 (vs. ulimit of 5500) |
| modules | C: hadoop-dist . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/1/console |
| versions | git=2.25.1 maven=3.6.3 hadolint=1.11.1-0-g0e692dd shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 0m 20s | Docker mode activated. | |
| _ Prechecks _ | ||||
| +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
| +0 :ok: | codespell | 0m 0s | codespell was not available. | |
| +0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
| +0 :ok: | xmllint | 0m 0s | xmllint was not available. | |
| +0 :ok: | shelldocs | 0m 0s | Shelldocs was not available. | |
| +0 :ok: | yamllint | 0m 0s | yamllint was not available. | |
| +0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
| -1 :x: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | |
| _ trunk Compile Tests _ | ||||
| +0 :ok: | mvndep | 13m 57s | Maven dependency ordering for branch | |
| +1 :green_heart: | mvninstall | 19m 28s | trunk passed | |
| +1 :green_heart: | compile | 8m 18s | trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | compile | 7m 35s | trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | mvnsite | 11m 59s | trunk passed | |
| +1 :green_heart: | javadoc | 4m 38s | trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javadoc | 4m 51s | trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | shadedclient | 28m 0s | branch has no errors when building and testing our client artifacts. | |
| _ Patch Compile Tests _ | ||||
| +0 :ok: | mvndep | 0m 29s | Maven dependency ordering for patch | |
| +1 :green_heart: | mvninstall | 16m 44s | the patch passed | |
| +1 :green_heart: | compile | 8m 1s | the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javac | 8m 1s | the patch passed | |
| +1 :green_heart: | compile | 7m 30s | the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | javac | 7m 30s | the patch passed | |
| +1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
| -1 :x: | hadolint | 0m 1s | /results-hadolint.txt | The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) |
| +1 :green_heart: | mvnsite | 7m 1s | the patch passed | |
| +1 :green_heart: | shellcheck | 0m 0s | No new issues. | |
| +1 :green_heart: | javadoc | 4m 32s | the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javadoc | 5m 0s | the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | shadedclient | 28m 56s | patch has no errors when building and testing our client artifacts. | |
| _ Other Tests _ | ||||
| -1 :x: | unit | 602m 25s | /patch-unit-root.txt | root in the patch failed. |
| +0 :ok: | asflicense | 0m 35s | ASF License check generated no output? | |
| 764m 34s |
| Reason | Tests |
|---|---|
| Failed junit tests | hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy |
| hadoop.hdfs.TestDistributedFileSystemWithECFileWithRandomECPolicy | |
| hadoop.hdfs.server.federation.router.TestRouterRefreshSuperUserGroupsConfiguration | |
| hadoop.hdfs.server.federation.router.TestRouterRetryCache | |
| hadoop.hdfs.server.federation.router.TestRouterUserMappings | |
| hadoop.hdfs.server.federation.router.TestRouterRPCMultipleDestinationMountTableResolver | |
| hadoop.hdfs.server.federation.router.TestRenewLeaseWithSameINodeId | |
| hadoop.hdfs.server.federation.metrics.TestNameserviceRPCMetrics | |
| hadoop.hdfs.server.federation.router.TestRouterWithSecureStartup | |
| hadoop.hdfs.server.federation.metrics.TestRouterClientMetrics | |
| hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat | |
| hadoop.hdfs.server.federation.router.TestRouterMountTableCacheRefresh | |
| hadoop.hdfs.server.federation.router.TestRouterMultiRack |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/2/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/6483 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs yamllint markdownlint hadolint |
| uname | Linux 66f28dabf359 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 464c37847a3fe848a8e16fda3caf3261e3d97212 |
| Default Java | Private Build-1.8.0_392-8u392-ga-1~20.04-b08 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~20.04-b08 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/2/testReport/ |
| Max. process+thread count | 4561 (vs. ulimit of 5500) |
| modules | C: hadoop-dist . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/2/console |
| versions | git=2.25.1 maven=3.6.3 hadolint=1.11.1-0-g0e692dd shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
Hi @jojochuang, it's not the same as running docker-compose build and building the image. It doesn't work unless you use the -Pdist option, which is what takes the extra time and not docker.
When you run docker-compose build in one of the special branches, it downloads the release tarball and then extracts it and copies it under the docker containers. The containers then use the release files when the docker env is started.
Here, when you enable the -Pdist, you get all the files that would normally be under a release, under hadoop-dist/target/hadoop-<version>. We mount the contents of that dir as a docker volume for all the containers. We use these files for the docker env just like we would do with the files from a release, with the difference that we didn't have to download them or copy them.
For reference, these are the times on my machine for this branch
- Without
-Pdist
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:24 min
- With
-Pdist
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade -Pdist,src
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:18 min
That's how long it takes in trunk as well.
@ayushtkn Thanks for the review.
I think Ozone even builds the docker images during:
BTW, that's where I got the idea for this PR.
because we are doing stuff for docker image, not sure how much, we need to see the time diff with & without the patch....
The times I posted above, are for this branch. Let me get the times for trunk as well and post them in another comment.
Because we are mounting the dist directory as a docker volume for the containers, there isn't any extra time needed in the build other than the time we spend building the dist directory. It's not building an official hadoop image using a Dockerfile.
These are the times from my local machine. Someone with a more powerful CPU or a different OS will be getting different times but the spread, with and without the dist profile, will be analogous.
-
trunk
- Without
-Pdist
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:06 min- With
-Pdist
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade -Pdist,src [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 06:49 min - Without
-
this branch
- Without
-Pdist
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:34 min- With
-Pdist
> mvn clean install -Dmaven.javadoc.skip=true -DskipTests -DskipShade -Pdist,src [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 06:30 min - Without
Without the dist profile, docker is still built but there are no dist files to be used for the containers and therefore starting the environment will fail.
Thanx @xBis7 for the details. I haven't tried the code locally yet, but on a quick look, it looks fine.
If @jojochuang is convinced, it is good with me
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| +0 :ok: | reexec | 25m 27s | Docker mode activated. | |
| _ Prechecks _ | ||||
| +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
| +0 :ok: | codespell | 0m 0s | codespell was not available. | |
| +0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
| +0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
| +0 :ok: | xmllint | 0m 0s | xmllint was not available. | |
| +0 :ok: | shelldocs | 0m 0s | Shelldocs was not available. | |
| +0 :ok: | yamllint | 0m 0s | yamllint was not available. | |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
| -1 :x: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | |
| _ trunk Compile Tests _ | ||||
| +0 :ok: | mvndep | 14m 47s | Maven dependency ordering for branch | |
| +1 :green_heart: | mvninstall | 30m 46s | trunk passed | |
| +1 :green_heart: | compile | 16m 26s | trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | compile | 15m 4s | trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | mvnsite | 18m 16s | trunk passed | |
| +1 :green_heart: | javadoc | 8m 29s | trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javadoc | 7m 37s | trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | shadedclient | 47m 28s | branch has no errors when building and testing our client artifacts. | |
| _ Patch Compile Tests _ | ||||
| +0 :ok: | mvndep | 0m 43s | Maven dependency ordering for patch | |
| +1 :green_heart: | mvninstall | 29m 27s | the patch passed | |
| +1 :green_heart: | compile | 15m 46s | the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javac | 15m 46s | the patch passed | |
| +1 :green_heart: | compile | 14m 55s | the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | javac | 14m 55s | the patch passed | |
| +1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
| -1 :x: | hadolint | 0m 1s | /results-hadolint.txt | The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) |
| +1 :green_heart: | mvnsite | 13m 57s | the patch passed | |
| +1 :green_heart: | shellcheck | 0m 1s | No new issues. | |
| +1 :green_heart: | javadoc | 8m 18s | the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 | |
| +1 :green_heart: | javadoc | 7m 32s | the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08 | |
| +1 :green_heart: | shadedclient | 50m 49s | patch has no errors when building and testing our client artifacts. | |
| _ Other Tests _ | ||||
| -1 :x: | unit | 747m 37s | /patch-unit-root.txt | root in the patch passed. |
| +1 :green_heart: | asflicense | 1m 35s | The patch does not generate ASF License warnings. | |
| 1048m 28s |
| Reason | Tests |
|---|---|
| Failed junit tests | hadoop.hdfs.server.datanode.TestDirectoryScanner |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/3/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/6483 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient xmllint shellcheck shelldocs yamllint hadolint |
| uname | Linux 5c2310990dcf 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 03d600f0a51e9cefa7282856215c77e63196583b |
| Default Java | Private Build-1.8.0_392-8u392-ga-1~20.04-b08 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~20.04-b08 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/3/testReport/ |
| Max. process+thread count | 3913 (vs. ulimit of 5500) |
| modules | C: hadoop-common-project/hadoop-common hadoop-dist . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6483/3/console |
| versions | git=2.25.1 maven=3.6.3 hadolint=1.11.1-0-g0e692dd shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
:broken_heart: -1 overall
| Vote | Subsystem | Runtime | Logfile | Comment |
|---|---|---|---|---|
| _ Prechecks _ | ||||
| +1 :green_heart: | dupname | 0m 02s | No case conflicting files found. | |
| +0 :ok: | codespell | 0m 02s | codespell was not available. | |
| +0 :ok: | detsecrets | 0m 02s | detect-secrets was not available. | |
| +0 :ok: | markdownlint | 0m 02s | markdownlint was not available. | |
| +0 :ok: | xmllint | 0m 00s | xmllint was not available. | |
| +0 :ok: | shellcheck | 0m 01s | Shellcheck was not available. | |
| +0 :ok: | shelldocs | 0m 01s | Shelldocs was not available. | |
| +0 :ok: | yamllint | 0m 01s | yamllint was not available. | |
| +0 :ok: | hadolint | 0m 01s | hadolint was not available. | |
| +1 :green_heart: | @author | 0m 00s | The patch does not contain any @author tags. | |
| -1 :x: | test4tests | 0m 00s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | |
| _ trunk Compile Tests _ | ||||
| +0 :ok: | mvndep | 4m 56s | Maven dependency ordering for branch | |
| +1 :green_heart: | mvninstall | 108m 15s | trunk passed | |
| +1 :green_heart: | compile | 47m 52s | trunk passed | |
| -1 :x: | mvnsite | 28m 48s | /branch-mvnsite-root.txt | root in trunk failed. |
| +1 :green_heart: | javadoc | 19m 14s | trunk passed | |
| +1 :green_heart: | shadedclient | 390m 28s | branch has no errors when building and testing our client artifacts. | |
| _ Patch Compile Tests _ | ||||
| +0 :ok: | mvndep | 5m 06s | Maven dependency ordering for patch | |
| -1 :x: | mvninstall | 3m 08s | /patch-mvninstall-hadoop-dist.txt | hadoop-dist in the patch failed. |
| +1 :green_heart: | compile | 48m 07s | the patch passed | |
| +1 :green_heart: | javac | 48m 07s | the patch passed | |
| +1 :green_heart: | blanks | 0m 01s | The patch has no blanks issues. | |
| -1 :x: | mvnsite | 28m 00s | /patch-mvnsite-root.txt | root in the patch failed. |
| +1 :green_heart: | javadoc | 19m 56s | the patch passed | |
| +1 :green_heart: | shadedclient | 232m 42s | patch has no errors when building and testing our client artifacts. | |
| _ Other Tests _ | ||||
| +1 :green_heart: | asflicense | 7m 47s | The patch does not generate ASF License warnings. | |
| 813m 26s |
| Subsystem | Report/Notes |
|---|---|
| GITHUB PR | https://github.com/apache/hadoop/pull/6483 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient xmllint shellcheck shelldocs yamllint hadolint |
| uname | MINGW64_NT-10.0-17763 34cb8b2b35a4 3.4.10-87d57229.x86_64 2024-02-14 20:17 UTC x86_64 Msys |
| Build tool | maven |
| Personality | /c/hadoop/dev-support/bin/hadoop.sh |
| git revision | trunk / 03d600f0a51e9cefa7282856215c77e63196583b |
| Default Java | Azul Systems, Inc.-1.8.0_332-b09 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch-windows-10/job/PR-6483/1/testReport/ |
| modules | C: hadoop-common-project/hadoop-common hadoop-dist . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch-windows-10/job/PR-6483/1/console |
| versions | git=2.44.0.windows.1 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.