HADOOP-19058. [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn

[BilwaST]

Description of PR

How was this patch tested?

For code changes:

• [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
• [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
• [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
• [ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

[hadoop-yetus]

:broken_heart: -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 :ok:	reexec	0m 55s		Docker mode activated.
			_ Prechecks _
+1 :green_heart:	dupname	0m 0s		No case conflicting files found.
+0 :ok:	codespell	0m 0s		codespell was not available.
+0 :ok:	detsecrets	0m 0s		detect-secrets was not available.
+0 :ok:	xmllint	0m 0s		xmllint was not available.
+1 :green_heart:	@author	0m 0s		The patch does not contain any @author tags.
-1 :x:	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+1 :green_heart:	mvninstall	41m 54s		trunk passed
+1 :green_heart:	compile	0m 21s		trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04
+1 :green_heart:	compile	0m 21s		trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08
+1 :green_heart:	mvnsite	0m 26s		trunk passed
+1 :green_heart:	javadoc	0m 27s		trunk passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04
+1 :green_heart:	javadoc	0m 23s		trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08
+1 :green_heart:	shadedclient	75m 42s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 :green_heart:	mvninstall	0m 14s		the patch passed
+1 :green_heart:	compile	0m 13s		the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04
+1 :green_heart:	javac	0m 13s		the patch passed
+1 :green_heart:	compile	0m 13s		the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08
+1 :green_heart:	javac	0m 13s		the patch passed
+1 :green_heart:	blanks	0m 0s		The patch has no blanks issues.
+1 :green_heart:	mvnsite	0m 16s		the patch passed
+1 :green_heart:	javadoc	0m 14s		the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04
+1 :green_heart:	javadoc	0m 14s		the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08
+1 :green_heart:	shadedclient	33m 7s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 :green_heart:	unit	0m 17s		hadoop-project in the patch passed.
+1 :green_heart:	asflicense	0m 35s		The patch does not generate ASF License warnings.
		115m 27s

Subsystem	Report/Notes
Docker	ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6531/1/artifact/out/Dockerfile
GITHUB PR	https://github.com/apache/hadoop/pull/6531
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint
uname	Linux b47656071f4b 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / fcb51d70221c64831ab78e20abb3d48f59bbf506
Default Java	Private Build-1.8.0_392-8u392-ga-1~20.04-b08
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~20.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6531/1/testReport/
Max. process+thread count	672 (vs. ulimit of 5500)
modules	C: hadoop-project U: hadoop-project
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6531/1/console
versions	git=2.25.1 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

[steveloughran]

commented. I looked at surefire and it is at 3.2.5; probably time to upgrade. I propose it is done before doing this one, splitting them in two.

and we need java8 and java17 profiles so we can add other options in other places

[slfan1989]

commented. I looked at surefire and it is at 3.2.5; probably time to upgrade. I propose it is done before doing this one, splitting them in two.

and we need java8 and java17 profiles so we can add other options in other places

I agree with your points, but there are some additional details to be added:

• I agree to establish profiles for Java 8 and Java 17, and I think we should also include Java 11 and Java 21.
• There are still some pending tasks related to Java 11. We need to continue working on HADOOP-15984, specifically updating Jersey from version 1.19 to 2.x. Ideally, we should update it to Jersey 3.x. （I will start following this JIRA in the next 1-2 days）
• We need to migrate from JUnit 4 to JUnit 5. Some progress has already been made in Yarn.
• We should consider upgrading the version of the Maven Surefire Plugin. Currently, we are using 3.0.0-M1, but I suggest upgrading it to 3.2.2. I have noticed that some projects are using this version, and I will try it out.

I will create a JIRA ticket for Java 17 compile support. I am aware that there is a lot of work to be done, and I hope that we can address the JDK support issue this year.

[hadoop-yetus]

:broken_heart: -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
			_ Prechecks _
+1 :green_heart:	dupname	0m 00s		No case conflicting files found.
+0 :ok:	codespell	0m 01s		codespell was not available.
+0 :ok:	detsecrets	0m 01s		detect-secrets was not available.
+0 :ok:	xmllint	0m 01s		xmllint was not available.
+1 :green_heart:	@author	0m 00s		The patch does not contain any @author tags.
-1 :x:	test4tests	0m 00s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+1 :green_heart:	mvninstall	92m 58s		trunk passed
+1 :green_heart:	compile	4m 29s		trunk passed
+1 :green_heart:	mvnsite	4m 34s		trunk passed
+1 :green_heart:	javadoc	4m 33s		trunk passed
+1 :green_heart:	shadedclient	246m 17s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 :green_heart:	mvninstall	2m 01s		the patch passed
+1 :green_heart:	compile	1m 55s		the patch passed
+1 :green_heart:	javac	1m 55s		the patch passed
+1 :green_heart:	blanks	0m 00s		The patch has no blanks issues.
+1 :green_heart:	mvnsite	1m 59s		the patch passed
+1 :green_heart:	javadoc	1m 57s		the patch passed
+1 :green_heart:	shadedclient	152m 30s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 :green_heart:	asflicense	5m 29s		The patch does not generate ASF License warnings.
		418m 45s

Subsystem	Report/Notes
GITHUB PR	https://github.com/apache/hadoop/pull/6531
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint
uname	MINGW64_NT-10.0-17763 fef11fae28ac 3.4.10-87d57229.x86_64 2024-02-14 20:17 UTC x86_64 Msys
Build tool	maven
Personality	/c/hadoop/dev-support/bin/hadoop.sh
git revision	trunk / fcb51d70221c64831ab78e20abb3d48f59bbf506
Default Java	Azul Systems, Inc.-1.8.0_332-b09
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch-windows-10/job/PR-6531/1/testReport/
modules	C: hadoop-project U: hadoop-project
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch-windows-10/job/PR-6531/1/console
versions	git=2.44.0.windows.1
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.