aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

April 2024 CPU - JDK17 Triage

Open smlambert opened this issue 10 months ago • 9 comments

Release Summary Report for release-openjdk17-pipeline

Warning: The release summary report is not yet complete. Currently, it only contains partial results.

Report generated at: Wed, 17 Apr 2024 11:22:41 GMT - aggregated to temurin/issue/38

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/62/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk17u" build number 4690 at 4/17/2024, 1:43:25 AM


✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ all pass
x86-64_linux ✔️ comment raise issue for failures in comment
x86-64_windows ✔️ comment
aarch64_linux ✔️ all pass
aarch64_mac ✔️ all pass
arm_linux ✔️ comment
x86-64_alpine-linux ✔️ comment
x86-32_windows ✔️ comment ACTION: exclude CheckCICompilerCount & follow-up
ppc64le_linux ✔️ comment ACTION: raise issues relating to 3 failures
s390x_linux ✔️ comment
ppc64_aix ✔️ comment

Rerun tap files Test_openjdk17_hs_extended.openjdk_ppc64le_linux_rerun.tap.txt

smlambert avatar Apr 17 '24 11:04 smlambert

ppc64le_linux

  • jdk_beans fails in original run (test-osuosl-ubuntu1604-ppc64le-2), passes on rerun (test-osuosl-ubuntu1804-ppc64le-1)
  • jdk_tools, jvm_compiler_1 fail in original run (test-skytap-ubuntu2004-ppc64le-1), pass on rerun (test-osuosl-ubuntu1804-ppc64le-1)

Test_openjdk17_hs_extended.openjdk_ppc64le_linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_ppc64le_linux_rerun ✅ SUCCESS ✅ Rerun all

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

Test_openjdk17_hs_extended.openjdk_ppc64le_linux_testList_1 ⚠️ UNSTABLE ⚠️ jdk_beans_0 => deep history 11/17 passed | possible issues

Test_openjdk17_hs_extended.openjdk_ppc64le_linux_testList_2 ⚠️ UNSTABLE ⚠️ jvm_compiler_1 => deep history 12/18 passed | possible issues jdk_tools_1 => deep history 11/15 passed | possible issues jdk_tools_0 => deep history 13/16 passed | possible issues

Test_openjdk17_hs_extended.openjdk_ppc64le_linux_rerun.tap.txt

ACTION: raise issues relating to rerun passed testcases: tools/jpackage/share/RuntimePackageTest.java#id0.RuntimePackageTest_id0 tools/jpackage/share/RuntimePackageTest.java#id0.RuntimePackageTest_id0 compiler/rtm/locking/TestRTMAbortRatio.java.TestRTMAbortRatio compiler/rtm/locking/TestRTMSpinLoopCount.java.TestRTMSpinLoopCount java/beans/Beans/TypoInBeanDescription.java.TypoInBeanDescription

SL/May1:

  • https://github.com/adoptium/aqa-tests/issues/5273 for jvm_compiler failures

smlambert avatar Apr 17 '24 12:04 smlambert

arm_linux

Test_openjdk17_hs_extended.openjdk_arm_linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_arm_linux_rerun ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

Test_openjdk17_hs_extended.openjdk_arm_linux_testList_0 ⚠️ UNSTABLE ⚠️ jdk_io_2 => deep history 0/16 passed | possible issues

Test_openjdk17_hs_extended.openjdk_arm_linux_testList_1 ⚠️ UNSTABLE ⚠️ jvm_compiler_2 => deep history 2/17 passed | possible issues jdk_net_2 => deep history 26/33 passed | possible issues

jdk_io -> java_io_File_GetXSpace fails - rerun in TCGrinder/4228 fails, rerun 5x Grinder in TCGrinder/4253 fails

  • slambert/Apr20 GetXSpace was intended to be excluded, but the ProblemList is formatted incorrectly (see https://github.com/adoptium/aqa-tests/issues/5227)
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by GetXSpace (file:/home/jenkins/workspace/Test_openjdk17_hs_extended.openjdk_arm_linux_testList_0/aqa-tests/TKG/output_17133386898426/jdk_io_2/work/classes/1/java/io/File/GetXSpace.d/)
WARNING: Please consider reporting this to the maintainers of GetXSpace
WARNING: System::setSecurityManager will be removed in a future release
FAILED: '/ total space': 960196055040 != 2418348032
FAILED: '/': 1996599296 ?? 813745418240
FAILED: '/ size': 960196055040 > 2418348032
FAILED: '/ total space': 960196055040 != 2418348032
FAILED: '/ usable space': 813745418240 > 2418348032
Warning: us > s.free()
FAILED: '/ usable vs. free space': 813745418240 > 1090453504
FAILED: '/ total space': 960196055040 != 2418348032
FAILED: '/': 1996599296 ?? 813745418240
FAILED: '/ size': 960196055040 > 2418348032
FAILED: '/ total space': 960196055040 != 2418348032
FAILED: '/ usable space': 813745418240 > 2418348032
Warning: us > s.free()
FAILED: '/ usable vs. free space': 813745418240 > 1090453504
30 tests: 12 failure(s); first: java.lang.RuntimeException: '/ total space': 960196055040 != 2418348032
FAILED: '/ total space': 960196055040 != 2418348032
FAILED: '/': 1996599296 ?? 813745418240
FAILED: '/ size': 960196055040 > 2418348032
FAILED: '/ total space': 960196055040 != 2418348032
FAILED: '/ usable space': 813745418240 > 2418348032
Warning: us > s.free()
FAILED: '/ usable vs. free space': 813745418240 > 1090453504
6 tests: 6 failure(s); first: java.lang.RuntimeException: '/ total space': 960196055040 != 2418348032
java.lang.RuntimeException: 2 test(s) failed
	at GetXSpace.main(GetXSpace.java:485)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
	at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
	at java.base/java.lang.Thread.run(Thread.java:840)

JavaTest Message: Test threw exception: java.lang.RuntimeException: 2 test(s) failed
JavaTest Message: shutting down test
  • jvm_compiler -> rerun in Grinder/9701 - 1 testcase fails, this is the CheckCICompilerCount discussed in https://github.com/adoptium/aqa-tests/issues/5211#issuecomment-2057639685 and https://github.com/adoptium/aqa-tests/issues/5211#issuecomment-2067659633. 32-bit platforms would set TieredStopAtLevel to 1 by default (so that only C1 compilations are performed in the system). The test expects to run at level 2. Marking this failure as non-blocking. ACTION: to understand why this test failure was not seen in January (was the testcase ProblemListed previously? and exclude testcase for arm_linux (a 32-bit platform).

sophia-guo avatar Apr 17 '24 15:04 sophia-guo

ppc64_aix

Test_openjdk17_hs_extended.openjdk_ppc64_aix ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_ppc64_aix_rerun ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode)

Test_openjdk17_hs_extended.openjdk_ppc64_aix_testList_2 ⚠️ UNSTABLE ⚠️ jvm_compiler_1 => deep history 14/17 passed | possible issues jdk_jmx_1 => deep history 3/19 passed | possible issues jdk_jmx_0 => deep history 3/34 passed | possible issues jdk_nio_1 => deep history 16/31 passed | possible issues

smlambert avatar Apr 17 '24 20:04 smlambert

x86-64_linux

Test_openjdk17_hs_extended.openjdk_x86-64_linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_x86-64_linux_rerun ✅ SUCCESS ✅ Rerun all

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

Test_openjdk17_hs_extended.openjdk_x86-64_linux_testList_1 ⚠️ UNSTABLE ⚠️ jdk_jmx_1 => deep history 11/12 passed | possible issues

Test_openjdk17_hs_extended.system_x86-64_linux ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

HCRLateAttachWorkload_previewEnabled_0 => deep history 54/56 passed | possible issues HCRLateAttachWorkload_previewEnabled_1 => deep history 54/55 passed | possible issues

Test_openjdk17_hs_extended.system_x86-64_linux_rerun ✅ SUCCESS ✅ Rerun all

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)
  • HCRLateAttachWorkload_previewEnabled failed in original run on test-docker-ubuntu2204-x64-6, passed in auto rerun on test-ibmcloud-rhel6-x64-1, ACTION: raise issue against this failure, check if there is a pattern of passing on some infra and not on others

smlambert avatar Apr 17 '24 22:04 smlambert

x86-64_alpine-linux

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux_rerun ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux_testList_1 ⚠️ UNSTABLE ⚠️ jdk_nio_0 => deep history 23/29 passed | possible issues

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux_testList_2 ⚠️ UNSTABLE ⚠️ jdk_nio_1 => deep history 19/28 passed | possible issues

smlambert avatar Apr 18 '24 02:04 smlambert

x86-64_windows

extended.openjdk sees the following failures:

not ok 21 - jdk_tools_0
  ---
    output:
      |
        Failed test cases: 
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        TEST: tools/jmod/hashes/HashesOrderTest.java
        Test results: passed: 226; failed: 2
    duration_ms: 689685
  ...
not ok 22 - jdk_tools_1
  ---
    output:
      |
        Failed test cases: 
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        TEST: tools/jmod/hashes/HashesOrderTest.java
        Test results: passed: 226; failed: 2
    duration_ms: 693289
  • which pass in auto rerun (here)

all other top-level test targets pass

smlambert avatar Apr 18 '24 11:04 smlambert

ref x86-64_alpine-linux triage, the failing java/nio/file/DirectoryStream/SecureDS.java test in jdk_nio_0 and _1 passes on test-docker-alpine314-x64-1 https://ci.adoptium.net/job/Grinder/9688/console

Infra issue raised https://github.com/adoptium/infrastructure/issues/3522

Haroon-Khel avatar Apr 18 '24 13:04 Haroon-Khel

s390x_linux

  • extended.perf rerun in https://ci.adoptium.net/job/Test_openjdk17_hs_extended.perf_s390x_linux/162 on test-marist-sles15-s390x-2
  • Need to rerun extended.openjdk, - all but 2 testcases pass in the auto rerun, rerun the failing testcases in Grinder/9731 passes Grinder_20240420133444_JDK17_s390x.tap.txt
    • sun/net/www/protocol/https/HttpsURLConnection/PostThruProxyWithAuth.java java.lang.RuntimeException: Get hostname failed.
    • javax/imageio/plugins/shared/ImageWriterCompressionTest.java Caused by: java.lang.RuntimeException: Fontconfig head is null, check your fonts or fonts configuration

Test_openjdk17_hs_extended.openjdk_s390x_linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_s390x_linux_rerun ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

Test_openjdk17_hs_extended.openjdk_s390x_linux_testList_0 ⚠️ UNSTABLE ⚠️ jdk_net_0 => deep history 4/22 passed | possible issues jdk_imageio_0 => deep history 9/29 passed | possible issues

Test_openjdk17_hs_extended.openjdk_s390x_linux_testList_1 ⚠️ UNSTABLE ⚠️ jdk_management_0 => deep history 12/29 passed | possible issues

Test_openjdk17_hs_extended.openjdk_s390x_linux_testList_2 ⚠️ UNSTABLE ⚠️ jvm_compiler_0 => deep history 12/16 passed | possible issues jvm_compiler_1 => deep history 12/16 passed | possible issues jdk_net_1 => deep history 3/16 passed | possible issues jdk_security3_1 => deep history 17/31 passed | possible issues jdk_nio_1 => deep history 15/31 passed | possible issues jdk_tools_0 => deep history 12/15 passed | possible issues jdk_jmx_0 => deep history 24/33 passed | possible issues jdk_tools_1 => deep history 11/14 passed | possible issues jdk_imageio_1 => deep history 6/15 passed | possible issues

Test_openjdk17_hs_extended.perf_s390x_linux ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

renaissance-movie-lens_0 => deep history 24/37 passed | possible issues

Test_openjdk17_hs_extended.perf_s390x_linux_rerun ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

Test_openjdk17_hs_sanity.system_s390x_linux ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

TestJlmRemoteClassAuth_0 => deep history 42/56 passed | possible issues TestJlmRemoteClassAuth_1 => deep history 42/56 passed | possible issues TestJlmRemoteClassNoAuth_0 => deep history 42/56 passed | possible issues TestJlmRemoteClassNoAuth_1 => deep history 42/56 passed | possible issues TestJlmRemoteMemoryAuth_0 => deep history 42/56 passed | possible issues TestJlmRemoteMemoryAuth_1 => deep history 41/56 passed | possible issues TestJlmRemoteMemoryNoAuth_0 => deep history 42/56 passed | possible issues TestJlmRemoteMemoryNoAuth_1 => deep history 42/56 passed | possible issues TestJlmRemoteNotifierProxyAuth_0 => deep history 42/56 passed | possible issues TestJlmRemoteNotifierProxyAuth_1 => deep history 42/56 passed | possible issues TestJlmRemoteThreadAuth_0 => deep history 41/56 passed | possible issues TestJlmRemoteThreadAuth_1 => deep history 41/56 passed | possible issues TestJlmRemoteThreadNoAuth_0 => deep history 42/56 passed | possible issues TestJlmRemoteThreadNoAuth_1 => deep history 42/56 passed | possible issues NioLoadTest_5m_0 => deep history 42/56 passed | possible issues NioLoadTest_5m_1 => deep history 42/56 passed | possible issues

  • sanity.system fails with java.net.NoRouteToHostException: No route to host on test-marist-sles15-s390x-2, then passes in auto rerun on test-marist-ubuntu2204-s390x-1

Test_openjdk17_hs_sanity.system_s390x_linux_rerun ✅ SUCCESS ✅ Rerun all

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK 64-Bit Server VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, sharing)

smlambert avatar Apr 18 '24 18:04 smlambert

x86-32_windows

Ran from https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/63/

Release Summary Report for release-openjdk17-pipeline

Report generated at: Sat, 20 Apr 2024 13:57:04 GMT

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/63/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk17u" build number 4690 at 4/18/2024, 1:25:36 PM


Test_openjdk17_hs_extended.openjdk_x86-32_windows ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_x86-32_windows_rerun ⚠️ UNSTABLE ⚠️ Rerun failed

java -version
openjdk version "17.0.11" 2024-04-16
OpenJDK Runtime Environment Temurin-17.0.11+9 (build 17.0.11+9)
OpenJDK Client VM Temurin-17.0.11+9 (build 17.0.11+9, mixed mode, emulated-client)

Test_openjdk17_hs_extended.openjdk_x86-32_windows_testList_1 ⚠️ UNSTABLE ⚠️ jvm_compiler_2 => deep history 3/14 passed | possible issues


  • 1 testcase failing, compiler/arguments/CheckCICompilerCount.java (also failing on arm_linux), deemed to be non-blocking as this testcase is failing in client mode on 32-bit platforms, where does not make sense to be running this test in that mode on 32-bit platforms
  • ACTION: exclude CheckCICompilerCount from win32, and understand why this failure is showing up now (but not in January, was testcase removed from a problemlist at some point)
17:08:27  java.lang.RuntimeException: java.lang.RuntimeException: Expected to get exit value of [1]
17:08:27  
17:08:27  	at compiler.arguments.CheckCICompilerCount.verifyValidOption(CheckCICompilerCount.java:203)
17:08:27  	at compiler.arguments.CheckCICompilerCount.main(CheckCICompilerCount.java:222)
17:08:27  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
17:08:27  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
17:08:27  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
17:08:27  	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
17:08:27  	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
17:08:27  	at java.base/java.lang.Thread.run(Thread.java:840)
17:08:27  Caused by: java.lang.RuntimeException: Expected to get exit value of [1]
17:08:27  
17:08:27  	at jdk.test.lib.process.OutputAnalyzer.shouldHaveExitValue(OutputAnalyzer.java:489)
17:08:27  	at compiler.arguments.CheckCICompilerCount.verifyValidOption(CheckCICompilerCount.java:197)
17:08:27  	... 7 more
17:08:27  

smlambert avatar Apr 20 '24 13:04 smlambert