aqa-tests
aqa-tests copied to clipboard
April 2025 Release Triage - JDK17
Release Summary Report for release-openjdk17-pipeline - Grid view
✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.
| Platform | Status | Results | Actions |
|---|---|---|---|
| x86-64_mac | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809573010 | |
| x86-64_linux | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809823651 | |
| x86-64_windows | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809447340 | |
| aarch64_linux | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809566055 | |
| aarch64_mac | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809358658 | |
| x86-64_alpine-linux | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2812676101 | |
| ppc64le_linux | ✔️ | all pass | |
| s390x_linux | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2812677204 | |
| ppc64_aix | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809847505 | Raise issues for 3 testcases mentioned in comment |
| arm_linux | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2810393663 | |
| riscv64_linux | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2812677953 | 2 headful testcases fail / need problemlist |
| x86-32_windows | ✔️ | https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2816378230 | separate pipeline |
aarch64_mac ✔️
extended.openjdk
CUSTOM_TARGET: gc/metaspace/TestMetaspacePerfCounters.java#Epsilon-64 fails in original, passes on rerun
x86-64_windows ✔️
extended.openjdk original and rerun a variety of failures running on test-azure-win2022-x64-2 manual rerun on test-azure-win2022-x64-3 in Grinder/12910 as deep history shows them passing there - 77 testcases pass in 12910, 1 still fails java/io/File/createTempFile/SpecialTempFile.java.SpecialTempFile - unable to create temp file (consider non-blocker) Grinder_20250416153128_JDK17_win64.tap.txt & Grinder/12920
ACTION: need infra issue to investigate diff between test-azure-win2022-x64-3 and test-azure-win2022-x64-2
extended.perf - renaissance targets fail on test-azure-win2022-x64-4 with java.lang.UnsatisfiedLinkError: C:\jenkins\workspace\Test_openjdk17_hs_extended.perf_x86-64_windows_rerun\aqa-tests\TKG\output_17447735254868\renaissance-chi-square_0\harness-031855-13538900942902338658\apache-spark\chi-square\hadoop\bin\hadoop.dll: %1 is not a valid Win32 application
manual rerun on test-azure-win2022-x64-3 in Grinder/12911 - passes Grinder_20250416153954_JDK17_win64.tap.txt
- Long queue for machines
aarch64_linux ✔️
sanity.openjdk CUSTOM_TARGET: tools/javac/lambda/LambdaParserTest.java fails in original, passes in rerun
x86-64_mac ✔️
extended.openjdk CUSTOM_TARGET: com/sun/jndi/dns/ConfigTests/PortUnreachable.java fails in original, passes in rerun
x86-64_linux ✔️
extended.openjdk pending
- waiting on https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_linux_testList_2/42/
other top-level targets pass
ppc64_aix ✔️
sanity.openjdk unstable
- 4 testcases
CUSTOM_TARGET: gc/metaspace/TestMetaspacePerfCounters.java#Epsilon-64 runtime/ErrorHandling/MachCodeFramesInErrorFile.java runtime/DefineClass/NullClassBytesTest.java runtime/jni/getCreatedJavaVMs/TestGetCreatedJavaVMs.javafailed in original, 3 fail in rerun
Failed test cases:
TEST: runtime/DefineClass/NullClassBytesTest.java
TEST: runtime/ErrorHandling/MachCodeFramesInErrorFile.java
TEST: runtime/jni/getCreatedJavaVMs/TestGetCreatedJavaVMs.java
Test results: passed: 1; failed: 3
extended.openjdk 5 targets TESTLIST=hotspot_runtime_0,hotspot_compiler_0,hotspot_gc_0,jdk_jmx_0,jdk_net_1,jdk_jmx_1 fail in original, a handful of testcases fail in rerun, manually rerun the failing testcases in Grinder/12913 and Grinder/12914
Those Grinders still have the following failures (some OOM):
java/net/httpclient/StreamingBody.java.StreamingBody
javax/management/mxbean/ThreadStartTest.java.ThreadStartTest OOM
runtime/DefineClass/NullClassBytesTest.java.NullClassBytesTest OOM
runtime/ErrorHandling/MachCodeFramesInErrorFile.java.MachCodeFramesInErrorFile fatal error see below
runtime/jni/getCreatedJavaVMs/TestGetCreatedJavaVMs.java.TestGetCreatedJavaVMs StackOverFlow
MachCodeFramesInErrorFile crashes
Execution failed: `main' threw exception: java.lang.RuntimeException: "Native frames: " line missing in hs_err_pid file: # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x0a000100000816a0, pid=6488400, tid=258 # # JRE version: OpenJDK Runtime Environment Temurin-17.0.15+6 (17.0.15+6) (build 17.0.15+6) # Java VM: OpenJDK 64-Bit Server VM Temurin-17.0.15+6 (17.0.15+6, compiled mode, compressed oops, compressed class ptrs, g1 gc, aix-ppc64) # Problematic frame: # J 18 c2 MachCodeFramesInErrorFile$Crasher.crashInJava3(J)V (27 bytes) @ 0x0a000100000816a0 [0x0a00010000081680+0x0000000000000020] # # CreateCoredumpOnCrash turned off, no core file dumped # # If you would like to submit a bug report, please visit: # https://github.com/adoptium/adoptium-support/issues
TestGetCreatedJavaVMs... StackOverflowError
07:48:23 STDERR:
07:48:23 stdout: [Error occurred during initialization of VM
07:48:23 java.lang.StackOverflowError
07:48:23 at java.lang.String.<clinit>(java.base/String.java:224)
07:48:23
07:48:23 [*] Creating thread 0
07:48:23 [*] Creating thread 1
07:48:23 [0] BEGIN JNI_CreateJavaVM
07:48:23 [1] BEGIN JNI_CreateJavaVM
07:48:23 [1] END JNI_CreateJavaVM
07:48:23 [1] Error creating JVM: -5
07:48:23 [1] BEGIN JNI_GetCreatedJavaVMs
07:48:23 [1] END JNI_GetCreatedJavaVMs
07:48:23 [1] Obtained 0 created VMs
07:48:23 ];
07:48:23 stderr: []
07:48:23 exitValue = 1
07:48:23
07:48:23 java.lang.RuntimeException: Expected to get exit value of [0]
07:48:23
07:48:23 at jdk.test.lib.process.OutputAnalyzer.shouldHaveExitValue(OutputAnalyzer.java:489)
07:48:23 at TestGetCreatedJavaVMs.main(TestGetCreatedJavaVMs.java:39)
07:48:23 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
07:48:23 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
07:48:23 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
07:48:23 at java.base/java.lang.reflect.Method.invoke(Method.java:569)
07:48:23 at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
07:48:23 at java.base/java.lang.Thread.run(Thread.java:840)
Rerun the 5 failing testcases
- jdk_custom in TCGrinder/5403 pass Grinder_20250424115056_JDK17_ppc64AIX.tap.txt
- hotspot_custom
NullClassBytesTest,MachCodeFramesInErrorFile,TestGetCreatedJavaVMsin TCGrinder/5402 FAIL in same way as public Jenkins server
ACTION: determine whether the 3 testcase failures NullClassBytesTest,MachCodeFramesInErrorFile,TestGetCreatedJavaVMs should be considered blocking or non-blocking
Try running with -Xint Grinder/12987 - Unstable
- gc_g1_TestSkipRebuildRemsetPhase - PASSED
- rest failed...
NullClassBytesTest,MachCodeFramesInErrorFile,TestGetCreatedJavaVMs Summary:
- hotspot/jtreg/native/GetCreatedJavaVMs is new in jdk-17.0.15: https://github.com/adoptium/jdk17u/commit/ed63b718fe5b4e9f77154f6015516762800d13d6
- Cause StackOverflow, reason unclear - Testcase error????
- As new testcase, needs further investigation... but say Non-Blocking
- runtime/DefineClass/NullClassBytesTest.java failed previous release in jdk-17.0.14 Grinder using: https://ci.adoptium.net/job/Grinder/13003/console
- Fails here: https://github.com/openjdk/jdk17u/blob/0b592b7f04aae6cec666345be37c1456845e6e0d/src/java.base/share/native/libjava/ClassLoader.c#L105
- Due to following test case, where b.length==0, and the 0 gets passed to malloc(0), the result of which is OS/compiler specific, and suspect in this AIX case returns 0 rather than an arbitrary address :
byte[] b = new byte[0]; return defineClass(name, b, 0, b.length);- I think testcase is not accurate, as OutOfMemory from malloc(0) returning 0 is valid, hence Non_blocking
- runtime/ErrorHandling/MachCodeFramesInErrorFile.java failed in jdk-17.0.14 Grinder using: https://ci.adoptium.net/job/Grinder/13015/consoleFull
- Fails due to fr.pc() == 0, indicating no valid native frame : https://github.com/adoptium/jdk17u/blob/0b592b7f04aae6cec666345be37c1456845e6e0d/src/hotspot/share/utilities/vmError.cpp#L373
- Hence no "Native frames:" line in crash hserr dump
- Only affects hserr dump output, so would say Non-Blocking
- Fails due to fr.pc() == 0, indicating no valid native frame : https://github.com/adoptium/jdk17u/blob/0b592b7f04aae6cec666345be37c1456845e6e0d/src/hotspot/share/utilities/vmError.cpp#L373
arm_linux ✔️
extended.functional - CryptoTests_jtreg fails (cryptotest.tests.SignatureTests times out on test-docker-debian12-armv7l-1), rerun on test-docker-ubuntu2404-armv7-5 in Grinder/12917 - passes Grinder_20250416183014_JDK17_armLinux.tap.txt
sanity.openjdk java/lang/invoke/TestLambdaFormCustomization.java fails in rerun, manually rerun in Grinder/12918 on test-docker-ubuntu2404-armv7-1 - passes Grinder_20250416184328_JDK17_armLinux.tap.txt
extended.openjdk 4 targets fail in original, pass in rerun
sanity.system 1 target fails in rerun TestJlmRemoteThreadAuth_2, manually rerun in Grinder/12919 on !test-docker-ubuntu2404-armv7-3 - passes Grinder_20250416184702_JDK17_armLinux.tap.txt
x86-64_alpine-linux ✔️
sanity.openjdk CUSTOM_TARGET: jdk/jshell/ExternalEditorTest.java known/non-blocking (should be excluded, but no easy mechanism to problemlist for just alpine-linux instead of all linux)
extended.openjdk CUSTOM_TARGET: java/nio/channels/Selector/Wakeup.java fails in original, passes in rerun
s390x_linux ✔️
extended.openjdk CUSTOM_TARGET: java/net/DatagramSocket/DatagramSocketExample.java java/net/DatagramSocket/DatagramSocketMulticasting.java java/net/MulticastSocket/SetLoopbackModeIPv4.java java/nio/channels/DatagramChannel/AdaptorMulticasting.java java/nio/channels/DatagramChannel/Loopback.java sun/management/jdp/JdpDefaultsTest.java sun/management/jdp/JdpJmxRemoteDynamicPortTest.java sun/management/jdp/JdpSpecificAddressTest.java java/beans/PropertyChangeSupport/Test4682386.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java java/beans/XMLEncoder/javax_swing_JTree.java java/beans/XMLEncoder/Test4631471.java java/beans/XMLEncoder/Test4903007.java fail in original, all pass except java/nio/channels/DatagramChannel/AdaptorMulticasting.java in rerun, manual rerun in Grinder/12940 passes
23:21:53 testSendNoReceive
23:21:53 STDERR:
23:21:53 java.lang.RuntimeException: message shouldn't have been received
23:21:53 at AdaptorMulticasting.testSendNoReceive(AdaptorMulticasting.java:459)
23:21:53 at AdaptorMulticasting.testJoinGroup1(AdaptorMulticasting.java:160)
23:21:53 at AdaptorMulticasting.test(AdaptorMulticasting.java:93)
23:21:53 at AdaptorMulticasting.main(AdaptorMulticasting.java:80)
23:21:53 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
23:21:53 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
23:21:53 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
23:21:53 at java.base/java.lang.reflect.Method.invoke(Method.java:569)
23:21:53 at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
23:21:53 at java.base/java.lang.Thread.run(Thread.java:840)
23:21:53
riscv64_linux ✔️
sanity.openjdk serviceability/sa/TestJhsdbJstackMixed.java fails in original, passes on rerun
extended.openjdk - 4 targets TESTLIST=jdk_vector_0,hotspot_serviceability_0,jdk_core_tools_1,jdk_core_tools_0 fail in original, 2 testcases from jdk_core_tools fail in rerun, manually rerun on !test-rise-ubuntu2404-riscv64-2 in Grinder/12933
TEST: tools/jpackage/share/EmptyFolderTest.java#id0
TEST: tools/jpackage/share/EmptyFolderTest.java#id1
Those look to be needing a lib_awt library that likely not present on a headless platform, counting it as non-blocking
Exception in thread "main" java.lang.UnsatisfiedLinkError: Can't load library: /home/jenkins/workspace/Grinder/aqa-tests/TKG/output_17448927247866/jdk_custom_0/work/scratch/1/testAppImage/output/AppImageEmptyFolderTest/lib/runtime/lib/libawt_xawt.so
ACTION: investigate if those 2 testcases are to be excluded for riscv
x86-32_windows ✔️
sanity.openjdk compiler/loopopts/superword/TestEliminateAllocationWithCastP2XUse.java fails, should be excluded
Unrecognized VM option 'SplitIfBlocks'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
extended.openjdk 3 targets TESTLIST=jdk_io_2,jdk_core_tools_2,hotspot_compiler_0fail in original, 3 testcases fail in rerun compiler/loopopts/superword/TestEliminateAllocationWithCastP2XUse.java, java/io/File/createTempFile/SpecialTempFile.java, tools/jpackage/share/EmptyFolderTest.java#id0
EmptyFolderTest
java.lang.AssertionError: Expected [0]. Actual [1603]: Check command [cmd /c .\testPackage\uunpacked-msi\uunpack.bat](3) exited with 0 code
at jdk.jpackage.test.TKit.error(TKit.java:264)
at jdk.jpackage.test.TKit.assertEquals(TKit.java:567)
SpecialTempFile
java.io.IOException: Unable to create temporary file
at java.base/java.io.File.createTempFile(File.java:2171)
at SpecialTempFile.test(SpecialTempFile.java:74)
at SpecialTempFile.main(SpecialTempFile.java:123)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
at java.base/java.lang.Thread.run(Thread.java:840)
Rerun SpecialTempFile and EmptyFolderTest in Grinder/12964 and Grinder/12965
SpecialTempFile still fails, however EmptyFolderTest passes
# Timestamp: Wed Apr 23 16:17:07 2025 UTC
# CUSTOM_TARGET: java/io/File/createTempFile/SpecialTempFile.java tools/jpackage/share/EmptyFolderTest.java#id0
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1 EXECUTED: 1 PASSED: 0 FAILED: 1 DISABLED: 0 SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 1; error: 0; skipped: 0
1..1
not ok 1 - jdk_custom_0
---
output:
|
Failed test cases:
TEST: java/io/File/createTempFile/SpecialTempFile.java
Test results: passed: 1; failed: 1
duration_ms: 287084
...
SpecialTempFile test code has been updated since January release, which I suspect has changed its behaviour on Win32
- https://github.com/adoptium/jdk17u/commit/356146f558660abdf56d81ede41ce62c5e412f50
- https://github.com/adoptium/jdk17u/commit/2691c1428c592f952a0093e0cae3244ab48246c0
- https://github.com/adoptium/jdk17u/commit/d6ad2f1715757bc289cc16c78680f515aec78a6d Will consider this failure as non-blocking, but ACTION: need to raise issue