aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

April 2025 Release Triage - JDK17

Open smlambert opened this issue 7 months ago • 11 comments

Release Summary Report for release-openjdk17-pipeline - Grid view


✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809573010
x86-64_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809823651
x86-64_windows ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809447340
aarch64_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809566055
aarch64_mac ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809358658
x86-64_alpine-linux ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2812676101
ppc64le_linux ✔️ all pass
s390x_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2812677204
ppc64_aix ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2809847505 Raise issues for 3 testcases mentioned in comment
arm_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2810393663
riscv64_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2812677953 2 headful testcases fail / need problemlist
x86-32_windows ✔️ https://github.com/adoptium/aqa-tests/issues/6197#issuecomment-2816378230 separate pipeline

smlambert avatar Apr 16 '25 11:04 smlambert

aarch64_mac ✔️

extended.openjdk CUSTOM_TARGET: gc/metaspace/TestMetaspacePerfCounters.java#Epsilon-64 fails in original, passes on rerun

smlambert avatar Apr 16 '25 12:04 smlambert

x86-64_windows ✔️

extended.openjdk original and rerun a variety of failures running on test-azure-win2022-x64-2 manual rerun on test-azure-win2022-x64-3 in Grinder/12910 as deep history shows them passing there - 77 testcases pass in 12910, 1 still fails java/io/File/createTempFile/SpecialTempFile.java.SpecialTempFile - unable to create temp file (consider non-blocker) Grinder_20250416153128_JDK17_win64.tap.txt & Grinder/12920

ACTION: need infra issue to investigate diff between test-azure-win2022-x64-3 and test-azure-win2022-x64-2

extended.perf - renaissance targets fail on test-azure-win2022-x64-4 with java.lang.UnsatisfiedLinkError: C:\jenkins\workspace\Test_openjdk17_hs_extended.perf_x86-64_windows_rerun\aqa-tests\TKG\output_17447735254868\renaissance-chi-square_0\harness-031855-13538900942902338658\apache-spark\chi-square\hadoop\bin\hadoop.dll: %1 is not a valid Win32 application manual rerun on test-azure-win2022-x64-3 in Grinder/12911 - passes Grinder_20250416153954_JDK17_win64.tap.txt

  • Long queue for machines

smlambert avatar Apr 16 '25 12:04 smlambert

aarch64_linux ✔️

sanity.openjdk CUSTOM_TARGET: tools/javac/lambda/LambdaParserTest.java fails in original, passes in rerun

smlambert avatar Apr 16 '25 13:04 smlambert

x86-64_mac ✔️

extended.openjdk CUSTOM_TARGET: com/sun/jndi/dns/ConfigTests/PortUnreachable.java fails in original, passes in rerun

smlambert avatar Apr 16 '25 13:04 smlambert

x86-64_linux ✔️

extended.openjdk pending

  • waiting on https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_linux_testList_2/42/

other top-level targets pass

smlambert avatar Apr 16 '25 14:04 smlambert

ppc64_aix ✔️

sanity.openjdk unstable

  • 4 testcases CUSTOM_TARGET: gc/metaspace/TestMetaspacePerfCounters.java#Epsilon-64 runtime/ErrorHandling/MachCodeFramesInErrorFile.java runtime/DefineClass/NullClassBytesTest.java runtime/jni/getCreatedJavaVMs/TestGetCreatedJavaVMs.java failed in original, 3 fail in rerun
       Failed test cases: 
        TEST: runtime/DefineClass/NullClassBytesTest.java
        TEST: runtime/ErrorHandling/MachCodeFramesInErrorFile.java
        TEST: runtime/jni/getCreatedJavaVMs/TestGetCreatedJavaVMs.java
        Test results: passed: 1; failed: 3

extended.openjdk 5 targets TESTLIST=hotspot_runtime_0,hotspot_compiler_0,hotspot_gc_0,jdk_jmx_0,jdk_net_1,jdk_jmx_1 fail in original, a handful of testcases fail in rerun, manually rerun the failing testcases in Grinder/12913 and Grinder/12914 Those Grinders still have the following failures (some OOM): java/net/httpclient/StreamingBody.java.StreamingBody javax/management/mxbean/ThreadStartTest.java.ThreadStartTest OOM runtime/DefineClass/NullClassBytesTest.java.NullClassBytesTest OOM runtime/ErrorHandling/MachCodeFramesInErrorFile.java.MachCodeFramesInErrorFile fatal error see below runtime/jni/getCreatedJavaVMs/TestGetCreatedJavaVMs.java.TestGetCreatedJavaVMs StackOverFlow

MachCodeFramesInErrorFile crashes

Execution failed: `main' threw exception: java.lang.RuntimeException: "Native frames: " line missing in hs_err_pid file: # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x0a000100000816a0, pid=6488400, tid=258 # # JRE version: OpenJDK Runtime Environment Temurin-17.0.15+6 (17.0.15+6) (build 17.0.15+6) # Java VM: OpenJDK 64-Bit Server VM Temurin-17.0.15+6 (17.0.15+6, compiled mode, compressed oops, compressed class ptrs, g1 gc, aix-ppc64) # Problematic frame: # J 18 c2 MachCodeFramesInErrorFile$Crasher.crashInJava3(J)V (27 bytes) @ 0x0a000100000816a0 [0x0a00010000081680+0x0000000000000020] # # CreateCoredumpOnCrash turned off, no core file dumped # # If you would like to submit a bug report, please visit: # https://github.com/adoptium/adoptium-support/issues

TestGetCreatedJavaVMs... StackOverflowError

07:48:23  STDERR:
07:48:23   stdout: [Error occurred during initialization of VM
07:48:23  java.lang.StackOverflowError
07:48:23  	at java.lang.String.<clinit>(java.base/String.java:224)
07:48:23  
07:48:23  [*] Creating thread 0
07:48:23  [*] Creating thread 1
07:48:23  [0] BEGIN JNI_CreateJavaVM
07:48:23  [1] BEGIN JNI_CreateJavaVM
07:48:23  [1] END JNI_CreateJavaVM
07:48:23  [1] Error creating JVM: -5
07:48:23  [1] BEGIN JNI_GetCreatedJavaVMs
07:48:23  [1] END JNI_GetCreatedJavaVMs
07:48:23  [1] Obtained 0 created VMs
07:48:23  ];
07:48:23   stderr: []
07:48:23   exitValue = 1
07:48:23  
07:48:23  java.lang.RuntimeException: Expected to get exit value of [0]
07:48:23  
07:48:23  	at jdk.test.lib.process.OutputAnalyzer.shouldHaveExitValue(OutputAnalyzer.java:489)
07:48:23  	at TestGetCreatedJavaVMs.main(TestGetCreatedJavaVMs.java:39)
07:48:23  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
07:48:23  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
07:48:23  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
07:48:23  	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
07:48:23  	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
07:48:23  	at java.base/java.lang.Thread.run(Thread.java:840)

Rerun the 5 failing testcases

ACTION: determine whether the 3 testcase failures NullClassBytesTest,MachCodeFramesInErrorFile,TestGetCreatedJavaVMs should be considered blocking or non-blocking

Try running with -Xint Grinder/12987 - Unstable

  • gc_g1_TestSkipRebuildRemsetPhase - PASSED
  • rest failed...

NullClassBytesTest,MachCodeFramesInErrorFile,TestGetCreatedJavaVMs Summary:

  • hotspot/jtreg/native/GetCreatedJavaVMs is new in jdk-17.0.15: https://github.com/adoptium/jdk17u/commit/ed63b718fe5b4e9f77154f6015516762800d13d6
    • Cause StackOverflow, reason unclear - Testcase error????
    • As new testcase, needs further investigation... but say Non-Blocking
  • runtime/DefineClass/NullClassBytesTest.java failed previous release in jdk-17.0.14 Grinder using: https://ci.adoptium.net/job/Grinder/13003/console
    • Fails here: https://github.com/openjdk/jdk17u/blob/0b592b7f04aae6cec666345be37c1456845e6e0d/src/java.base/share/native/libjava/ClassLoader.c#L105
    • Due to following test case, where b.length==0, and the 0 gets passed to malloc(0), the result of which is OS/compiler specific, and suspect in this AIX case returns 0 rather than an arbitrary address :
                      byte[] b = new byte[0];
                     return defineClass(name, b, 0, b.length);
    
    • I think testcase is not accurate, as OutOfMemory from malloc(0) returning 0 is valid, hence Non_blocking
  • runtime/ErrorHandling/MachCodeFramesInErrorFile.java failed in jdk-17.0.14 Grinder using: https://ci.adoptium.net/job/Grinder/13015/consoleFull
    • Fails due to fr.pc() == 0, indicating no valid native frame : https://github.com/adoptium/jdk17u/blob/0b592b7f04aae6cec666345be37c1456845e6e0d/src/hotspot/share/utilities/vmError.cpp#L373
      • Hence no "Native frames:" line in crash hserr dump
      • Only affects hserr dump output, so would say Non-Blocking

smlambert avatar Apr 16 '25 14:04 smlambert

arm_linux ✔️

extended.functional - CryptoTests_jtreg fails (cryptotest.tests.SignatureTests times out on test-docker-debian12-armv7l-1), rerun on test-docker-ubuntu2404-armv7-5 in Grinder/12917 - passes Grinder_20250416183014_JDK17_armLinux.tap.txt

sanity.openjdk java/lang/invoke/TestLambdaFormCustomization.java fails in rerun, manually rerun in Grinder/12918 on test-docker-ubuntu2404-armv7-1 - passes Grinder_20250416184328_JDK17_armLinux.tap.txt

extended.openjdk 4 targets fail in original, pass in rerun

sanity.system 1 target fails in rerun TestJlmRemoteThreadAuth_2, manually rerun in Grinder/12919 on !test-docker-ubuntu2404-armv7-3 - passes Grinder_20250416184702_JDK17_armLinux.tap.txt

smlambert avatar Apr 16 '25 18:04 smlambert

x86-64_alpine-linux ✔️

sanity.openjdk CUSTOM_TARGET: jdk/jshell/ExternalEditorTest.java known/non-blocking (should be excluded, but no easy mechanism to problemlist for just alpine-linux instead of all linux)

extended.openjdk CUSTOM_TARGET: java/nio/channels/Selector/Wakeup.java fails in original, passes in rerun

smlambert avatar Apr 17 '25 12:04 smlambert

s390x_linux ✔️

extended.openjdk CUSTOM_TARGET: java/net/DatagramSocket/DatagramSocketExample.java java/net/DatagramSocket/DatagramSocketMulticasting.java java/net/MulticastSocket/SetLoopbackModeIPv4.java java/nio/channels/DatagramChannel/AdaptorMulticasting.java java/nio/channels/DatagramChannel/Loopback.java sun/management/jdp/JdpDefaultsTest.java sun/management/jdp/JdpJmxRemoteDynamicPortTest.java sun/management/jdp/JdpSpecificAddressTest.java java/beans/PropertyChangeSupport/Test4682386.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java java/beans/XMLEncoder/javax_swing_JTree.java java/beans/XMLEncoder/Test4631471.java java/beans/XMLEncoder/Test4903007.java fail in original, all pass except java/nio/channels/DatagramChannel/AdaptorMulticasting.java in rerun, manual rerun in Grinder/12940 passes

23:21:53  testSendNoReceive
23:21:53  STDERR:
23:21:53  java.lang.RuntimeException: message shouldn't have been received
23:21:53  	at AdaptorMulticasting.testSendNoReceive(AdaptorMulticasting.java:459)
23:21:53  	at AdaptorMulticasting.testJoinGroup1(AdaptorMulticasting.java:160)
23:21:53  	at AdaptorMulticasting.test(AdaptorMulticasting.java:93)
23:21:53  	at AdaptorMulticasting.main(AdaptorMulticasting.java:80)
23:21:53  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
23:21:53  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
23:21:53  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
23:21:53  	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
23:21:53  	at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
23:21:53  	at java.base/java.lang.Thread.run(Thread.java:840)
23:21:53  

smlambert avatar Apr 17 '25 12:04 smlambert

riscv64_linux ✔️

sanity.openjdk serviceability/sa/TestJhsdbJstackMixed.java fails in original, passes on rerun

extended.openjdk - 4 targets TESTLIST=jdk_vector_0,hotspot_serviceability_0,jdk_core_tools_1,jdk_core_tools_0 fail in original, 2 testcases from jdk_core_tools fail in rerun, manually rerun on !test-rise-ubuntu2404-riscv64-2 in Grinder/12933

TEST: tools/jpackage/share/EmptyFolderTest.java#id0
TEST: tools/jpackage/share/EmptyFolderTest.java#id1

Those look to be needing a lib_awt library that likely not present on a headless platform, counting it as non-blocking Exception in thread "main" java.lang.UnsatisfiedLinkError: Can't load library: /home/jenkins/workspace/Grinder/aqa-tests/TKG/output_17448927247866/jdk_custom_0/work/scratch/1/testAppImage/output/AppImageEmptyFolderTest/lib/runtime/lib/libawt_xawt.so

ACTION: investigate if those 2 testcases are to be excluded for riscv

smlambert avatar Apr 17 '25 12:04 smlambert

x86-32_windows ✔️

sanity.openjdk compiler/loopopts/superword/TestEliminateAllocationWithCastP2XUse.java fails, should be excluded

Unrecognized VM option 'SplitIfBlocks'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.

extended.openjdk 3 targets TESTLIST=jdk_io_2,jdk_core_tools_2,hotspot_compiler_0fail in original, 3 testcases fail in rerun compiler/loopopts/superword/TestEliminateAllocationWithCastP2XUse.java, java/io/File/createTempFile/SpecialTempFile.java, tools/jpackage/share/EmptyFolderTest.java#id0

EmptyFolderTest

java.lang.AssertionError: Expected [0]. Actual [1603]: Check command [cmd /c .\testPackage\uunpacked-msi\uunpack.bat](3) exited with 0 code
	at jdk.jpackage.test.TKit.error(TKit.java:264)
	at jdk.jpackage.test.TKit.assertEquals(TKit.java:567)

SpecialTempFile

java.io.IOException: Unable to create temporary file
	at java.base/java.io.File.createTempFile(File.java:2171)
	at SpecialTempFile.test(SpecialTempFile.java:74)
	at SpecialTempFile.main(SpecialTempFile.java:123)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
	at java.base/java.lang.Thread.run(Thread.java:840)

Rerun SpecialTempFile and EmptyFolderTest in Grinder/12964 and Grinder/12965

SpecialTempFile still fails, however EmptyFolderTest passes

# Timestamp: Wed Apr 23 16:17:07 2025 UTC 
# CUSTOM_TARGET: java/io/File/createTempFile/SpecialTempFile.java tools/jpackage/share/EmptyFolderTest.java#id0
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 1; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/io/File/createTempFile/SpecialTempFile.java
        Test results: passed: 1; failed: 1
    duration_ms: 287084
  ...

SpecialTempFile test code has been updated since January release, which I suspect has changed its behaviour on Win32

  • https://github.com/adoptium/jdk17u/commit/356146f558660abdf56d81ede41ce62c5e412f50
  • https://github.com/adoptium/jdk17u/commit/2691c1428c592f952a0093e0cae3244ab48246c0
  • https://github.com/adoptium/jdk17u/commit/d6ad2f1715757bc289cc16c78680f515aec78a6d Will consider this failure as non-blocking, but ACTION: need to raise issue

smlambert avatar Apr 19 '25 00:04 smlambert