aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

Unstable test jobs triage (pre-dry-run)

Open smlambert opened this issue 2 months ago • 4 comments

This is to look at the most recent EA pipelines for all versions ahead of the dry-run. Will not investigate if build jobs fail (and subsequently no test jobs are run). Will also ignore JDK25, as we have recently reviewed the state of things there (as part of Sept release activities). Because this is an EA triage, it is looking at more top-level test targets than are run as part of a release (dev.functional, sanity.external, etc).

JDK8

Platform Status Results Notes
x86-64_mac ⏸️
x86-64_linux ⏸️
x86-64_windows ⏸️
aarch64_linux ⏸️
x86-64_alpine-linux ⏸️
ppc64le_linux ⏸️
ppc64_aix ⏸️
sparcv9_solaris ⏸️
x86-64_solaris ⏸️
x86-32_windows ⏸️
arm_linux ⏸️ separate pipeline

JDK11

Grid view

Platform Status Results Notes
x86-64_mac ✔️ comment All tests pass, but job fails due to channel termination
x86-64_linux ✔️ comment
x86-64_windows Build fail, no tests run
aarch64_linux Build fail, no tests run
aarch64_mac comment
x86-64_alpine-linux comment
ppc64le_linux ✔️ All tests pass, but build unstable
s390x_linux ⏸️
ppc64_aix ⏸️
arm_linux Build fail, no tests run
x86-32_windows Build fail, no tests run

JDK17

Platform Status Results Notes
x86-64_mac ⏸️
x86-64_linux ⏸️
x86-64_windows ⏸️
aarch64_linux ⏸️
aarch64_mac ⏸️
x86-64_alpine-linux ⏸️
ppc64le_linux ⏸️
s390x_linux ⏸️
ppc64_aix ⏸️
arm_linux ⏸️
riscv64_linux ⏸️
x86-32_windows ⏸️

JDK21

Platform Status Results Notes
x86-64_mac ⏸️
x86-64_linux ⏸️
x86-64_windows ⏸️
aarch64_linux ⏸️
aarch64_mac ⏸️
x86-64_alpine-linux ⏸️
ppc64le_linux ⏸️
s390x_linux ⏸️
ppc64_aix ⏸️
riscv64_linux ⏸️
aarch64_windows ⏸️
aarch64_alpine-linux ⏸️

smlambert avatar Oct 08 '25 19:10 smlambert

JDK11 aarch64_mac

https://ci.adoptium.net/job/Test_openjdk11_hs_dev.functional_aarch64_mac/47/ - dev.functional - testHeadlessComponents fails on mac, appears also to pull in an alternate JDK, instead of testing the EA one that we would expect. Seems to be failing for all of DeepHistory. Exclude and consider excluding it everywhere if its not testing the JDK at TEST_JDK_HOME.

        + installAlternativeJDK
        ++ uname -m
        + ARCH=arm64
        + '[' x == x ']'
        + BOOTJDK_DIR=/Users/admin/bootjdk
        + '[' x == x ']'
        + BOOTJDK_ARCHIVE_DIR=/Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/bootjdkarchive
        + mkdir -p /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/bootjdkarchive
        + cd /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/bootjdkarchive
        + curl -OLJks https://api.adoptopenjdk.net/v3/binary/latest/11/ga/mac/arm64/jdk/hotspot/normal/adoptopenjdk
        + rm -rf /Users/admin/bootjdk
        + mkdir -p /Users/admin/bootjdk
        + unwrap_file_to_location /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/bootjdkarchive/adoptopenjdk /Users/admin/bootjdk
        + '[' mac == mac -o mac == linux ']'
        + tar --strip-components=1 -xf /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/bootjdkarchive/adoptopenjdk -C /Users/admin/bootjdk
        + JAVAC_BINARY=/Users/admin/bootjdk/bin/javac
        + '[' mac == mac ']'
        + JAVAC_BINARY=/Users/admin/bootjdk/Contents/Home/bin/javac
        + cp -r /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/aqa-tests/functional/testHeadlessComponents/TestHeadlessComponents/testHeadlessComponents /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac
        + ls /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac
        aqa-tests
        aqa-tests@tmp
        bootjdkarchive
        jdkbinary
        jvmtest
        testHeadlessComponents
        + pushd /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/testHeadlessComponents/jreTestingSwingComponents/src
        ~/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/testHeadlessComponents/jreTestingSwingComponents/src ~/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/bootjdkarchive
        ++ mktemp -d
        + cp=/var/folders/fs/0w3t9t1d28xc3bj0tgb8hcrw0000gn/T/tmp.IZX2wgclRf
        ++ find . -type f -name '*.java'
        + /Users/admin/bootjdk/Contents/Home/bin/javac ./IncompatibleComponent.java ./JLabelExample.java ./JDialogExample.java ./JButtonExample.java ./JComboBoxExample.java ./MainRunner.java ./JFrameExample.java ./TestArgumentParser.java ./CompatibleComponent.java ./SwingTestUtils.java ./JCheckBoxExample.java ./AbstractComponent.java -d /var/folders/fs/0w3t9t1d28xc3bj0tgb8hcrw0000gn/T/tmp.IZX2wgclRf
        /Users/admin/workspace/workspace/Test_openjdk11_hs_dev.functional_aarch64_mac/aqa-tests/TKG/../functional/testHeadlessComponents/TestHeadlessComponents/testHeadlessComponents.sh: line 189: /Users/admin/bootjdk/Contents/Home/bin/javac: No such file or directory
        -----------------------------------
        TestHeadlessComponents_0_FAILED

smlambert avatar Oct 08 '25 19:10 smlambert

JDK11 x64 Mac

https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.system_x86-64_mac/950/

Both child jobs passed all tests, but the parent test job failed due to

11:27:36  Exception: hudson.remoting.RequestAbortedException: java.io.IOException: Unexpected termination of the channel

smlambert avatar Oct 08 '25 19:10 smlambert

JDK11 x64 Linux

  • 1 testcase fails in original on test-docker-ubuntu2404-x64-1, passes in rerun on test-ibmcloud-ubuntu1604-x64-1
not ok 3 - hotspot_tier1_runtime_0
  ---
    output:
      |
        Failed test cases: 
        TEST: runtime/os/AvailableProcessors.java
        Test results: passed: 386; failed: 1
    duration_ms: 384298
  ...

sanity.external (not gating for releases) fails

19:32:39  Cleanup failed, processes still remain...
[Pipeline] echo
19:32:40  rc = 127, Unable to terminate all processes.

smlambert avatar Oct 08 '25 19:10 smlambert

JDK11 x64 alpine-linux

sanity.openjdk

TestRangeCheckPredicatesControl.java Problematic frame [libjvm.so+0xf02e65] ZObjectAllocator::remaining() const+0x25 and TestSystemGC.java#Z crash, Problematic frame [libjvm.so+0xef9e4e] ZMark::try_mark_object(ZMarkCache*, unsigned long, bool)+0x3e

# Timestamp: Fri Oct  3 05:05:02 2025 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 3   EXECUTED: 3   PASSED: 1   FAILED: 2   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1,915; failed: 2; error: 0; skipped: 0 
1..3
not ok 1 - hotspot_tier1_compiler_0
  ---
    output:
      |
        Failed test cases: 
        TEST: compiler/loopopts/TestRangeCheckPredicatesControl.java
        Test results: passed: 751; failed: 1
    duration_ms: 666260
  ...
not ok 2 - hotspot_tier1_gc_0
  ---
    output:
      |
        Failed test cases: 
        TEST: gc/TestSystemGC.java#Z 
        Test results: passed: 295; failed: 1
    duration_ms: 630697
  ...
...
jdk/test/hotspot/jtreg/compiler/loopopts/TestRangeCheckPredicatesControl.java
00:33:34  
00:33:34  ACTION: main -- Failed. Unexpected exit from test [exit code: 134]
00:33:34  REASON: User specified action: run main/othervm -Xmx256m -XX:+UnlockExperimentalVMOptions -XX:+UseZGC compiler.loopopts.TestRangeCheckPredicatesControl 
00:33:34  TIME:   1.047 seconds
00:33:34  messages:
00:33:34  command: main -Xmx256m -XX:+UnlockExperimentalVMOptions -XX:+UseZGC compiler.loopopts.TestRangeCheckPredicatesControl
00:33:34  reason: User specified action: run main/othervm -Xmx256m -XX:+UnlockExperimentalVMOptions -XX:+UseZGC compiler.loopopts.TestRangeCheckPredicatesControl 
00:33:34  started: Fri Oct 03 04:33:22 GMT 2025
00:33:34  Mode: othervm [/othervm specified]
00:33:34  finished: Fri Oct 03 04:33:23 GMT 2025
00:33:34  elapsed time (seconds): 1.047
00:33:34  configuration:
00:33:34  STDOUT:
00:33:34  #
00:33:34  # A fatal error has been detected by the Java Runtime Environment:
00:33:34  #
00:33:34  #  SIGSEGV (0xb) at pc=0x00007ddbc8904e65, pid=3292505, tid=3292530
00:33:34  #
00:33:34  # JRE version: OpenJDK Runtime Environment Temurin-11.0.29+6-202510012007 (11.0.29+6) (build 11.0.29-beta+6-ea)
00:33:34  # Java VM: OpenJDK 64-Bit Server VM Temurin-11.0.29+6-202510012007 (11.0.29-beta+6-ea, mixed mode, tiered, z gc, linux-amd64)
00:33:34  # Problematic frame:
00:33:34  # V  [libjvm.so+0xf02e65]  ZObjectAllocator::remaining() const+0x25

...

64_alpine-linux_testList_2/aqa-tests/openjdk/openjdk-jdk/test/hotspot/jtreg/gc/TestSystemGC.java
[2025-10-03T01:53:55.035Z] 
[2025-10-03T01:53:55.035Z] ACTION: main -- Failed. Unexpected exit from test [exit code: 134]
[2025-10-03T01:53:55.035Z] REASON: User specified action: run main/othervm -XX:+UnlockExperimentalVMOptions -XX:+UseZGC gc.TestSystemGC 
[2025-10-03T01:53:55.035Z] TIME:   0.648 seconds
[2025-10-03T01:53:55.035Z] messages:
[2025-10-03T01:53:55.035Z] command: main -XX:+UnlockExperimentalVMOptions -XX:+UseZGC gc.TestSystemGC
[2025-10-03T01:53:55.035Z] reason: User specified action: run main/othervm -XX:+UnlockExperimentalVMOptions -XX:+UseZGC gc.TestSystemGC 
[2025-10-03T01:53:55.035Z] started: Fri Oct 03 01:53:44 GMT 2025
[2025-10-03T01:53:55.035Z] Mode: othervm [/othervm specified]
[2025-10-03T01:53:55.035Z] finished: Fri Oct 03 01:53:45 GMT 2025
[2025-10-03T01:53:55.035Z] elapsed time (seconds): 0.648
[2025-10-03T01:53:55.035Z] configuration:
[2025-10-03T01:53:55.035Z] STDOUT:
[2025-10-03T01:53:55.035Z] #
[2025-10-03T01:53:55.035Z] # A fatal error has been detected by the Java Runtime Environment:
[2025-10-03T01:53:55.035Z] #
[2025-10-03T01:53:55.035Z] #  SIGSEGV (0xb) at pc=0x000073c593343e4e, pid=2898846, tid=2898851
[2025-10-03T01:53:55.035Z] #
[2025-10-03T01:53:55.035Z] # JRE version: OpenJDK Runtime Environment Temurin-11.0.29+6-202510012007 (11.0.29+6) (build 11.0.29-beta+6-ea)
[2025-10-03T01:53:55.035Z] # Java VM: OpenJDK 64-Bit Server VM Temurin-11.0.29+6-202510012007 (11.0.29-beta+6-ea, mixed mode, tiered, z gc, linux-amd64)
[2025-10-03T01:53:55.035Z] # Problematic frame:
[2025-10-03T01:53:55.035Z] # V  [libjvm.so+0xef9e4e]  ZMark::try_mark_object(ZMarkCache*, unsigned long, bool)+0x3e
[2025-10-03T01:53:55.035Z] #
[2025-10-03T01:53:55.035Z] # Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -F%F -- %E" (or dumping to /home/jenkins/workspace/Test_openjdk11_hs_sanity.openjdk_x86-64_alpine-linux_testList_2/aqa-tests/TKG/output_17594548608817/hotspot_tier1_gc_0/work/scratch/0/core.2898846)
[2025-10-03T01:53:55.035Z] #6646 

smlambert avatar Oct 08 '25 21:10 smlambert