aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard

April 2025 Release Triage - JDK8

Open smlambert opened this issue 7 months ago • 11 comments

Release Summary Report for release-openjdk8-pipeline

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk8-pipeline/79/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk8u" build number 4898 at 4/15/2025, 9:03:14 PM


✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2812591038
x86-64_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2812570510
x86-64_windows ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2812592276
aarch64_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2812593016
x86-64_alpine-linux ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2815239917 infra issue to update diff version on nodes
ppc64le_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2812605343
ppc64_aix ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2812615373
sparcv9_solaris ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2815240245
x86-64_solaris ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2815240399
x86-32_windows ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2816347874 separate pipeline
arm_linux ✔️ https://github.com/adoptium/aqa-tests/issues/6200#issuecomment-2830264974 separate pipeline

smlambert avatar Apr 16 '25 12:04 smlambert

x86-64_linux ✔️

extended.openjdk 4 testcases fail in originalCUSTOM_TARGET: jdk/jfr/event/sampling/TestNative.java sun/security/pkcs11/fips/TestTLS12.java sun/security/pkcs11/Secmod/JksSetPrivateKey.java sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java, 2 still fail in rerun Symantec.java and TestNative.java, manually rerun in Grinder/12926, Symantec.java is a known, non-blocking issue Grinder_20250417112802_JDK8_x64Linux.tap.txt

sanity.system - 2 targets fail, MauveSingleThrdLoad_HS_5m_0 and MauveSingleInvocLoad_HS_5m_1 on # Hostname: test-ibmcloud-rhel6-x64-1.adoptopenjdk.net, rerun manually on an Ubuntu machine, in Grinder/12927 passes Grinder_20250417113350_JDK8_x64Linux.tap.txt

extended.system - MiniMix targets fail in original, pass in rerun on Ubuntu2404 node

smlambert avatar Apr 17 '25 11:04 smlambert

x86-64_mac ✔️

extended.openjdk - sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java fails, is known/non-blocking

all other top-level targets pass

smlambert avatar Apr 17 '25 11:04 smlambert

x86-64_windows ✔️

all pass

smlambert avatar Apr 17 '25 11:04 smlambert

aarch64_linux ✔️

extended.openjdk jdk/jfr/event/runtime/TestThreadCpuTimeEvent.java jdk/jfr/event/sampling/TestNative.java sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java fail in original, Symantec.java is a known non-blocking failure, other testcases pass in rerun

sanity.system - MauveSingleThrdLoad_HS_5m_0 target fails in original, passes in rerun (seen with x64 Linux also, ACTION: investigate why passes on Ubuntu nodes but not on RHEL nodes)

extended.system - Minimix targets fail in original and in rerun, run manually in Grinder/12928 on debian node passes

Grinder_20250417113907_JDK8_aarch64Linux.tap.txt

smlambert avatar Apr 17 '25 11:04 smlambert

ppc64le_linux ✔️

extended.openjdk - sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java fails, and is a known non-blocking issue

smlambert avatar Apr 17 '25 11:04 smlambert

ppc64_aix ✔️

sanity.openjdk - java/lang/ThreadLocal/TestThreadId.java failed in original, passed in rerun

extended.openjdk - sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java failed and is known, non-blocking

sanity.system - Mauve targets failing with

13:16:09.319 - Test failed
        LT    Failure num.  = 1
        LT    Test number   = 3580
        LT    Test details  = 'Mauve[gnu.testlet.java.nio.ByteBuffer.Allocating]'

manual rerun in Grinder/12929 on test-osuosl-aix72-ppc64-6 passes

extended.system - Minimix failures, manual rerun on test-osuosl-aix72-ppc64-6 in Grinder/12930 passes

smlambert avatar Apr 17 '25 11:04 smlambert

x86-64_alpine-linux ✔️

extended.openjdk CUSTOM_TARGET: sun/tools/native2ascii/Native2AsciiTests.sh tools/launcher/ExecutionEnvironment.java sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java fail in original, Native2AsciiTests and Symantec fail in rerun, Symantec.java known/non-blocking, Native2AsciiTests is an issue with the version of diff on machine ACTION: raise infra issue (test material using -c option that is not available), consider non-blocking

TEST: sun/tools/native2ascii/Native2AsciiTests.sh
00:12:56  TEST JDK: /home/jenkins/workspace/Test_openjdk8_hs_extended.openjdk_x86-64_alpine-linux_rerun/jdkbinary/j2sdk-image
00:12:56  
00:12:56  ACTION: shell -- Failed. Execution failed: exit code 1
00:12:56  REASON: Assumed action based on file name: run shell Native2AsciiTests.sh 
00:12:56  TIME:   0.569 seconds
00:12:56  messages:
00:12:56  command: shell Native2AsciiTests.sh
00:12:56  reason: Assumed action based on file name: run shell Native2AsciiTests.sh 
00:12:56  elapsed time (seconds): 0.569
00:12:56  STDOUT:
00:12:56  4630463 failed
00:12:56  STDERR:
00:12:56  + diff -c x.out.expected x.out.1
00:12:56  diff: unrecognized option: c
00:12:56  BusyBox v1.36.1 (2024-06-10 07:11:47 UTC) multi-call binary.

smlambert avatar Apr 18 '25 10:04 smlambert

sparcv9_solaris

sxa@fedora:~$ curl -q https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-sparcv9-temurin-simpletest/78/consoleText | awk '/FAILED test targets:/,/TOTAL:/'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0FAILED test targets:
	jdk_lang_0 - Test results: passed: 473; failed: 1 
		Failed test cases: 
			TEST: jdk/lambda/vm/InterfaceAccessFlagsTest.java
        

TOTAL: 23   EXECUTED: 9   PASSED: 8   FAILED: 1   DISABLED: 0   SKIPPED: 14
100 1704k    0 1704k    0     0  2666k      0 --:--:-- --:--:-- --:--:-- 2667kFAILED test targets:
	hotspot_jdk_0 - Test results: passed: 812; error: 1 
		Failed test cases: 
			TEST: serviceability/sa/jmap-hashcode/Test8028623.java
        
	jdk_security3_0 - Test results: passed: 606; failed: 2 
		Failed test cases: 
			TEST: sun/security/ssl/SSLSocketImpl/ClientSocketCloseHang.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java
        

TOTAL: 64   EXECUTED: 16   PASSED: 14   FAILED: 2   DISABLED: 15   SKIPPED: 33
100 4081k    0 4081k    0     0  3869k      0 --:--:--  0:00:01 --:--:-- 3872k
sxa@fedora:~$ 
  • InterfaceAccessFlags is known to be intermittent: https://github.com/adoptium/aqa-tests/issues/5916
  • Test8028623 and ClientSocketCloseHang are known intermittent tests: https://github.com/adoptium/temurin-build/issues/4099#issuecomment-2614362854
    • Test8028623 passed with gmake _hotspot_custom JDK_CUSTOM_TARGET=serviceability/sa/jmap-hashcode/Test8028623.java on the command line on the TC system.
    • ClientSocketCloseHang passed on second attempt with gmake _hotspot_custom JDK_CUSTOM_TARGET=serviceability/sa/jmap-hashcode/Test8028623.java
  • Symantec failure I believe is an expired certificate and is marked non-blocking on other platforms.

Noting also the presence of core files in of the targets:

  • output_1744816618281/langtools_all_0/work/classes/tools/javac/annotations/6365854/test/core
  • output_17448304533232/MauveMultiThrdLoad_5m_0/20250416-151815-MauveMultiThrdLoad/results/core
  • output_17448366901769/MiniMix_10m_0/20250416-155720-MixedLoadTest/results/core
  • output_17448366901769/MiniMix_5m_0/20250416-155139-MixedLoadTest/results/core
  • output_17448366901769/MiniMix_aot_5m_0/20250416-160854-MixedLoadTest/results/core

Some of those may be normal - https://ci.adoptium.net/job/Grinder/12952/console running MauveMultiThrdLoad_5m_0 seems to have segfaulted

InterfaceAccessFlags is still failing consistently at the command line but passed 25/25 iterations in Grinder:

gmake _jdk_custom JDK_CUSTOM_TARGET=jdk/lambda/vm/InterfaceAccessFlagsTest.java

but seems to pass in Grinder. Need to figure out the difference. Failing .jtr is InterfaceAccessFlagsTest.jtr.txt which has the error java.lang.RuntimeException: IOException encountered during compilation

gmake _jdk_custom JDK_CUSTOM_TARGET=jdk/lambda/vm/InterfaceAccessFlagsTest.java

EDIT: Passes ok on the AQA machine but not on the "private" Sparc machine.

Discussed with @smlambert today and on the basis that the core dumps do not appear to be a regression we will not block on this and can consider it an OVERALL PASS

smlambert avatar Apr 18 '25 10:04 smlambert

x86-64_solaris

Four failures:

sxa@fedora:~$ curl -q https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-temurin-simpletest/89/consoleText | awk '/FAILED test targets:/,/TOTAL:/'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0FAILED test targets:
	jdk_lang_0 - Test results: passed: 472; failed: 1 
		Failed test cases: 
			TEST: jdk/lambda/vm/InterfaceAccessFlagsTest.java
        

TOTAL: 23   EXECUTED: 9   PASSED: 8   FAILED: 1   DISABLED: 0   SKIPPED: 14
100 2052k    0 2052k    0     0  3161k      0 --:--:-- --:--:-- --:--:-- 3161kFAILED test targets:
	jdk_security3_0 - Test results: passed: 616; failed: 2 
		Failed test cases: 
			TEST: javax/net/ssl/ciphersuites/DisabledAlgorithms.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java
        
	jdk_management_0 - Test results: passed: 110; failed: 1 
		Failed test cases: 
			TEST: sun/management/jmxremote/bootstrap/SSLConfigFilePermissionTest.sh
        

TOTAL: 64   EXECUTED: 15   PASSED: 13   FAILED: 2   DISABLED: 18   SKIPPED: 31
100 3887k    0 3887k    0     0  4391k      0 --:--:-- --:--:-- --:--:-- 4387k
sxa@fedora:~$ 
  • InterfaceAccessFlags is known to be intermittent: https://github.com/adoptium/aqa-tests/issues/5916
  • DisabledAlgorithms is a know failure on recent JDK8u test material: https://github.com/adoptium/aqa-tests/issues/5915
  • Symantec failure I believe is an expired certificate and is marked non-blocking on other platforms.
  • SSLConfigFilePermissionTest.sh is non-blocking and caused by the DHCP server setup blocking a port on the Solaris/x64 systems: https://github.com/adoptium/aqa-tests/issues/5917

InterfaceAccessFlags passed with:

gmake _jdk_custom JDK_CUSTOM_TARGET=jdk/lambda/vm/InterfaceAccessFlagsTest.java

From the jtr file (output_*/jdk_custom_0/work/jdk/lambda/vm/InterfaceAccessFlagsTest.jtr):

===============================================
jdk/lambda/vm/InterfaceAccessFlagsTest.java
Total tests run: 3, Failures: 0, Skips: 0
===============================================

On the basis of the above we can consider this an OVERALL PASS

smlambert avatar Apr 18 '25 10:04 smlambert

x86-32_windows ✔️

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk8-pipeline/82/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk8u" build number 4898 at 4/17/2025, 9:10:30 AM

all pass

smlambert avatar Apr 18 '25 23:04 smlambert

arm_linux ✔️

https://ci.adoptium.net/job/build-scripts/job/release-openjdk8-pipeline/84/

Test_openjdk8_hs_extended.openjdk_arm_linux #140 -unstable TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java - unblock -- need to exclude TEST: java/net/ipv6tests/TcpTest.java - https://ci.adoptium.net/job/Grinder/13027/ -passed

Grinder_20250425191930.tap.txt

https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.openjdk_arm_linux/666/ -- similar to https://github.com/adoptium/aqa-tests/issues/2263, lambda related, not sure not happened before? Failed test cases: TEST: java/util/stream/boottest/java/util/stream/FlagOpTest.java TEST: java/util/stream/boottest/java/util/stream/NodeTest.java TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/FilterOpTest.java TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/IntSliceOpTest.java TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/SequentialOpTest.java TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/IntUniqOpTest.java TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/StreamBuilderTest.java TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/InfiniteStreamWithLimitOpTest.java

See https://github.com/adoptium/aqa-tests/issues/5098

smlambert avatar Apr 25 '25 12:04 smlambert