aqa-tests icon indicating copy to clipboard operation
aqa-tests copied to clipboard
verified publisher icon adoptium

October 2024 Release Triage: JDK17

Open smlambert opened this issue 1 year ago • 11 comments

https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/70/

✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ comment
x86-64_linux ✔️ comment smoke tests failed, so running test jobs via AQA_Test_Pipeline/378/
x86-64_windows ✔️ comment
aarch64_linux ✔️ comment
aarch64_mac ✔️ comment initial build failed, rebuld at release-openjdk17-pipeline/71/
x86-64_alpine-linux ✔️ all pass
ppc64le_linux ✔️ comment smoke tests failed running on misconfigured machine, need to run all test jobs via AQA_Test_Pipeline/379, 1 testcase does not compile InetAddress.ofLiteral needs exclusion
s390x_linux ✔️ comment
ppc64_aix ✔️ comment
arm_linux ✔️ comment TODO: exclude sun/security/util/Debug/DebugOptions.java
riscv64_linux ✔️ comment
x86-32_windows ✔️ comment Exclude tests that fail with HeadlessException, and ensure that all windows machines are configured to be able to run the JShellHeapDump test

smlambert avatar Oct 16 '24 13:10 smlambert

x86-64_mac ✔️

waiting on extended.openjdk (https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_mac/181/)

  • 4/5 child jobs passed, waiting on https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_mac_testList_2/23/ to complete, that job failed with
04:37:01  Cannot contact test-orka-macos14-x64-d5pxf: java.lang.InterruptedException
01:34:35  Cancelling nested steps due to timeout
01:34:35  Could not connect to test-orka-macos14-x64-d5pxf to send interrupt signal to process
[Pipeline] sh

rerun at: https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_mac_testList_2/24 - passes Test_openjdk17_hs_extended.openjdk_x86-64_mac_testList_2.tap.txt

other top-level targets passing

smlambert avatar Oct 16 '24 14:10 smlambert

x86-64_linux ✔️

Smoke test failure due to jobs being sent to dynamic agents (as they are currently labeled with ci.role.test and should not be).
Exception: java.io.IOException: Cannot run program "Xvfb": error=2, No such file or directory

Rerun of smoke tests at: https://ci.adoptium.net/job/build-scripts/job/jobs/job/release/job/jobs/job/jdk17u/job/jdk17u-release-linux-x64-temurin_SmokeTests/25 - passes jdk17u-release-linux-x64-temurin_SmokeTests.tap.txt

Then trigger all 9 test targets via AQA_Test_Pipeline at: https://ci.adoptium.net/view/Test_grinder/job/AQA_Test_Pipeline/378/ sanity.openjdk has 1 testcase failure, java/lang/ProcessHandle/InfoTest.java, rerun in Grinder/11187 - passes Grinder_20241017041052_JDK17_x64Linux.tap.txt

extended.openjdk was run serially and hit 10hr time limit so was aborted, rerun with PARALLEL=Dynamic,NUM_MACHINES=3 in https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_linux/221/ which passes Test_openjdk17_hs_extended.openjdk_x86-64_linux_testList_0.tap.txt Test_openjdk17_hs_extended.openjdk_x86-64_linux_testList_2.tap.txt Test_openjdk17_hs_extended.openjdk_x86-64_linux_testList_1.tap.txt

smlambert avatar Oct 16 '24 14:10 smlambert

x86-64_windows ✔️

waiting on extended.openjdk (https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_windows/183/)

As we have marked win2019 machines offline and they were previously the only nodes where the bean tests were passing, we see the following failures in the rerun

# Timestamp: Wed Oct 16 17:56:21 2024 UTC 
# CUSTOM_TARGET: java/beans/PropertyEditor/6380849/TestPropertyEditor.java java/beans/PropertyEditor/TestColorClass.java java/beans/PropertyEditor/TestColorClassJava.java java/beans/PropertyEditor/TestColorClassNull.java java/beans/PropertyEditor/TestColorClassValue.java java/beans/PropertyEditor/TestFontClass.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassNull.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/java_awt_ScrollPane.java javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java java/beans/PropertyEditor/6380849/TestPropertyEditor.java java/beans/PropertyEditor/TestColorClass.java java/beans/PropertyEditor/TestColorClassNull.java java/beans/PropertyEditor/TestColorClassJava.java java/beans/PropertyEditor/TestColorClassValue.java java/beans/PropertyEditor/TestFontClass.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassNull.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/java_awt_ScrollPane.java sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java sun/tools/jhsdb/JShellHeapDumpTest.java sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java sun/tools/jhsdb/JShellHeapDumpTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 13; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClass.java
        TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClass.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        TEST: sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        Test results: failed: 13
    duration_ms: 245147
  ...

These are known issues (https://github.com/adoptium/aqa-tests/issues/5616), that were excluded in master via https://github.com/adoptium/aqa-tests/pull/5617 but not cherrypicked to release branch. Consider non-blocking.

other top-level targets passing

smlambert avatar Oct 16 '24 14:10 smlambert

aarch64_linux ✔️

extended.openjdk 1 testcase failure, passes on rerun

# CUSTOM_TARGET: sun/security/ec/ed/EdDSATest.java sun/security/ec/ed/EdDSATest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 146284
  ...

sanity.system 1 target fails TestJlmRemoteMemoryAuth_1, passes on rerun on test-aws-rhel76-armv8-1

# Timestamp: Wed Oct 16 09:15:35 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
1..1
ok 1 - TestJlmRemoteMemoryAuth_1
  ---
    duration_ms: 992128
  ...

extended.system 1 target fails, ConcurrentLoadTest_5m_1, passes on rerun on test-osuosl-ubuntu2404-aarch64-1

# Timestamp: Wed Oct 16 06:42:55 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
1..1
ok 1 - ConcurrentLoadTest_5m_1
  ---
    duration_ms: 352735
  ...

smlambert avatar Oct 16 '24 14:10 smlambert

aarch64_mac ✔️

BUILD FAILURE, no tests run

Pipeline] error
[Pipeline] }
[2024-10-16T00:14:56.845Z] ERROR: sign installer not successful, setting stage result to: FAILURE
[Pipeline] // catchError
[Pipeline] }

Rebuild at https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/71/

Release Summary Report for release-openjdk17-pipeline

Report generated at: Wed, 16 Oct 2024 19:43:42 GMT

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/71/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk17u" build number 5811 at 10/16/2024, 11:20:17 AM

jdk17u-release-mac-aarch64-temurin ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_aarch64_mac ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_aarch64_mac_rerun ✅ SUCCESS ✅ Rerun all

java -version 
openjdk version "17.0.13" 2024-10-15
OpenJDK Runtime Environment Temurin-17.0.13+11 (build 17.0.13+11)
OpenJDK 64-Bit Server VM Temurin-17.0.13+11 (build 17.0.13+11, mixed mode, sharing)

Test_openjdk17_hs_extended.openjdk_aarch64_mac_testList_1 ⚠️ UNSTABLE ⚠️ jdk_nio_1 => deep history 9/14 passed | possible issues

extended.openjdk 2 testcases failures that pass on rerun

not ok 16 - jdk_nio_1
  ---
    output:
      |
        Failed test cases: 
        TEST: java/nio/channels/DatagramChannel/BasicMulticastTests.java
        TEST: java/nio/channels/DatagramChannel/AdaptorMulticasting.java
        Test results: passed: 438; failed: 2
    duration_ms: 449078
  ...

# Timestamp: Wed Oct 16 18:33:38 2024 UTC 
# CUSTOM_TARGET: java/nio/channels/DatagramChannel/BasicMulticastTests.java java/nio/channels/DatagramChannel/AdaptorMulticasting.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 2
    duration_ms: 16860
  ...

smlambert avatar Oct 16 '24 14:10 smlambert

s390x_linux ✔️

extended.openjdk jdk_net, jdk_nio, jdk_beans have testcase failures, 7 jdk_beans testcases still fail in automated rerun, Deep History shows those have passed previously on test-marist-ubuntu2404-s390x-1, attempt manual rerun in Grinder/11181 on that node - passes

# Timestamp: Wed Oct 16 10:39:08 2024 UTC 
# CUSTOM_TARGET: java/net/DatagramSocket/DatagramSocketExample.java java/net/DatagramSocket/DatagramSocketMulticasting.java java/net/MulticastSocket/SetLoopbackModeIPv4.java java/nio/channels/DatagramChannel/AdaptorMulticasting.java java/nio/channels/DatagramChannel/Loopback.java java/beans/PropertyChangeSupport/Test4682386.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java java/beans/XMLEncoder/javax_swing_JTree.java java/beans/XMLEncoder/Test4631471.java java/beans/XMLEncoder/Test4903007.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 5; failed: 7; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/PropertyChangeSupport/Test4682386.java
        TEST: java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java
        TEST: java/beans/XMLEncoder/Test4631471.java
        TEST: java/beans/XMLEncoder/javax_swing_JTree.java
        TEST: java/beans/XMLEncoder/Test4903007.java
        Test results: passed: 5; failed: 7
    duration_ms: 157087
  ...

rerun passes


# CUSTOM_TARGET: java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/PropertyChangeSupport/Test4682386.java java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java java/beans/XMLEncoder/Test4631471.java java/beans/XMLEncoder/javax_swing_JTree.java java/beans/XMLEncoder/Test4903007.java
--
  | # TEST TARGETS RESULTS SUMMARY: TOTAL: 1 EXECUTED: 1 PASSED: 1 FAILED: 0 DISABLED: 0 SKIPPED: 0
  | # TESTCASES RESULTS SUMMARY: passed: 7; failed: 0; error: 0; skipped: 0
  | 1 | - jdk_custom_0 |  
outputTest results: passed: 7 duration_ms60872 |   | output | Test results: passed: 7 |   | duration_ms | 60872
  | output | Test results: passed: 7
  | duration_ms | 60872

smlambert avatar Oct 16 '24 18:10 smlambert

ppc64_aix

extended.openjdk 2 unique testcases (ThreadStartTest and StreamingBody) failing in original and rerun. jdk_jmx/ThreadStartTest has no recent history of passing on this platform, StreamingBody appears to intermittently pass on test-osuosl-aix72-ppc64-6, so try running in Grinder/11183 - still fails Re-run using 16G heap and still fails due to "thread shortage". I think this is hitting a machine limit on native threads, so not a blocker (AL)

16:32:51  Caused by: java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached

# Timestamp: Wed Oct 16 12:35:38 2024 UTC 
# CUSTOM_TARGET: javax/management/mxbean/ThreadStartTest.java java/net/httpclient/StreamingBody.java java/net/httpclient/StreamingBody.java javax/management/mxbean/ThreadStartTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 2; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/net/httpclient/StreamingBody.java
        TEST: javax/management/mxbean/ThreadStartTest.java
        Test results: failed: 2
    duration_ms: 79139
  ...

jdk_jmx fails with OOM
[2024-10-16T11:13:34.854Z] STDOUT:
[2024-10-16T11:13:34.854Z] [0.312s][warning][os,thread] Failed to start thread "Unknown thread" - pthread_create failed (11=EAGAIN) for attributes: stacksize: 2112k, guardsize: 0k, detached.
[2024-10-16T11:13:34.854Z] [0.312s][warning][os,thread] Failed to start the native thread for java.lang.Thread "Thread-911"
[2024-10-16T11:13:34.854Z] STDERR:
[2024-10-16T11:13:34.854Z] java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached
[2024-10-16T11:13:34.854Z] 	at java.base/java.lang.Thread.start0(Native Method)
[2024-10-16T11:13:34.854Z] 	at java.base/java.lang.Thread.start(Thread.java:809)
[2024-10-16T11:13:34.854Z] 	at ThreadStartTest.main(ThreadStartTest.java:53)
[2024-10-16T11:13:34.854Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2024-10-16T11:13:34.854Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
[2024-10-16T11:13:34.854Z] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2024-10-16T11:13:34.854Z] 	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
[2024-10-16T11:13:34.854Z] 	at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
[2024-10-16T11:13:34.854Z] 	at java.base/java.lang.Thread.run(Thread.java:840)
[2024-10-16T11:13:34.854Z]

Sophia - seems as July release https://github.com/adoptium/aqa-tests/issues/5443#issuecomment-2233272094

extended.perf 1 target fails in original and rerun, renaissance-philosophers with There is insufficient memory for the Java Runtime Environment to continue Deep history shows it failing on test-osuosl-aix72-ppc64-5 and passing on test-osuosl-aix72-ppc64-1, test-osuosl-aix72-ppc64-1 and test-osuosl-aix72-ppc64-6. Rerun on a different machine in Grinder/11182 - Pass

smlambert avatar Oct 16 '24 18:10 smlambert

arm_linux

sanity.openjdk 41 testcases fail in original, pass in automatic rerun

# CUSTOM_TARGET: com/sun/crypto/provider/NSASuiteB/TestHmacSHAOids.java com/sun/crypto/provider/Mac/HmacSaltLengths.java com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java com/sun/crypto/provider/TLS/TestPremaster.java com/sun/crypto/provider/Mac/HmacSHA512.java com/sun/crypto/provider/KeyProtector/IterationCount.java javax/crypto/Cipher/ByteBuffers.java com/sun/crypto/provider/TLS/TestKeyMaterial.java javax/crypto/Cipher/CipherInputStreamExceptions.java com/sun/crypto/provider/KeyAgreement/SupportedDHParamGensLongKey.java com/sun/crypto/provider/TLS/TestPRF12.java com/sun/crypto/provider/NSASuiteB/TestAESOids.java com/sun/crypto/provider/Cipher/RSA/TestOAEPPadding.java javax/crypto/Cipher/ExampleVectors/CheckExampleVectors.java com/sun/org/apache/xml/internal/security/ShortECDSA.java javax/crypto/Cipher/CipherStreamClose.java com/sun/crypto/provider/Cipher/RSA/TestOAEP.java com/sun/crypto/provider/Mac/MacKAT.java com/sun/crypto/provider/Cipher/PBE/PBMacDoFinalVsUpdate.java com/sun/crypto/provider/NSASuiteB/TestAESWrapOids.java com/sun/crypto/provider/TLS/TestPRF.java com/sun/org/apache/xml/internal/security/SignatureKeyInfo.java com/sun/crypto/provider/TLS/TestMasterSecret.java javax/crypto/CryptoPermission/RSANoLimit.java com/sun/crypto/provider/Cipher/PBE/PBMacBuffer.java javax/crypto/spec/IvParameterSpec/NullIV.java javax/crypto/spec/DESKeySpec/NullKey.java javax/crypto/spec/GCMParameterSpec/GCMParameterSpecTest.java com/sun/crypto/provider/KeyAgreement/SupportedDHKeys.java com/sun/crypto/provider/Cipher/PBE/TestCipherKeyWrapperPBEKey.java com/sun/crypto/provider/Cipher/PBE/PBESealedObject.java javax/crypto/CryptoPermission/RC4AliasPermCheck.java javax/crypto/JceSecurity/VerificationResults.java javax/crypto/JceSecurity/FinalRestricted.java javax/crypto/EncryptedPrivateKeyInfo/GetKeySpecException2.java javax/crypto/EncryptedPrivateKeyInfo/GetKeySpecInvalidEncoding.java com/sun/crypto/provider/KeyAgreement/SameDHKeyStressTest.java javax/crypto/CryptoPermissions/CryptoPolicyFallback.java javax/crypto/EncryptedPrivateKeyInfo/GetEncoded.java javax/crypto/CryptoPermissions/TestUnlimited.java javax/crypto/EncryptedPrivateKeyInfo/GetKeySpecException.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 41; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 41
    duration_ms: 173832
  ...

extended.openjdk 4 targets are rerun, all but 1 passes in rerun, jdk_security3 fails with 1 testcase DebugOptions, rerun manually in Grinder/11184 - also fails in grinder

# Timestamp: Wed Oct 16 12:02:37 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 4   EXECUTED: 4   PASSED: 3   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2,110; failed: 1; error: 0; skipped: 0 
1..4
ok 1 - jdk_net_2
  ---
    output:
      |
        Test results: passed: 807
    duration_ms: 3165084
  ...
not ok 2 - jdk_security3_2
  ---
    output:
      |
        Failed test cases: 
        TEST: sun/security/util/Debug/DebugOptions.java
        Test results: passed: 858; failed: 1
    duration_ms: 2934811
  ...
ok 3 - jdk_time_2
  ---
    output:
      |
        Test results: passed: 186
    duration_ms: 193679
  ...
ok 4 - jdk_tools_2
  ---
    output:
      |
        Test results: passed: 259
    duration_ms: 2066408
  ...

DebugOptions
14:43:27  STARTED    DebugOptions::shouldContain '[12] all+thread, properties\[.*\|main.*((.*\R)*)keystore\[.*\|main.*java.*\]:, properties\[\d{4}-\d{2}-\d{2}.*\]:'
14:43:27  java.lang.StackOverflowError
14:43:27  	at java.base/java.util.regex.Pattern$Loop.match(Pattern.java:4898)
14:43:27  	at java.base/java.util.regex.Pattern$GroupTail.match(Pattern.java:4820)
14:43:27  	at java.base/java.util.regex.Pattern$LineEnding.match(Pattern.java:3890)
14:43:27  	at java.base/java.util.regex.Pattern$CharPropertyGreedy.match(Pattern.java:4290)
14:43:27  	at java.base/java.util.regex.Pattern$GroupHead.match(Pattern.java:4789)
...
14:43:27  	at java.base/java.util.regex.Pattern$GroupTail.match(Pattern.java:4820)
14:43:27  FAILED     DebugOptions::shouldContain '[16] properties,all+thread, properties\[.*\|main.*java.*\]((.*\R)*)keystore\[.*\|main.*java.*\]:, properties:'
14:43:27  JavaTest Message: JUnit Platform Failure(s): 4
14:43:27  
14:43:27  [ JUnit Containers: found 5, started 5, succeeded 5, failed 0, aborted 0, skipped 0]
14:43:27  [ JUnit Tests: found 16, started 16, succeeded 12, failed 4, aborted 0, skipped 0]
14:43:27  
14:43:27  java.lang.Exception: JUnit test failure
14:43:27  	at com.sun.javatest.regtest.agent.JUnitRunner.runWithJUnitPlatform(JUnitRunner.java:149)
14:43:27  	at com.sun.javatest.regtest.agent.JUnitRunner.main(JUnitRunner.java:95)
14:43:27  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
14:43:27  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
14:43:27  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
14:43:27  	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
14:43:27  	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
14:43:27  	at java.base/java.lang.Thread.run(Thread.java:840)
14:43:27  
14:43:27  JavaTest Message: Test threw exception: java.lang.Exception
14:43:27  JavaTest Message: shutting down test
14:43:27

extended.perf run appears to have been terminated, relaunch at https://ci.adoptium.net/job/Test_openjdk17_hs_extended.perf_arm_linux/193 - passes Test_openjdk17_hs_extended.perf_arm_linux.tap.txt

21:28:02  make[1]: *** [settings.mk:356: extended.perf-..] Terminated
21:28:02  make: *** [makefile:70: _extended.perf] Terminated
21:28:02  Terminated
21:28:02  make[2]: *** [/ssd/jenkins/workspace/Test_openjdk17_hs_extended.perf_arm_linux/aqa-tests/TKG/../TKG/settings.mk:356: extended.perf-perf] Terminated
21:28:02  make[3]: *** [/ssd/jenkins/workspace/Test_openjdk17_hs_extended.perf_arm_linux/aqa-tests/TKG/../TKG/settings.mk:356: extended.perf-renaissance] Terminated
21:28:02  make[4]: *** [autoGen.mk:194: renaissance-par-mnemonics_0] Terminated

Sophia - sun/security/util/Debug/DebugOptions.java JBS https://bugs.openjdk.org/browse/JDK-8339713 - consider non-blocker.

smlambert avatar Oct 16 '24 18:10 smlambert

riscv64_linux ✔️

sanity.functional cmdLineTester_libpathTestRtfChild_0 - looks like it expects awt lib, likely should not be run against headless builds (mark as non-blocking/needing exclusion)

extended.functional 1 target CryptoTests_jtreg fails, passes on rerun

# Timestamp: Wed Oct 16 12:34:17 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
1..1
ok 1 - CryptoTests_jtreg_0
  ---
    output:
      |
        Test results: passed: 31
    duration_ms: 702346
  ...

sanity.openjdk 1 testcase TestLoggerBundleSync fails, passes on rerun

# Timestamp: Wed Oct 16 18:02:46 2024 UTC 
# CUSTOM_TARGET: java/util/logging/TestLoggerBundleSync.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 95386
  ...

extended.openjdk 2 testcases fail, 1 LinuxWeirdOutputDirTest still fails in rerun - rerun in Grinder/11191 - still fails looks like that test expects awt lib, should not be run against headless builds (consider non-blocking).

# Timestamp: Thu Oct 17 01:29:38 2024 UTC 
# CUSTOM_TARGET: tools/jpackage/linux/LinuxWeirdOutputDirTest.java tools/jpackage/linux/LinuxWeirdOutputDirTest.java javax/net/ssl/DTLS/PacketLossRetransmission.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 1; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: tools/jpackage/linux/LinuxWeirdOutputDirTest.java
        Test results: passed: 1; failed: 1
    duration_ms: 296763
  ...


Exception in thread "main" java.lang.UnsatisfiedLinkError: Can't load library: /home/jenkins/workspace/Grinder/aqa-tests/TKG/output_17291786461946/jdk_custom_0/work/scratch/0/test.965ce0cf/output/bin/LinuxWeirdOutputDirTest/lib/runtime/lib/libawt_xawt.so
	at java.base/java.lang.ClassLoader.loadLibrary(Unknown Source)
	at java.base/java.lang.Runtime.load0(Unknown Source)
	at java.base/java.lang.System.load(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.load(Native Method)
	at java.base/jdk.internal.loader.NativeLibraries$NativeLibraryImpl.open(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.findFromPaths(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(Unknown Source)
	at java.base/java.lang.ClassLoader.loadLibrary(Unknown Source)
	at java.base/java.lang.Runtime.loadLibrary0(Unknown Source)
	at java.base/java.lang.System.loadLibrary(Unknown Source)
	at java.desktop/java.awt.Toolkit$2.run(Unknown Source)
	at java.desktop/java.awt.Toolkit$2.run(Unknown Source)
	at java.base/java.security.AccessController.doPrivileged(Unknown Source)
	at java.desktop/java.awt.Toolkit.loadLibraries(Unknown Source)
	at java.desktop/java.awt.Toolkit.initStatic(Unknown Source)
	at java.desktop/java.awt.Toolkit.<clinit>(Unknown Source)
	at java.desktop/java.awt.Desktop.isDesktopSupported(Unknown Source)
	at Hello.createInstance(Hello.java:170)
	at Hello.<clinit>(Hello.java:161)

extended.perf

  • 1 child passes, 1 child job fails, rerun at: https://ci.adoptium.net/job/Test_openjdk17_hs_extended.perf_riscv64_linux_testList_1/15

smlambert avatar Oct 16 '24 18:10 smlambert

ppc64le_linux ✔️ Smoke tests failed as they were sent to the machine that should have been taken offline

19:38:59  stdout: 
19:38:59  stderr: /usr/local/libexec/git-core/git-remote-https: /usr/lib/powerpc64le-linux-gnu/libcurl.so.4: version `CURL_OPENSSL_3' not found (required by /usr/local/libexec/git-core/git-remote-https)

This means no test jobs were launched.

Rerun smoke tests here: https://ci.adoptium.net/job/build-scripts/job/jobs/job/release/job/jobs/job/jdk17u/job/jdk17u-release-linux-ppc64le-temurin_SmokeTests/24 - passes jdk17u-release-linux-ppc64le-temurin_SmokeTests.tap.txt

Run the 9 top-level test targets here: https://ci.adoptium.net/view/Test_grinder/job/AQA_Test_Pipeline/379/ extended.openjdk 1 jdk_nio testcase java/nio/channels/DatagramChannel/Disconnect.java fails, rerun in Grinder/11188 fails

not ok 21 - jdk_nio_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/nio/channels/DatagramChannel/Disconnect.java
        Test results: passed: 441; failed: 1
    duration_ms: 474946
  ...
not ok 22 - jdk_nio_1
  ---
    output:
      |
        Failed test cases: 
        TEST: java/nio/channels/DatagramChannel/Disconnect.java
        Test results: passed: 441; failed: 1
    duration_ms: 529552
  ...

Compilation fails, InetAddress.ofLiteral cannot find symbol, known issue and won't be fixed upstream until Jan 2025 release, so needed exclusion in release branch (https://bugs.openjdk.org/browse/JDK-8299813). Consider non-blocking.

00:19:15  stderr:
00:19:15  WARNING: A terminally deprecated method in java.lang.System has been called
00:19:15  WARNING: System::setSecurityManager has been called by com.sun.javatest.regtest.agent.RegressionSecurityManager (file:/home/jenkins/workspace/Grinder/jvmtest/openjdk/jtreg/lib/jtreg.jar)
00:19:15  WARNING: Please consider reporting this to the maintainers of com.sun.javatest.regtest.agent.RegressionSecurityManager
00:19:15  WARNING: System::setSecurityManager will be removed in a future release
00:19:15  direct:
00:19:15  /home/jenkins/workspace/Grinder/aqa-tests/openjdk/openjdk-jdk/test/jdk/java/nio/channels/DatagramChannel/Disconnect.java:55: error: cannot find symbol
00:19:15                  InetAddress lo4 = InetAddress.ofLiteral("127.0.0.1");
00:19:15                                               ^
00:19:15    symbol:   method ofLiteral(String)
00:19:15    location: class InetAddress
00:19:15  /home/jenkins/workspace/Grinder/aqa-tests/openjdk/openjdk-jdk/test/jdk/java/nio/channels/DatagramChannel/Disconnect.java:65: error: cannot find symbol
00:19:15                  InetAddress lo6 = InetAddress.ofLiteral("::1");
00:19:15                                               ^
00:19:15    symbol:   method ofLiteral(String)
00:19:15    location: class InetAddress
00:19:15  2 errors

smlambert avatar Oct 16 '24 18:10 smlambert

x86-32_windows ✔️

extended.openjdk - non-blocking, known failures 12 testcases fail in rerun, run in Grinder/11215

# Timestamp: Wed Oct 16 23:55:44 2024 UTC 
# CUSTOM_TARGET: java/beans/PropertyEditor/6380849/TestPropertyEditor.java java/beans/PropertyEditor/TestColorClass.java java/beans/PropertyEditor/TestColorClassJava.java java/beans/PropertyEditor/TestColorClassNull.java java/beans/PropertyEditor/TestColorClassValue.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClass.java java/beans/PropertyEditor/TestFontClassNull.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/java_awt_ScrollPane.java java/nio/channels/unixdomain/IOExchanges.java sun/tools/jhsdb/JShellHeapDumpTest.java javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 12; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClass.java
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClass.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        Test results: passed: 1; failed: 12
    duration_ms: 147783
  ...

These are 'known' failures (most are HeadlessException) that should likely get excluded as we will not be running with a desktop session open under automation.

java.awt.HeadlessException: 
The application does not have desktop access,
but this program performed an operation which requires it.
	at java.desktop/java.awt.GraphicsEnvironment.checkHeadless(GraphicsEnvironment.java:164)
	at java.desktop/java.awt.Window.<init>(Window.java:553)
	at java.desktop/java.awt.Frame.<init>(Frame.java:428)
	at java.desktop/java.awt.Frame.<init>(Frame.java:393)
	at JPEGsNotAcceleratedTest.main(JPEGsNotAcceleratedTest.java:307)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
	at java.base/java.lang.Thread.run(Thread.java:840)

JShellHeapDumpTest has an issue where it needs a particular configuration on the machine or fails with pipe closed

Starting Jshell
[JShell]:c:\jenkins\workspace\Grinder\jdkbinary\j2sdk-image\bin\jshell.exe
[JShell] |  Welcome to JShell -- Version 17.0.13
[JShell] |  For an introduction type: /help intro
Jshell Started in 1470ms
Starting jmap against 10108
[2024-10-18T03:50:25.097693900Z] Gathering output for process 13428
[2024-10-18T03:50:25.368124Z] Waiting for completion for process 13428
[2024-10-18T03:50:25.368124Z] Waiting for completion finished for process 13428
Output and diagnostic info for process 13428 was saved into 'pid-13428-output.log'
jhsdb jmap stdout:
Attaching to process ID 10108, please wait...

jhsdb jmap stderr:
Error attaching to process: Windbg Error: WaitForEvent failed! (hr: 0x80004002)
sun.jvm.hotspot.debugger.DebuggerException: Windbg Error: WaitForEvent failed! (hr: 0x80004002)
	at jdk.hotspot.agent/sun.jvm.hotspot.debugger.windbg.WindbgDebuggerLocal.attach0(Native Method)
	at jdk.hotspot.agent/sun.jvm.hotspot.debugger.windbg.WindbgDebuggerLocal.attach(WindbgDebuggerLocal.java:152)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.attachDebugger(HotSpotAgent.java:651)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.setupDebuggerWin32(HotSpotAgent.java:549)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.setupDebugger(HotSpotAgent.java:366)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.go(HotSpotAgent.java:337)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.attach(HotSpotAgent.java:142)
	at jdk.hotspot.agent/sun.jvm.hotspot.tools.Tool.start(Tool.java:203)
	at jdk.hotspot.agent/sun.jvm.hotspot.tools.Tool.execute(Tool.java:134)
	at jdk.hotspot.agent/sun.jvm.hotspot.tools.JMap.main(JMap.java:202)
	at jdk.hotspot.agent/sun.jvm.hotspot.SALauncher.runJMAP(SALauncher.java:340)
	at jdk.hotspot.agent/sun.jvm.hotspot.SALauncher.main(SALauncher.java:500)


###### End of all output:
[2024-10-18T03:50:25.373122500Z] Waiting for completion for process 13428
[2024-10-18T03:50:25.373122500Z] Waiting for completion finished for process 13428
[2024-10-18T03:50:25.373122500Z] Waiting for completion for process 13428
[2024-10-18T03:50:25.373122500Z] Waiting for completion finished for process 13428
Jshell not alive
    
Standard Error
[JShell] jshell> Exception in thread "main" java.io.IOError: java.io.IOException: The pipe is being closed
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.keymap.BindingReader.readCharacter(BindingReader.java:170)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.keymap.BindingReader.readBinding(BindingReader.java:110)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.keymap.BindingReader.readBinding(BindingReader.java:61)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.reader.impl.LineReaderImpl.doReadBinding(LineReaderImpl.java:924)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.reader.impl.LineReaderImpl.readBinding(LineReaderImpl.java:957)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.ConsoleIOContext$2.readBinding(ConsoleIOContext.java:172)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.reader.impl.LineReaderImpl.readLine(LineReaderImpl.java:652)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.reader.impl.LineReaderImpl.readLine(LineReaderImpl.java:468)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.ConsoleIOContext.readLine(ConsoleIOContext.java:248)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.JShellTool.getInput(JShellTool.java:1275)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.JShellTool.run(JShellTool.java:1209)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.JShellTool.start(JShellTool.java:995)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.JShellToolBuilder.start(JShellToolBuilder.java:261)
[JShell] 	at jdk.jshell/jdk.internal.jshell.tool.JShellToolProvider.main(JShellToolProvider.java:120)
[JShell] Caused by: java.io.IOException: The pipe is being closed
[JShell] 	at java.base/java.io.FileInputStream.read0(Native Method)
[JShell] 	at java.base/java.io.FileInputStream.read(FileInputStream.java:228)
[JShell] 	at jdk.internal.le/jdk.internal.org.jline.utils.NonBlockingInputStreamImpl.run(NonBlockingInputStreamImpl.java:209)
[JShell] 	at java.base/java.lang.Thread.run(Thread.java:840)
 stdout: [Attaching to process ID 10108, please wait...
];
 stderr: [Error attaching to process: Windbg Error: WaitForEvent failed! (hr: 0x80004002)
sun.jvm.hotspot.debugger.DebuggerException: Windbg Error: WaitForEvent failed! (hr: 0x80004002)
	at jdk.hotspot.agent/sun.jvm.hotspot.debugger.windbg.WindbgDebuggerLocal.attach0(Native Method)
	at jdk.hotspot.agent/sun.jvm.hotspot.debugger.windbg.WindbgDebuggerLocal.attach(WindbgDebuggerLocal.java:152)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.attachDebugger(HotSpotAgent.java:651)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.setupDebuggerWin32(HotSpotAgent.java:549)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.setupDebugger(HotSpotAgent.java:366)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.go(HotSpotAgent.java:337)
	at jdk.hotspot.agent/sun.jvm.hotspot.HotSpotAgent.attach(HotSpotAgent.java:142)
	at jdk.hotspot.agent/sun.jvm.hotspot.tools.Tool.start(Tool.java:203)
	at jdk.hotspot.agent/sun.jvm.hotspot.tools.Tool.execute(Tool.java:134)
	at jdk.hotspot.agent/sun.jvm.hotspot.tools.JMap.main(JMap.java:202)
	at jdk.hotspot.agent/sun.jvm.hotspot.SALauncher.runJMAP(SALauncher.java:340)
	at jdk.hotspot.agent/sun.jvm.hotspot.SALauncher.main(SALauncher.java:500)

]
 exitValue = 1

java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: Expected to get exit value of [0]

	at JShellHeapDumpTest.launch(JShellHeapDumpTest.java:82)
	at JShellHeapDumpTest.launch(JShellHeapDumpTest.java:97)
	at JShellHeapDumpTest.testHeapDump(JShellHeapDumpTest.java:133)
	at JShellHeapDumpTest.main(JShellHeapDumpTest.java:184)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Expected to get exit value of [0]

	at jdk.test.lib.process.OutputAnalyzer.shouldHaveExitValue(OutputAnalyzer.java:489)
	at JShellHeapDumpTest.launch(JShellHeapDumpTest.java:80)
	... 9 more

JavaTest Message: Test threw exception: java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: Expected to get exit value of [0]

JavaTest Message: shutting down test

STATUS:Failed.`main' threw exception: java.lang.RuntimeException: Test ERROR java.lang.RuntimeException: Expected to get exit value of [0]

smlambert avatar Oct 18 '24 03:10 smlambert

https://github.com/adoptium/aqa-tests/issues/5689#issuecomment-2417588899

@jiekang could you please add https://bugs.openjdk.org/browse/JDK-8339713 Affects Version/s with 17? Thanks.

sophia-guo avatar Oct 29 '24 16:10 sophia-guo

@sophia-guo Done. I would like to add a comment along the lines of:

We saw this failing for JDK 17 arm32 as well here: <link-to-GitHub-issue>.

But to a bug-specific issue rather than this release one. Can a separate issue be made to track this failure?

jiekang avatar Oct 29 '24 16:10 jiekang

@jiekang as there is a JBS I'd like not to add a duplicate one here as this will require extra work to track it especially no extra helpful information is provided.

sophia-guo avatar Oct 29 '24 20:10 sophia-guo