openj9 icon indicating copy to clipboard operation
openj9 copied to clipboard

JDK11 AIOOBE at java.base/java.lang.CharacterDataLatin1.getProperties(CharacterDataLatin1.java:74)

Open JasonFengJ9 opened this issue 3 years ago • 39 comments

Failure link

From an internal build job/Test_openjdk11_j9_extended.openjdk_x86-64_linux/71/(ub18x64rt1-3):

openjdk version "11.0.16" 2022-07-19
IBM Semeru Runtime Open Edition 11.0.16.0-m1 (build 11.0.16+4)
Eclipse OpenJ9 VM 11.0.16.0-m1 (build v0.33.0-release-02a21c792, JRE 11 Linux amd64-64-Bit Compressed References 20220531_445 (JIT enabled, AOT enabled)
OpenJ9   - 02a21c792
OMR      - 942daf672
JCL      - edbcb7dbc3 based on jdk-11.0.16+4)

Rerun in Grinder - Change TARGET to run only the failed test targets.

Optional info

Failure output (captured from console output)

[2022-05-31T20:05:34.504Z] variation: Mode650
[2022-05-31T20:05:34.504Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2022-05-31T20:55:14.459Z] ===============================================
[2022-05-31T20:55:14.459Z] sun/security/tools/jarsigner/PreserveRawManifestEntryAndDigest.java
[2022-05-31T20:55:14.459Z] Total tests run: 284, Failures: 1, Skips: 0
[2022-05-31T20:55:14.459Z] ===============================================
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z] STDERR:
[2022-05-31T20:55:14.459Z]  stdout: [Command line args: [-verify, -strict, -keystore, test.jks, -storepass, changeit, -debug, -verbose, test-emptyJarTrailingSeqAddFile10131013-step4.jar, a]
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z] s k      151 Tue May 31 16:53:00 EDT 2022 META-INF/MANIFEST.MF
[2022-05-31T20:55:14.459Z]          314 Tue May 31 16:53:00 EDT 2022 META-INF/B.SF
[2022-05-31T20:55:14.459Z]         1229 Tue May 31 16:53:00 EDT 2022 META-INF/B.DSA
[2022-05-31T20:55:14.459Z]          226 Tue May 31 16:52:58 EDT 2022 META-INF/A.SF
[2022-05-31T20:55:14.459Z]         1230 Tue May 31 16:52:58 EDT 2022 META-INF/A.DSA
[2022-05-31T20:55:14.459Z] smkX      16 Tue May 31 16:53:00 EDT 2022 updated-contents
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z]   s = signature was verified 
[2022-05-31T20:55:14.459Z]   m = entry is listed in manifest
[2022-05-31T20:55:14.459Z]   k = at least one certificate was found in keystore
[2022-05-31T20:55:14.459Z]   X = not signed by specified alias(es)
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z] - Signed by "CN=A"
[2022-05-31T20:55:14.459Z]     Digest algorithm: SHA-256
[2022-05-31T20:55:14.459Z]     Signature algorithm: SHA256withDSA, 2048-bit key
[2022-05-31T20:55:14.459Z] - Signed by "CN=B"
[2022-05-31T20:55:14.459Z]     Digest algorithm: SHA-256
[2022-05-31T20:55:14.459Z]     Signature algorithm: SHA256withDSA, 2048-bit key
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z] jar verified, with signer errors.
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z] Error: 
[2022-05-31T20:55:14.459Z] This jar contains entries whose certificate chain is invalid. Reason: null
[2022-05-31T20:55:14.459Z] This jar contains signed entries which are not signed by the specified alias(es).
[2022-05-31T20:55:14.459Z] 
[2022-05-31T20:55:14.459Z] Re-run with the -verbose and -certs options for more details.
[2022-05-31T20:55:14.459Z] ];
[2022-05-31T20:55:14.459Z]  stderr: [java.lang.ArrayIndexOutOfBoundsException
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.CharacterDataLatin1.getProperties(CharacterDataLatin1.java:74)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.CharacterDataLatin1.toUpperCaseEx(CharacterDataLatin1.java:260)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.Character.toUpperCaseEx(Character.java:10572)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.StringUTF16.toUpperCase(StringUTF16.java:780)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.String.toUpperCase(String.java:2835)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.AVA.toRFC2253CanonicalString(AVA.java:998)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.RDN.toRFC2253StringInternal(RDN.java:437)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.RDN.toRFC2253String(RDN.java:417)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.X500Name.getRFC2253CanonicalName(X500Name.java:724)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.X500Name.hashCode(X500Name.java:383)
[2022-05-31T20:55:14.459Z] 	at java.base/javax.security.auth.x500.X500Principal.hashCode(X500Principal.java:487)
[2022-05-31T20:55:14.459Z] 	at java.base/java.util.HashMap.hash(HashMap.java:340)
[2022-05-31T20:55:14.459Z] 	at java.base/java.util.HashMap.containsKey(HashMap.java:592)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.validator.PKIXValidator.setTrustedSubjects(PKIXValidator.java:148)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.validator.PKIXValidator.<init>(PKIXValidator.java:132)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.validator.Validator.getInstance(Validator.java:199)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.validateCertChain(Main.java:2275)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.certsAndTSInfo(Main.java:1939)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.signerInfo(Main.java:1900)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.verifyJar(Main.java:818)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.run(Main.java:278)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.main(Main.java:128)
[2022-05-31T20:55:14.459Z] java.lang.ArrayIndexOutOfBoundsException
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.CharacterDataLatin1.getProperties(CharacterDataLatin1.java:74)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.CharacterDataLatin1.toUpperCaseEx(CharacterDataLatin1.java:260)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.Character.toUpperCaseEx(Character.java:10572)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.StringUTF16.toUpperCase(StringUTF16.java:780)
[2022-05-31T20:55:14.459Z] 	at java.base/java.lang.String.toUpperCase(String.java:2835)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.AVA.toRFC2253CanonicalString(AVA.java:998)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.RDN.toRFC2253StringInternal(RDN.java:437)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.RDN.toRFC2253String(RDN.java:417)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.X500Name.getRFC2253CanonicalName(X500Name.java:724)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.x509.X500Name.hashCode(X500Name.java:383)
[2022-05-31T20:55:14.459Z] 	at java.base/javax.security.auth.x500.X500Principal.hashCode(X500Principal.java:487)
[2022-05-31T20:55:14.459Z] 	at java.base/java.util.HashMap.hash(HashMap.java:340)
[2022-05-31T20:55:14.459Z] 	at java.base/java.util.HashMap.containsKey(HashMap.java:592)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.validator.PKIXValidator.setTrustedSubjects(PKIXValidator.java:148)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.validator.PKIXValidator.<init>(PKIXValidator.java:132)
[2022-05-31T20:55:14.459Z] 	at java.base/sun.security.validator.Validator.getInstance(Validator.java:199)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.validateCertChain(Main.java:2275)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.certsAndTSInfo(Main.java:1939)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.signerInfo(Main.java:1900)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.verifyJar(Main.java:818)
[2022-05-31T20:55:14.459Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.run(Main.java:278)
[2022-05-31T20:55:14.460Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.main(Main.java:128)
[2022-05-31T20:55:14.460Z] ]
[2022-05-31T20:55:14.460Z]  exitValue = 36
[2022-05-31T20:55:14.460Z] 
[2022-05-31T20:55:14.460Z] java.lang.Exception: failures: 1
[2022-05-31T20:55:14.460Z] 	at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:96)
[2022-05-31T20:55:14.460Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2022-05-31T20:55:14.460Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[2022-05-31T20:55:14.460Z] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2022-05-31T20:55:14.460Z] 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[2022-05-31T20:55:14.460Z] 	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
[2022-05-31T20:55:14.460Z] 	at java.base/java.lang.Thread.run(Thread.java:840)
[2022-05-31T20:55:14.460Z] 
[2022-05-31T20:55:14.460Z] JavaTest Message: Test threw exception: java.lang.Exception
[2022-05-31T20:55:14.460Z] JavaTest Message: shutting down test
[2022-05-31T20:55:14.460Z] 
[2022-05-31T20:55:14.460Z] 
[2022-05-31T20:55:14.460Z] TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.Exception: failures: 1
[2022-05-31T20:55:14.460Z] --------------------------------------------------
[2022-05-31T21:06:45.718Z] Test results: passed: 766; failed: 1
[2022-05-31T21:06:55.438Z] Report written to /home/jenkins/workspace/Test_openjdk11_j9_extended.openjdk_x86-64_linux/jvmtest/openjdk/report/html/report.html
[2022-05-31T21:06:55.438Z] Results written to /home/jenkins/workspace/Test_openjdk11_j9_extended.openjdk_x86-64_linux/aqa-tests/TKG/output_1654016709315/jdk_security3_1/work
[2022-05-31T21:06:55.438Z] Error: Some tests failed or other problems occurred.
[2022-05-31T21:06:55.438Z] 
[2022-05-31T21:06:55.438Z] jdk_security3_1_FAILED

50x grinder - job/Grinder/24383 - no failure reproduced, 40 passed (in 4 different machines), 10 weren't run due to infra error in one machine.

JasonFengJ9 avatar Jun 01 '22 14:06 JasonFengJ9

job/Test_openjdk11_j9_extended.openjdk_x86-64_linux/76/(ub18x64rt1-1)

java version "11.0.16" 2022-07-19
IBM Semeru Runtime Certified Edition 11.0.16+7 (build 11.0.16+7)
Eclipse OpenJ9 VM 11.0.16+7 (build master-6b4a2db09, JRE 11 Linux amd64-64-Bit Compressed References 20220709_378 (JIT enabled, AOT enabled)
OpenJ9   - 6b4a2db09
OMR      - ff6a49823
JCL      - 672a83a46c based on jdk-11.0.16+7)
[2022-07-09T01:49:43.310Z] variation: Mode150
[2022-07-09T01:49:43.310Z] JVM_OPTIONS:  -XX:+UseCompressedOops 

[2022-07-09T02:21:07.689Z] TEST: sun/nio/cs/TestIBMBugs.java

[2022-07-09T02:21:07.690Z] STDERR:
[2022-07-09T02:21:07.690Z] java.lang.ArrayIndexOutOfBoundsException
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.CharacterDataLatin1.getProperties(CharacterDataLatin1.java:74)
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.CharacterDataLatin1.getType(CharacterDataLatin1.java:122)
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.Character.getType(Character.java:10351)
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.Character.isDefined(Character.java:9122)
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.Character.isDefined(Character.java:9098)
[2022-07-09T02:21:07.690Z] 	at TestIBMBugs.bug6577466(TestIBMBugs.java:173)
[2022-07-09T02:21:07.690Z] 	at TestIBMBugs.main(TestIBMBugs.java:386)
[2022-07-09T02:21:07.690Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2022-07-09T02:21:07.690Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[2022-07-09T02:21:07.690Z] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[2022-07-09T02:21:07.690Z] 	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
[2022-07-09T02:21:07.690Z] 	at java.base/java.lang.Thread.run(Thread.java:844)
[2022-07-09T02:21:07.690Z] 
[2022-07-09T02:21:07.690Z] JavaTest Message: Test threw exception: java.lang.ArrayIndexOutOfBoundsException
[2022-07-09T02:21:07.690Z] JavaTest Message: shutting down test
[2022-07-09T02:21:07.690Z] 
[2022-07-09T02:21:07.690Z] 
[2022-07-09T02:21:07.690Z] TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.ArrayIndexOutOfBoundsException
[2022-07-09T02:21:07.690Z] --------------------------------------------------
[2022-07-09T02:22:07.944Z] Test results: passed: 390; failed: 1
[2022-07-09T02:22:37.600Z] Report written to /home/jenkins/workspace/Test_openjdk11_j9_extended.openjdk_x86-64_linux/jvmtest/openjdk/report/html/report.html
[2022-07-09T02:22:37.600Z] Results written to /home/jenkins/workspace/Test_openjdk11_j9_extended.openjdk_x86-64_linux/aqa-tests/TKG/output_1657329966853/jdk_nio_0/work
[2022-07-09T02:22:37.600Z] Error: Some tests failed or other problems occurred.
[2022-07-09T02:22:37.600Z] 
[2022-07-09T02:22:37.600Z] jdk_nio_0_FAILED

50x grinder - job/Grinder/25606/ - passed

JasonFengJ9 avatar Jul 11 '22 19:07 JasonFengJ9

An internal build ub18x64rt1-3

[2022-07-20T06:17:58.318Z] variation: Mode650
[2022-07-20T06:17:58.774Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

java version "11.0.16" 2022-07-19
IBM Semeru Runtime Certified Edition 11.0.16.0-rc1 (build 11.0.16+8)
Eclipse OpenJ9 VM 11.0.16.0-rc1 (build openj9-0.33.0-rc1, JRE 11 Linux amd64-64-Bit Compressed References 20220720_388 (JIT enabled, AOT enabled)
OpenJ9   - 8cb527940
OMR      - b58aa2708
JCL      - 8b2d4875e9 based on jdk-11.0.16+8)

[2022-07-20T07:06:28.063Z] ===============================================
[2022-07-20T07:06:28.063Z] sun/security/tools/jarsigner/PreserveRawManifestEntryAndDigest.java
[2022-07-20T07:06:28.063Z] Total tests run: 284, Failures: 1, Skips: 0
[2022-07-20T07:06:28.063Z] ===============================================
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z] STDERR:
[2022-07-20T07:06:28.063Z]  stdout: [Command line args: [-verify, -strict, -keystore, test.jks, -storepass, changeit, -debug, -verbose, test-firstIndividualSectionTrailingSeqAddFile1313-step4.jar, a]
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z] s k      274 Wed Jul 20 03:04:44 EDT 2022 META-INF/MANIFEST.MF
[2022-07-20T07:06:28.063Z]          402 Wed Jul 20 03:04:44 EDT 2022 META-INF/B.SF
[2022-07-20T07:06:28.063Z]         1229 Wed Jul 20 03:04:44 EDT 2022 META-INF/B.DSA
[2022-07-20T07:06:28.063Z]          314 Wed Jul 20 03:04:44 EDT 2022 META-INF/A.SF
[2022-07-20T07:06:28.063Z]         1229 Wed Jul 20 03:04:44 EDT 2022 META-INF/A.DSA
[2022-07-20T07:06:28.063Z] smk       16 Wed Jul 20 03:04:42 EDT 2022 initial-contents
[2022-07-20T07:06:28.063Z] smkX      16 Wed Jul 20 03:04:44 EDT 2022 updated-contents
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z]   s = signature was verified 
[2022-07-20T07:06:28.063Z]   m = entry is listed in manifest
[2022-07-20T07:06:28.063Z]   k = at least one certificate was found in keystore
[2022-07-20T07:06:28.063Z]   X = not signed by specified alias(es)
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z] - Signed by "CN=A"
[2022-07-20T07:06:28.063Z]     Digest algorithm: SHA-256
[2022-07-20T07:06:28.063Z]     Signature algorithm: SHA256withDSA, 2048-bit key
[2022-07-20T07:06:28.063Z] - Signed by "CN=B"
[2022-07-20T07:06:28.063Z]     Digest algorithm: SHA-256
[2022-07-20T07:06:28.063Z]     Signature algorithm: SHA256withDSA, 2048-bit key
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z] jar verified, with signer errors.
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z] Error: 
[2022-07-20T07:06:28.063Z] This jar contains entries whose certificate chain is invalid. Reason: null
[2022-07-20T07:06:28.063Z] This jar contains signed entries which are not signed by the specified alias(es).
[2022-07-20T07:06:28.063Z] 
[2022-07-20T07:06:28.063Z] Re-run with the -verbose and -certs options for more details.
[2022-07-20T07:06:28.063Z] ];
[2022-07-20T07:06:28.063Z]  stderr: [java.lang.ArrayIndexOutOfBoundsException
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.CharacterDataLatin1.getProperties(CharacterDataLatin1.java:74)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.CharacterDataLatin1.toUpperCaseEx(CharacterDataLatin1.java:260)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.Character.toUpperCaseEx(Character.java:10572)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.StringUTF16.toUpperCase(StringUTF16.java:780)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.String.toUpperCase(String.java:2838)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.AVA.toRFC2253CanonicalString(AVA.java:998)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.RDN.toRFC2253StringInternal(RDN.java:437)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.RDN.toRFC2253String(RDN.java:417)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.X500Name.getRFC2253CanonicalName(X500Name.java:724)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.X500Name.hashCode(X500Name.java:383)
[2022-07-20T07:06:28.063Z] 	at java.base/javax.security.auth.x500.X500Principal.hashCode(X500Principal.java:487)
[2022-07-20T07:06:28.063Z] 	at java.base/java.util.HashMap.hash(HashMap.java:340)
[2022-07-20T07:06:28.063Z] 	at java.base/java.util.HashMap.containsKey(HashMap.java:592)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.validator.PKIXValidator.setTrustedSubjects(PKIXValidator.java:148)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.validator.PKIXValidator.<init>(PKIXValidator.java:132)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.validator.Validator.getInstance(Validator.java:199)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.validateCertChain(Main.java:2275)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.certsAndTSInfo(Main.java:1939)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.signerInfo(Main.java:1900)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.verifyJar(Main.java:818)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.run(Main.java:278)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.main(Main.java:128)
[2022-07-20T07:06:28.063Z] java.lang.ArrayIndexOutOfBoundsException
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.CharacterDataLatin1.getProperties(CharacterDataLatin1.java:74)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.CharacterDataLatin1.toUpperCaseEx(CharacterDataLatin1.java:260)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.Character.toUpperCaseEx(Character.java:10572)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.StringUTF16.toUpperCase(StringUTF16.java:780)
[2022-07-20T07:06:28.063Z] 	at java.base/java.lang.String.toUpperCase(String.java:2838)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.AVA.toRFC2253CanonicalString(AVA.java:998)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.RDN.toRFC2253StringInternal(RDN.java:437)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.RDN.toRFC2253String(RDN.java:417)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.X500Name.getRFC2253CanonicalName(X500Name.java:724)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.x509.X500Name.hashCode(X500Name.java:383)
[2022-07-20T07:06:28.063Z] 	at java.base/javax.security.auth.x500.X500Principal.hashCode(X500Principal.java:487)
[2022-07-20T07:06:28.063Z] 	at java.base/java.util.HashMap.hash(HashMap.java:340)
[2022-07-20T07:06:28.063Z] 	at java.base/java.util.HashMap.containsKey(HashMap.java:592)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.validator.PKIXValidator.setTrustedSubjects(PKIXValidator.java:148)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.validator.PKIXValidator.<init>(PKIXValidator.java:132)
[2022-07-20T07:06:28.063Z] 	at java.base/sun.security.validator.Validator.getInstance(Validator.java:199)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.validateCertChain(Main.java:2275)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.certsAndTSInfo(Main.java:1939)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.signerInfo(Main.java:1900)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.verifyJar(Main.java:818)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.run(Main.java:278)
[2022-07-20T07:06:28.063Z] 	at jdk.jartool/sun.security.tools.jarsigner.Main.main(Main.java:128)
[2022-07-20T07:06:28.063Z] ]
[2022-07-20T07:06:28.064Z]  exitValue = 36
[2022-07-20T07:06:28.064Z] 
[2022-07-20T07:06:28.064Z] java.lang.Exception: failures: 1
[2022-07-20T07:06:28.064Z] 	at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:96)
[2022-07-20T07:06:28.064Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2022-07-20T07:06:28.064Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[2022-07-20T07:06:28.064Z] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2022-07-20T07:06:28.064Z] 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[2022-07-20T07:06:28.064Z] 	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
[2022-07-20T07:06:28.064Z] 	at java.base/java.lang.Thread.run(Thread.java:840)
[2022-07-20T07:06:28.064Z] 
[2022-07-20T07:06:28.064Z] JavaTest Message: Test threw exception: java.lang.Exception
[2022-07-20T07:06:28.064Z] JavaTest Message: shutting down test
[2022-07-20T07:06:28.064Z] 
[2022-07-20T07:06:28.064Z] 
[2022-07-20T07:06:28.064Z] TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.Exception: failures: 1
[2022-07-20T07:06:28.064Z] --------------------------------------------------
[2022-07-20T07:18:40.897Z] Test results: passed: 766; failed: 1
[2022-07-20T07:19:11.944Z] Report written to /home/jenkins/workspace/Test_openjdk11_j9_extended.openjdk_x86-64_linux/jvmtest/openjdk/report/html/report.html
[2022-07-20T07:19:11.944Z] Results written to /home/jenkins/workspace/Test_openjdk11_j9_extended.openjdk_x86-64_linux/aqa-tests/TKG/output_16582874178859/jdk_security3_1/work
[2022-07-20T07:19:11.944Z] Error: Some tests failed or other problems occurred.
[2022-07-20T07:19:11.944Z] 
[2022-07-20T07:19:11.944Z] jdk_security3_1_FAILED

50x internal grinder on jdk_security3_1

JasonFengJ9 avatar Jul 20 '22 22:07 JasonFengJ9

50x internal grinder - 4/50 failed w/ same AIOOBE (3 on ub20x64rt4-4, 1 on ub20x64rt1-3).

There is a different failure javax/net/ssl/sanity/interop/ClientJSSEServerJSSE.java (ub20x64rt4-1)

21:39:10  ** Failed TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384 in TLSv1.2 mode with RSA client authentication**
21:39:10  STDERR:
21:39:10  javax.net.ssl.SSLException: Could not derive key
21:39:10  	at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:133)
21:39:10  	at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:353)
21:39:10  	at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:296)
21:39:10  	at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:291)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.handleException(SSLSocketImpl.java:1689)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:471)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.ensureNegotiated(SSLSocketImpl.java:921)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl$AppOutputStream.write(SSLSocketImpl.java:1291)
21:39:10  	at java.base/java.io.OutputStream.write(OutputStream.java:122)
21:39:10  	at CipherTest$Client.sendRequest(CipherTest.java:262)javax.net.ssl.SSLException: Received fatal alert: internal_error
21:39:10  
21:39:10  	at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:133)
21:39:10  	at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:117)
21:39:10  	at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:340)
21:39:10  	at java.base/sun.security.ssl.Alert$AlertConsumer.consume(Alert.java:293)
21:39:10  	at java.base/sun.security.ssl.TransportContext.dispatch(TransportContext.java:186)
21:39:10  	at java.base/sun.security.ssl.SSLTransport.decode(SSLTransport.java:172)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1506)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(SSLSocketImpl.java:1416)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:456)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.ensureNegotiated(SSLSocketImpl.java:921)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1012)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:972)
21:39:10  	at CipherTest$Server.handleRequest(CipherTest.java:76)
21:39:10  	at JSSEServer$1.run(JSSEServer.java:71)
21:39:10  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
21:39:10  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
21:39:10  	at java.base/java.lang.Thread.run(Thread.java:840)
21:39:10  	at JSSEClient.runTest(JSSEClient.java:61)
21:39:10  	at CipherTest$Client.run(CipherTest.java:249)
21:39:10  	at java.base/java.lang.Thread.run(Thread.java:840)
21:39:10  Caused by: java.security.ProviderException: Could not derive key
21:39:10  	at jdk.crypto.ec/sun.security.ec.NativeECDHKeyAgreement.engineGenerateSecret(NativeECDHKeyAgreement.java:248)
21:39:10  	at jdk.crypto.ec/sun.security.ec.NativeECDHKeyAgreement.engineGenerateSecret(NativeECDHKeyAgreement.java:200)
21:39:10  	at jdk.crypto.ec/sun.security.ec.NativeECDHKeyAgreement.engineGenerateSecret(NativeECDHKeyAgreement.java:265)
21:39:10  	at java.base/javax.crypto.KeyAgreement.generateSecret(KeyAgreement.java:660)
21:39:10  	at java.base/sun.security.ssl.KAKeyDerivation.t12DeriveKey(KAKeyDerivation.java:77)
21:39:10  	at java.base/sun.security.ssl.KAKeyDerivation.deriveKey(KAKeyDerivation.java:61)
21:39:10  	at java.base/sun.security.ssl.ECDHClientKeyExchange$ECDHClientKeyExchangeProducer.produce(ECDHClientKeyExchange.java:221)
21:39:10  	at java.base/sun.security.ssl.ClientKeyExchange$ClientKeyExchangeProducer.produce(ClientKeyExchange.java:65)
21:39:10  	at java.base/sun.security.ssl.SSLHandshake.produce(SSLHandshake.java:436)
21:39:10  	at java.base/sun.security.ssl.ServerHelloDone$ServerHelloDoneConsumer.consume(ServerHelloDone.java:182)
21:39:10  	at java.base/sun.security.ssl.SSLHandshake.consume(SSLHandshake.java:392)
21:39:10  	at java.base/sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:443)
21:39:10  	at java.base/sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:421)
21:39:10  	at java.base/sun.security.ssl.TransportContext.dispatch(TransportContext.java:183)
21:39:10  	at java.base/sun.security.ssl.SSLTransport.decode(SSLTransport.java:172)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1506)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(SSLSocketImpl.java:1416)
21:39:10  	at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:456)
21:39:10  	... 7 more
21:39:10  java.lang.Exception: *** Test 'Client JSSE - Server JSSE' failed ***
21:39:10  	at CipherTest.run(CipherTest.java:207)
21:39:10  	at CipherTest.main(CipherTest.java:329)
21:39:10  	at ClientJSSEServerJSSE.main(ClientJSSEServerJSSE.java:42)
21:39:10  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
21:39:10  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
21:39:10  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
21:39:10  	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
21:39:10  	at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:127)
21:39:10  	at java.base/java.lang.Thread.run(Thread.java:840)
21:39:10  
21:39:10  JavaTest Message: Test threw exception: java.lang.Exception: *** Test 'Client JSSE - Server JSSE' failed ***

JasonFengJ9 avatar Jul 21 '22 12:07 JasonFengJ9

@0xdaryl 4/50 seems like it could be a blocker. Pls have someone take a look.

@JasonFengJ9 pls run additional grinders

  1. the same grinder with an option to generate a core dump on AIOOBE
  2. a grinder on the individual test to see if it can be reproduced without running all jdk_security3_1

pshipton avatar Jul 21 '22 13:07 pshipton

@alon-sh does the failure in https://github.com/eclipse-openj9/openj9/issues/15171#issuecomment-1191441156 look like a problem with the OpenSSL support?

pshipton avatar Jul 21 '22 13:07 pshipton

the same grinder with an option to generate a core dump on AIOOBE

jdk_security3_1 50x grinder with an option to generate a core dump on AIOOBE

a grinder on the individual test to see if it can be reproduced without running all jdk_security3_1

sun/security/tools/jarsigner/PreserveRawManifestEntryAndDigest.java 500x grinder - passed

JasonFengJ9 avatar Jul 21 '22 13:07 JasonFengJ9

@alon-sh : could you or delegate begin the investigation on this 0.33 issue please?

0xdaryl avatar Jul 21 '22 14:07 0xdaryl

@pshipton that one error looks related to the OpenSSL EC support.

@ZainabF92 please look at this error. You can see NativeECDHKeyAgreement throwing an error in one of the runs. Easiest way to confirm if this is due to your latest changes is to turn off OpenSSL based EC and see if still fails.

alon-sh avatar Jul 21 '22 16:07 alon-sh

I've opened https://github.com/eclipse-openj9/openj9/issues/15598 for the javax/net/ssl/sanity/interop/ClientJSSEServerJSSE.java failure as it's likely a separate issue.

@0xdaryl @alon-sh who is investigating the AIOOBE failures?

pshipton avatar Jul 21 '22 16:07 pshipton

the AIOOBE looks unrelated to security, something in the locale code in java but got triggered by a security test. If there is someone more familiar with locale code, it may be resolved more quickly.

alon-sh avatar Jul 21 '22 16:07 alon-sh

@nbhuiyan : No idea if this is a JIT issue or not, but we have to start somewhere. Could you take a look at the AIOOBE failure herein? Securing a core when the AIOOBE is thrown is likely the first step. Note this is a potential blocker for 0.33.

0xdaryl avatar Jul 21 '22 18:07 0xdaryl

The grinder with the option failed to run Error: Could not find or load main class '-Xdump:system+java+snap:events=throw+systhrow,filter=java.lang.ArrayIndexOutOfBoundsException'

pshipton avatar Jul 21 '22 18:07 pshipton

I tried 1 iteration without the quotes and I think it's working. Edit - a bus error occurred (out of disk space) and the job needed to be stopped. I think the machine has problems, opened infra issue 7114.

Started another 50x.

pshipton avatar Jul 21 '22 18:07 pshipton

Oops, also started 50x grinder

JasonFengJ9 avatar Jul 21 '22 18:07 JasonFengJ9

Lots of chances to replicate the problem :)

pshipton avatar Jul 21 '22 19:07 pshipton

In 1 iteration there is a bus error in the shared classes library for some test, which means the machine was out of disk space. The test isn't finished running. Edit - the build seemed hung, with no output since the bus error after 6+ hours, so I took the machine offline and stopped the job.

pshipton avatar Jul 21 '22 20:07 pshipton

The 500x grinder on the test by itself isn't finished, but it's done about 320 iterations so far with no failures. It seems like it's only going to fail in the bigger, longer running, suite. Edit - the grinder passed.

pshipton avatar Jul 21 '22 21:07 pshipton

With the 2 50x grinders running the full jdk_security3_1 suite and the 500x grinder of the test where we see the AIOOBE, I decided to try to generate the cores with only enabling the tests under sun/security/tools/jarsigner/. The test iterations complete a lot quicker, but in 50 iterations I have not yet been able to reproduce the AIOOBE. I have expanded the list of enabled tests and launched another 50 iterations locally.

Not related to the AIOOBE, but I also had to disable sun/security/util/DerInputBuffer/PaddedBitString.java that ran as part of jdk_security3_1 because of an assertion failure. Not sure if this is already being tracked:

STDOUT:
Testing 0000: 03 03 00 5D C0                                     ...].
Testing 0000: 03 03 06 5D C0                                     ...].
Testing 0000: 03 03 06 5D CB                                     ...].
Testing 0000: 03 03 08 5D C0                                     ...].
STDERR:
java.lang.AssertionError: Didn't get expected exception IOException
	at jdk.test.lib.Utils.lambda$runAndCheckException$3(Utils.java:624)
	at jdk.test.lib.Utils.runAndCheckException(Utils.java:650)
	at jdk.test.lib.Utils.runAndCheckException(Utils.java:621)
	at PaddedBitString.test(PaddedBitString.java:100)
	at PaddedBitString.main(PaddedBitString.java:76)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
	at java.base/java.lang.Thread.run(Thread.java:840)

JavaTest Message: Test threw exception: java.lang.AssertionError
JavaTest Message: shutting down test


TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.AssertionError: Didn't get expected exception IOException
--------------------------------------------------
Test results: passed: 13; failed: 1

nbhuiyan avatar Jul 22 '22 00:07 nbhuiyan

The grinders are filling the disk, likely with core files from the -Xdump option, getting a "bus error" or other bad behaviour, and then possibly hanging. I guess AIOOBE must be thrown quite a bit, likely for other reasons than this failure. I'm going to clean the machines and we can try again using events=uncaught instead.

pshipton avatar Jul 22 '22 03:07 pshipton

4 iterations x 15 machines grinder using events=uncaught.

pshipton avatar Jul 22 '22 03:07 pshipton

The failure was reproduced (1 failure in each of the following), but no diagnostics generated. Grinder_iteration_14 - ub20x64rt3-7 Grinder_iteration_13 - ub18x64rt1-9 Grinder_iteration_5 - ub20x64rt3-8

pshipton avatar Jul 22 '22 12:07 pshipton

The test is execing the jarsigner tool, which doesn't have the diagnostic option included. We'll need to try setting the diagnostic option in an environment variable. Started another 4x x 10 grinder.

Execing the jarsigner creates a new JVM, but the failure couldn't be reproduced in 500x when running just the test by itself. Some possibilities

  • the 5 machines where the 500x ran were not good machines to reproduce the problem on (ub18x64rt1-8, ub20x64rt3-7, ub18x64rt1-6, ub20x64rt1-3, ub20x64rt4-9)
  • the problem could be related to the shared cache
  • the AIOOBE is related the parameters passed to the jarsigner, or other inputs like certificates in the keystore that were created by the test

pshipton avatar Jul 22 '22 12:07 pshipton

A few infra problems in that last grinder, started a new 5 machine grinder limited to ub20 machines

pshipton avatar Jul 22 '22 13:07 pshipton

Re the sun/security/util/DerInputBuffer/PaddedBitString.java failures, I haven't seen that one.

pshipton avatar Jul 22 '22 14:07 pshipton

The last grinder didn't reproduce it. Started another 12 machine grinder

pshipton avatar Jul 25 '22 13:07 pshipton

The failure was reproduced (ub20x64rt1-7), but no diagnostics were captured using https://github.com/pshipton/openjdk-tests/commit/a1fb22f98

pshipton avatar Jul 25 '22 18:07 pshipton

We do have the test artifacts. The latest failure seems to be running the following command from aqa-tests/TKG/output_16587560462168/jdk_security3_1/work/sun/security/tools/jarsigner/PreserveRawManifestEntryAndDigest.

bin/jarsigner -J-Duser.language=en -J-Duser.country=US -J-Djava.security.egd=file:/dev/./urandom -verify -strict -keystore test.jks -storepass changeit -debug -verbose test-singleIndividualSectionTrailingSeq10131010-step4.jar a

I tried running that a number of times on the failing machine but couldn't reproduce the error.

pshipton avatar Jul 25 '22 18:07 pshipton

Another grinder attempt with a modification to the test adding the -Xdump option. https://github.com/pshipton/openj9-openjdk-jdk11/commit/9bf5a4848b

pshipton avatar Jul 25 '22 20:07 pshipton

Try that again with the correct option. https://github.com/pshipton/openj9-openjdk-jdk11/commit/afd6fc9db4f

pshipton avatar Jul 26 '22 01:07 pshipton

The problem wasn't repeated in the last try, but the tests worked. Trying again

pshipton avatar Jul 26 '22 12:07 pshipton