Linux/x64 OpenJ9 build pipelines failing (JDK11 only)

[sxa]

Thank you for reporting a broken build! Please fill in the following details:

• Jenkins link to the failing log: https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-openj9/
• Which platforms (OS+arch) are affected: Linux/x64
• If you look at the historic logs, does the problem appear to be specific to one machine? No
• Link to any upstream project bug report (e.g. OpenJ9/JBS) n/a

19:20:14  Compiling 16 files for jdk.security.jgss
19:20:17  ar: creating apps/libapps.a
19:20:17  ar: creating libssl.a
19:20:17  ar: creating test/libtestutil.a
19:20:28  /bin/sh: CCACHE_COMPRESS=1: command not found
19:20:28  Makefile:9018: recipe for target 'test/rsa_complex' failed
19:20:28  gmake[5]: *** [test/rsa_complex] Error 127
19:20:28  gmake[5]: *** Waiting for unfinished jobs....
19:20:28  Makefile:174: recipe for target 'all' failed
19:20:28  gmake[4]: *** [all] Error 2
19:20:28  /home/adoptopenjdk/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-x64-openj9/workspace/build/src/closed/openssl.gmk:41: recipe for target 'build_openssl' failed
19:20:28  gmake[3]: *** [build_openssl] Error 1
19:20:28  /home/adoptopenjdk/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-x64-openj9/workspace/build/src/closed/custom/Main.gmk:49: recipe for target 'j9vm-build' failed
19:20:28  gmake[2]: *** [j9vm-build] Error 2
19:20:28  
19:20:28  ERROR: Build failed for targets 'product-images legacy-jre-image test-image debug-image' in configuration 'linux-x86_64-normal-server-release' (exit code 2) 
19:20:28  Stopping sjavac server

FYI @AdamBrousseau I've got a feeling we've seen this before but I haven't got the bandwidth to look into it just now. Seems to have been broken for a while (Cc @smlambert @andrew-m-leonard)

[karianna]

This is a ci.adoptopenjdk.net failure only. Semeru builds fine on their CI

[sxa]

@AdamBrousseau Do you remember if we did see this one before and what the resolution might have been? Looks like it's running under a base sh or something instead of a shell that supports VAR=value blah blah blah

(Or do you just have all ccache stuff disabled on your CI?)

[AdamBrousseau]

Looks like OpenSSL failing to compile. Is your build still using the container's v1.0.2?

--with-openssl=/usr/local/openssl-1.0.2

[sxa]

@AdamBrousseau Am I right in saying that you're currently building using CentOS7? We're still building on the CentOS6 container image which is why it's pointing to the separate openssl, so we should possibly switch over to using 7 now. https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-openj9/1103/ seemed to run through ok on CentOS7 and not using the separate /usr/local parameter to pick up openssl.

[AdamBrousseau]

OpenJ9 & Semeru are still using cent6 for jdk8 & 11. Semeru was using an older version of the Adopt build container that still had 1.0.2 up until last week when a Jenkins plugin regression broke us. The regression is not resolved yet but in the meantime I have changed all our compiles to use the latest containers (we had them frozen on jdk8 and also aarch64) and also disable-ccache on jdk11 xlinux. We only switched to cent7 on xlinux jdk15+.

[AdamBrousseau]

Guessing this can be closed?

[karianna]

@sxa to confirm

[sxa]

Let's keep it open for now as Adam has put in some fixes and we're going to discuss this further this week ...