ods-core icon indicating copy to clipboard operation
ods-core copied to clipboard

Published 20 hours ago • verified publisher icon opendevstack

make install-jenkins crashes due to a openssl dependency broken

Open jssnull opened this issue 4 years ago • 8 comments

Describe the bug Following this instalation guide:https://www.opendevstack.org/ods-documentation/opendevstack/3.x/administration/installation.html#_opendevstack_environment_in_openshift When we arrive to the command make install-jenkins the command crashes during Dockerfile build time concretely RUN yum -y install openssl && yum clean all && rm -rf /var/cache/yum/*

This is the error trace we're having:


Step 7/26 : RUN yum -y install     openssl     && yum clean all     && rm -rf /var/cache/yum/*
 ---> Running in 78a34135871a

Loaded plugins: ovl, product-id, search-disabled-repos, subscription-manager
Resolving Dependencies
--> Running transaction check
---> Package openssl.x86_64 1:1.0.2k-19.el7 will be installed
--> Processing Dependency: openssl-libs(x86-64) = 1:1.0.2k-19.el7 for package: 1:openssl-1.0.2k-19.el7.x86_64
--> Processing Dependency: make for package: 1:openssl-1.0.2k-19.el7.x86_64
--> Running transaction check
---> Package make.x86_64 1:3.82-24.el7 will be installed
---> Package openssl.x86_64 1:1.0.2k-19.el7 will be installed
--> Processing Dependency: openssl-libs(x86-64) = 1:1.0.2k-19.el7 for package: 1:openssl-1.0.2k-19.el7.x86_64
--> Finished Dependency Resolution
Error: Package: 1:openssl-1.0.2k-19.el7.x86_64 (rhel-7-server-rpms)
           Requires: openssl-libs(x86-64) = 1:1.0.2k-19.el7
           Installed: 1:openssl-libs-1.0.2k-21.el7_9.x86_64 (@rhel-7-server-rpms-615)
               openssl-libs(x86-64) = 1:1.0.2k-21.el7_9
           Available: 1:openssl-libs-1.0.1e-34.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7
           Available: 1:openssl-libs-1.0.1e-34.el7_0.3.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.3
           Available: 1:openssl-libs-1.0.1e-34.el7_0.4.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.4
           Available: 1:openssl-libs-1.0.1e-34.el7_0.6.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.6
           Available: 1:openssl-libs-1.0.1e-34.el7_0.7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.7
           Available: 1:openssl-libs-1.0.1e-42.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7
           Available: 1:openssl-libs-1.0.1e-42.el7_1.4.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.4
           Available: 1:openssl-libs-1.0.1e-42.el7_1.5.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.5
           Available: 1:openssl-libs-1.0.1e-42.el7_1.6.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.6
           Available: 1:openssl-libs-1.0.1e-42.el7_1.8.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.8
           Available: 1:openssl-libs-1.0.1e-42.el7_1.9.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.9
           Available: 1:openssl-libs-1.0.1e-51.el7_2.1.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.1
           Available: 1:openssl-libs-1.0.1e-51.el7_2.2.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.2
           Available: 1:openssl-libs-1.0.1e-51.el7_2.4.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.4
           Available: 1:openssl-libs-1.0.1e-51.el7_2.5.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.5
           Available: 1:openssl-libs-1.0.1e-51.el7_2.7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.7
           Available: 1:openssl-libs-1.0.1e-60.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-60.el7
           Available: 1:openssl-libs-1.0.1e-60.el7_3.1.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-60.el7_3.1
           Available: 1:openssl-libs-1.0.2k-8.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-8.el7
           Available: 1:openssl-libs-1.0.2k-12.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-12.el7
           Available: 1:openssl-libs-1.0.2k-16.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-16.el7
           Available: 1:openssl-libs-1.0.2k-16.el7_6.1.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-16.el7_6.1
           Available: 1:openssl-libs-1.0.2k-19.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-19.el7
**********************************************************************
yum can be configured to try to resolve such errors by temporarily enabling
disabled repos and searching for missing dependencies.
To enable this functionality please set 'notify_only=0' in /etc/yum/pluginconf.d/search-disabled-repos.conf
**********************************************************************

 You could try using --skip-broken to work around the problem
Error: Package: 1:openssl-1.0.2k-19.el7.x86_64 (rhel-7-server-rpms)
           Requires: openssl-libs(x86-64) = 1:1.0.2k-19.el7
           Installed: 1:openssl-libs-1.0.2k-21.el7_9.x86_64 (@rhel-7-server-rpms-615)
               openssl-libs(x86-64) = 1:1.0.2k-21.el7_9
           Available: 1:openssl-libs-1.0.1e-34.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7
           Available: 1:openssl-libs-1.0.1e-34.el7_0.3.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.3
           Available: 1:openssl-libs-1.0.1e-34.el7_0.4.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.4
           Available: 1:openssl-libs-1.0.1e-34.el7_0.6.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.6
           Available: 1:openssl-libs-1.0.1e-34.el7_0.7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-34.el7_0.7
           Available: 1:openssl-libs-1.0.1e-42.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7
           Available: 1:openssl-libs-1.0.1e-42.el7_1.4.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.4
           Available: 1:openssl-libs-1.0.1e-42.el7_1.5.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.5
           Available: 1:openssl-libs-1.0.1e-42.el7_1.6.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.6
           Available: 1:openssl-libs-1.0.1e-42.el7_1.8.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.8
           Available: 1:openssl-libs-1.0.1e-42.el7_1.9.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-42.el7_1.9
           Available: 1:openssl-libs-1.0.1e-51.el7_2.1.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.1
           Available: 1:openssl-libs-1.0.1e-51.el7_2.2.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.2
           Available: 1:openssl-libs-1.0.1e-51.el7_2.4.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.4
           Available: 1:openssl-libs-1.0.1e-51.el7_2.5.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.5
           Available: 1:openssl-libs-1.0.1e-51.el7_2.7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-51.el7_2.7
           Available: 1:openssl-libs-1.0.1e-60.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-60.el7
           Available: 1:openssl-libs-1.0.1e-60.el7_3.1.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.1e-60.el7_3.1
           Available: 1:openssl-libs-1.0.2k-8.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-8.el7
           Available: 1:openssl-libs-1.0.2k-12.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-12.el7
           Available: 1:openssl-libs-1.0.2k-16.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-16.el7
           Available: 1:openssl-libs-1.0.2k-16.el7_6.1.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-16.el7_6.1
           Available: 1:openssl-libs-1.0.2k-19.el7.x86_64 (rhel-7-server-rpms)
               openssl-libs(x86-64) = 1:1.0.2k-19.el7
 You could try running: rpm -Va --nofiles --nodigest
Removing intermediate container 78a34135871a
error: build error: The command '/bin/bash -o pipefail -c yum -y install     openssl     && yum clean all     && rm -rf /var/cache/yum/*' returned a non-zero code: 1
Please, check build jenkins-agent-base-2 since it seems failed/not completed.
Makefile:72: recipe for target 'start-jenkins-build-agent-base' failed
make: *** [start-jenkins-build-agent-base] Error 1

This error happened today (21/01/2021) Seems to be an error related with RHEL repositories

jssnull avatar Jan 21 '21 13:01 jssnull

maybe this is related with this? https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/7.9_release_notes/revision_history

jssnull avatar Jan 21 '21 13:01 jssnull

image

https://catalog.redhat.com/software/containers/openshift3/jenkins-slave-base-rhel7/581d2f3f00e5d05639b6515b?tag=v3.11&push_date=1611160293000&container-tabs=overview

The red hat image seems to have been updated recently (22 hours ago) and the package that is failing has a different version.

Package that it is trying to downlod is openssl-1.0.2k-19.el7.x86_64 but the one available now seems to be openssl-1.0.2k-21.el7_9.x86_64

BraisVQ avatar Jan 21 '21 14:01 BraisVQ

@michaelsauter @oalyman the jenkins master and jenkins agent Docker images works with the tag: "v3.11.346"

jssnull avatar Jan 21 '21 14:01 jssnull

Thanks for the excellent bug report!

Looking at the error log above, I believe the issue to be with the package resolution mechanism which is determined by the node underneath the pod. Do you now if the satellite is up-to-date? Is that updated at certain intervals automatically? If so, please try again after it has been updated.

michaelsauter avatar Jan 22 '21 07:01 michaelsauter

hi @michaelsauter in this case I don't know if the satellite is up-do-date, but if we change the target docke image to label v3.11.346 it will work. maybe Red Hat updated the 3.11 tag directly

jssnull avatar Jan 25 '21 11:01 jssnull

Oh yes, the 3.11 tag always points the latest 3.11 patch tag, which is now 3.11.346. And contrary to what it looks like, those patch updates can have huge changes inside (in the past, one changed Java 8 to 11).

michaelsauter avatar Jan 25 '21 15:01 michaelsauter

Hi @michaelsauter image

Here we can see the last tag associated to 3.11 is the 3.11.374 which is newer than 3.11.346 Maybe a temporal fix is to keep the current jenkins images with 3.11.346 tag

jssnull avatar Jan 26 '21 08:01 jssnull

is this solved?

clemensutschig avatar Jan 19 '22 18:01 clemensutschig