mq-container icon indicating copy to clipboard operation
mq-container copied to clipboard

Failed to build 9.4.0.5 on Mac

Open gkwan-ibm opened this issue 1 year ago • 16 comments

We followed this instruction to build a docker image for Mac ARM-based. We had no problem when built the 9.4.0.0 . But recently, when we built 9.4.0.5, we got error:

Downloading IBM MQ Advanced for Developers 9.4.0.5
mkdir -p downloads
curl --fail --location https://public.dhe.ibm.com/ibmdl/export/pub/software/websphere/messaging/mqadv/9.4.0.5-IBM-MQ-Advanced-for-Developers-Non-Install-LinuxARM64.tar.gz --output downloads/9.4.0.5-IBM-MQ-Advanced-for-Developers-Non-Install-LinuxARM64.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0   196    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (22) The requested URL returned error: 404
make: *** [downloads/9.4.0.5-IBM-MQ-Advanced-for-Developers-Non-Install-LinuxARM64.tar.gz] Error 22

gkwan-ibm avatar Sep 10 '24 13:09 gkwan-ibm

Looks like DHE does not have 9.4.0.5-IBM-MQ-Advanced-for-Developers-Non-Install-LinuxARM64.tar.gz

gkwan-ibm avatar Sep 10 '24 13:09 gkwan-ibm

@gkwan-ibm I am not sure if the LTS fix-pack developer editions are published or not. I will try to get it confirmed.

vgavinash avatar Sep 11 '24 05:09 vgavinash

for workaround, yep, we used 9.4.0.0

git clone https://github.com/ibm-messaging/mq-container.git -b 9.4.0.0-r3

gkwan-ibm avatar Sep 11 '24 12:09 gkwan-ibm

Hi @gkwan-ibm I tried git clone https://github.com/ibm-messaging/mq-container.git -b 9.4.0.0-r3

getting below. Any help please?

`=> CACHED [mq-server 2/12] COPY --from=mq-redux /opt/mqm-redux/ /opt/mqm/ 0.0s => CACHED [mq-server 3/12] COPY setup-image.sh /usr/local/bin/ 0.0s => CACHED [mq-server 4/12] COPY install-mq-server-prereqs.sh /usr/local/bin/ 0.0s => ERROR [mq-server 5/12] RUN env && chmod u+x /usr/local/bin/install-*.sh && chmod u+x /usr/local/bin/setup-image.sh && install-mq-server-prereqs.sh && setup-image.sh && /opt/mqm/bin/security/amqpamcf && c 0.7s

[mq-server 5/12] RUN env && chmod u+x /usr/local/bin/install-.sh && chmod u+x /usr/local/bin/setup-image.sh && install-mq-server-prereqs.sh && setup-image.sh && /opt/mqm/bin/security/amqpamcf && chown -R 1001:root /opt/mqm/: 0.110 GO_WORKDIR=/opt/app-root/src/go/src/github.com/ibm-messaging/mq-container 0.110 PWD=/ 0.110 container=oci 0.110 HOME=/root 0.110 BASE_TAG=9.4-1134 0.110 SHLVL=1 0.110 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 0.110 BASE_IMAGE=registry.access.redhat.com/ubi9/ubi-minimal 0.110 _=/usr/bin/env 0.114 + test -f /usr/bin/yum 0.114 + YUM=false 0.114 + test -f /usr/bin/microdnf 0.114 + MICRODNF=true 0.114 + test -f /usr/bin/rpm 0.114 + RPM=true 0.114 + test -f /usr/bin/apt-get 0.114 + UBUNTU=false 0.114 ++ uname -m 0.115 + CPU_ARCH=aarch64 0.115 + false 0.116 + true 0.116 + EXTRA_RPMS='bash bc ca-certificates file findutils gawk glibc-common grep ncurses-libs passwd procps-ng sed shadow-utils tar util-linux which' 0.116 + false 0.116 + true 0.116 + microdnf --disableplugin=subscription-manager -y install bash bc ca-certificates file findutils gawk glibc-common grep ncurses-libs passwd procps-ng sed shadow-utils tar util-linux which 0.164 Downloading metadata... 0.666 error: cannot update repo 'ubi-9-baseos-rpms': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried; Last error: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi9/9/aarch64/baseos/os/repodata/repomd.xml [SSL certificate problem: self-signed certificate in certificate chain]


2 warnings found (use docker --debug to expand):

  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 25)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 157) Dockerfile-server:114

113 | COPY install-mq-server-prereqs.sh /usr/local/bin/ 114 | >>> RUN env
115 | >>> && chmod u+x /usr/local/bin/install-.sh
116 | >>> && chmod u+x /usr/local/bin/setup-image.sh
117 | >>> && install-mq-server-prereqs.sh
118 | >>> && setup-image.sh
119 | >>> && /opt/mqm/bin/security/amqpamcf
120 | >>> && chown -R 1001:root /opt/mqm/
121 | COPY --from=builder $GO_WORKDIR/runmqserver /usr/local/bin/

ERROR: failed to solve: process "/bin/sh -c env && chmod u+x /usr/local/bin/install-.sh && chmod u+x /usr/local/bin/setup-image.sh && install-mq-server-prereqs.sh && setup-image.sh && /opt/mqm/bin/security/amqpamcf && chown -R 1001:root /opt/mqm/" did not complete successfully: exit code: 1 `

momzilla avatar Sep 17 '24 14:09 momzilla

hi @momzilla

  • are you using Mac ARM-based?
  • which docker you are using? DockerDesktop, RancherDesktop, Colima, or other?

gkwan-ibm avatar Sep 17 '24 14:09 gkwan-ibm

Hi @gkwan-ibm yes, using Mac ARM-based, and using docker desktop.

momzilla avatar Sep 17 '24 14:09 momzilla

did you run make build-devserver COMMAND=docker or other command to build?

I have no problem.

gkwan-ibm avatar Sep 17 '24 14:09 gkwan-ibm

And, as your description, can you access https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi9/9/aarch64/baseos/os/repodata/repomd.xml?

gkwan-ibm avatar Sep 17 '24 14:09 gkwan-ibm

I have tried running both make build-devserver COMMAND=docker And make build-devserver

But got that same error. Also, I am able to access the file https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi9/9/aarch64/baseos/os/repodata/repomd.xml from browser or curl it from command line.

momzilla avatar Sep 17 '24 20:09 momzilla

Curious if there's any update on the availability of the 9.4.0.5 ARM64 package? It looks like historically they've released them all at the same time.

arvest-bjoneson avatar Sep 18 '24 04:09 arvest-bjoneson

@gkwan-ibm please note images only for the supported platforms for production, i.e., LinuxPPC64LE, LinuxS390X & LinuxX64 have been made available for v9.4.0.5 as of now. The decision is yet to be made about ARM. Until then ARM images would be available for CD only. Or you can continue using the 9.4.0.0 LTS.

Cc: @arthurbarr

vgavinash avatar Sep 30 '24 07:09 vgavinash

Does it mean the "building mq container for Mac development is not supported anymore"?

gkwan-ibm avatar Oct 01 '24 14:10 gkwan-ibm

No, it just means that the arm64 build in the 9.4.0.x code stream is not being produced, as that code stream gets special treatment due to it being part of a longer support cycle. When the next CD release of MQ is produced, it will include the arm64 build for MQ Advanced for Developers as usual.

arthurbarr avatar Oct 01 '24 15:10 arthurbarr

It's just a little bit annoying, because it looks like historically on the distribution site, they have included arm images for each fix version. We recently built a CI/CD pipeline which builds for arm and amd arches for each new fix version. We can add some logic to optionally exclude the arm build on fix versions, but was nice that it was consistently there previously.

On Tue, Oct 1, 2024, 10:46 AM Arthur Barr @.***> wrote:

Information Security REMINDER: This is an EXTERNAL EMAIL. Stop and think before RESPONDING or CLICKING a link or OPENING attachments.

No, it just means that the arm64 build in the 9.4.0.x code stream is not being produced, as that code stream gets special treatment due to it being part of a longer support cycle. When the next CD release of MQ is produced, it will include the arm64 build for MQ Advanced for Developers as usual.

— Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/ibm-messaging/mq-container/issues/577*issuecomment-2386371465__;Iw!!CyJt3Yc!_9LAB1_EWzNAtUf4s8QWrZ0763dhtQCEFUapebKuwS4B5dstod71C47kS13K5vd6rGFlygBQYbdoTJNjy_B_T3s$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/BLL674WUFCHDVAVSKZNWRH3ZZK7WBAVCNFSM6AAAAABN6YT36WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBWGM3TCNBWGU__;!!CyJt3Yc!_9LAB1_EWzNAtUf4s8QWrZ0763dhtQCEFUapebKuwS4B5dstod71C47kS13K5vd6rGFlygBQYbdoTJNj3skc0zQ$ . You are receiving this because you commented.Message ID: @.***>

The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential or privileged material. Any review, distribution, or other unauthorized use of the information by persons or entities other than the intended recipient is prohibited. If you received this communication in error, please contact the sender and delete the material from any computer.

*** Arvest Confidential ***

arvest-bjoneson avatar Oct 01 '24 17:10 arvest-bjoneson

Ran into a similar issue -

+ microdnf --disableplugin=subscription-manager install bash bc ca-certificates file findutils gawk glibc-common grep ncurses-compat-libs passwd procps-ng sed shadow-utils tar util-linux which
Downloading metadata...
error: cannot update repo 'ubi-8-baseos-rpms': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried; Last error: Curl error (60): Peer certificate cannot be authenticated with given CA certificates for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/aarch64/baseos/os/repodata/repomd.xml [SSL certificate problem: unable to get local issuer certificate]
Error: building at STEP "RUN env   && mkdir /opt/mqm   && chmod u+x /usr/local/bin/install-*.sh   && sleep 1   && install-mq-server-prereqs.sh   && install-mq.sh   && /opt/mqm/bin/security/amqpamcf   && chown -R 1001:root /opt/mqm/*": while running runtime: exit status 1

Working with arm64 and using version 9.3.3.0

Build environment
ARCH=arm64
MQ_VERSION=9.3.3.0
MQ_ARCHIVE=IBM_MQ_9.3.3_LINUX__NOINST.tar.gz
MQ_ARCHIVE_DEV=9.3.3.0-IBM-MQ-Advanced-for-Developers-Non-Install-LinuxARM64.tar.gz
MQ_IMAGE_DEVSERVER=ibm-mqadvanced-server-dev
MQ_IMAGE_ADVANCEDSERVER=ibm-mqadvanced-server
COMMAND=podman

davisjose19 avatar Apr 23 '25 14:04 davisjose19

Hi @gkwan-ibm I tried git clone https://github.com/ibm-messaging/mq-container.git -b 9.4.0.0-r3

getting below. Any help please?

`=> CACHED [mq-server 2/12] COPY --from=mq-redux /opt/mqm-redux/ /opt/mqm/ 0.0s

=> CACHED [mq-server 3/12] COPY setup-image.sh /usr/local/bin/ 0.0s => CACHED [mq-server 4/12] COPY install-mq-server-prereqs.sh /usr/local/bin/ 0.0s => ERROR [mq-server 5/12] RUN env && chmod u+x /usr/local/bin/install-*.sh && chmod u+x /usr/local/bin/setup-image.sh && install-mq-server-prereqs.sh && setup-image.sh && /opt/mqm/bin/security/amqpamcf && c 0.7s

[mq-server 5/12] RUN env && chmod u+x /usr/local/bin/install-.sh && chmod u+x /usr/local/bin/setup-image.sh && install-mq-server-prereqs.sh && setup-image.sh && /opt/mqm/bin/security/amqpamcf && chown -R 1001:root /opt/mqm/: 0.110 GO_WORKDIR=/opt/app-root/src/go/src/github.com/ibm-messaging/mq-container 0.110 PWD=/ 0.110 container=oci 0.110 HOME=/root 0.110 BASE_TAG=9.4-1134 0.110 SHLVL=1 0.110 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 0.110 BASE_IMAGE=registry.access.redhat.com/ubi9/ubi-minimal 0.110 _=/usr/bin/env 0.114 + test -f /usr/bin/yum 0.114 + YUM=false 0.114 + test -f /usr/bin/microdnf 0.114 + MICRODNF=true 0.114 + test -f /usr/bin/rpm 0.114 + RPM=true 0.114 + test -f /usr/bin/apt-get 0.114 + UBUNTU=false 0.114 ++ uname -m 0.115 + CPU_ARCH=aarch64 0.115 + false 0.116 + true 0.116 + EXTRA_RPMS='bash bc ca-certificates file findutils gawk glibc-common grep ncurses-libs passwd procps-ng sed shadow-utils tar util-linux which' 0.116 + false 0.116 + true 0.116 + microdnf --disableplugin=subscription-manager -y install bash bc ca-certificates file findutils gawk glibc-common grep ncurses-libs passwd procps-ng sed shadow-utils tar util-linux which 0.164 Downloading metadata... 0.666 error: cannot update repo 'ubi-9-baseos-rpms': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried; Last error: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi9/9/aarch64/baseos/os/repodata/repomd.xml [SSL certificate problem: self-signed certificate in certificate chain]

2 warnings found (use docker --debug to expand):

  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 25)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 157) Dockerfile-server:114

113 | COPY install-mq-server-prereqs.sh /usr/local/bin/

114 | >>> RUN env 115 | >>> && chmod u+x /usr/local/bin/install-.sh 116 | >>> && chmod u+x /usr/local/bin/setup-image.sh 117 | >>> && install-mq-server-prereqs.sh 118 | >>> && setup-image.sh 119 | >>> && /opt/mqm/bin/security/amqpamcf 120 | >>> && chown -R 1001:root /opt/mqm/ 121 | COPY --from=builder $GO_WORKDIR/runmqserver /usr/local/bin/ ERROR: failed to solve: process "/bin/sh -c env && chmod u+x /usr/local/bin/install-.sh && chmod u+x /usr/local/bin/setup-image.sh && install-mq-server-prereqs.sh && setup-image.sh && /opt/mqm/bin/security/amqpamcf && chown -R 1001:root /opt/mqm/" did not complete successfully: exit code: 1 `

were you able to resolve this @momzilla ?

davisjose19 avatar Apr 24 '25 09:04 davisjose19

close

  • need to use the version that the ARM gz file is available at the https://public.dhe.ibm.com/ibmdl/export/pub/software/websphere/messaging/mqadv
  • if have issue for building ARM container, open other issue.

gkwan-ibm avatar Aug 12 '25 19:08 gkwan-ibm