mq-container MQ container CrashLoopBackOff - chmod 2775 on file /mnt/mqm/data/ failed

I am getting the following error when I try to install the MQ via helm charts; The error happens when spinning up the MQ container;

------------ HELM command -------------- helm install mq ibm_repo/ibm-mqadvanced-server-dev
--set license=accept
--set queueManager.dev.secret.name=mysecret
--set queueManager.dev.secret.adminPasswordKey=adminPassword
--set queueManager.multiInstance=true
--set queueManager.name=QMGR01
--set resources.limits.cpu=500m
--set resources.limits.memory=1Gi
--set resources.requests.cpu=500m
--set resources.requests.memory=512Mi
--set security.initVolumeAsRoot=true

------------ ERROR description --------------

_07/02/20 10:57:01 - Process(15.1) User(root) Program(crtmqdir) Host(mq-ibm-mq-0) Installation(Installation1) VRMF(9.1.5.0) Time(2020-07-02T10:57:01.723Z) CommentInsert1(Linux 4.4.0-179-generic (MQ Linux (x86-64 platform) 64-bit)) CommentInsert2(/opt/mqm (Installation1)) CommentInsert3(9.1.5.0 (p915-ifix-L200325.DE))

AMQ6287I: IBM MQ V9.1.5.0 (p915-ifix-L200325.DE).

EXPLANATION: IBM MQ system information: Host Info :- Linux 4.4.0-179-generic (MQ Linux (x86-64 platform) 64-bit) Installation :- /opt/mqm (Installation1) Version :- 9.1.5.0 (p915-ifix-L200325.DE) ACTION: None. ----- amqxeida.c : 6457 ------------------------------------------------------- 07/02/20 10:57:01 - Process(15.1) User(root) Program(crtmqdir) Host(mq-ibm-mq-0) Installation(Installation1) VRMF(9.1.5.0) Time(2020-07-02T10:57:01.721Z) ArithInsert1(1533) ArithInsert2(16877) CommentInsert1(chmod 2775) CommentInsert2(/mnt/mqm/data/)

AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/' error '16877'.

EXPLANATION: The execution of the system call chmod 2775 on file /mnt/mqm/data/ failed and the error code 16877 was returned. ACTION: Investigate the cause of the failure using the operating system error code 1533 and reissue the command. ----- amqxfdcx.c : 842 -------------------------------------------------------- 07/02/20 10:57:01 - Process(15.1) User(root) Program(crtmqdir) Host(mq-ibm-mq-0) Installation(Installation1) VRMF(9.1.5.0) Time(2020-07-02T10:57:01.733Z) ArithInsert1(15)

AMQ6183W: An internal IBM MQ error has occurred._

---------- My persistent volumes: NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE data-mq-ibm-mq-0 Bound data-mq-ibm-mq-0 2Gi RWO 4h14m mq-ibm-mq-log Bound mq-ibm-mq-log 2Gi RWO 169m mq-ibm-mq-qm Bound mq-ibm-mq-qm 2Gi RWO 169m mq-ibm-mq-token-65pc2 Bound mq-ibm-mq-token-65pc2 2Gi RWO 3h59m

mounting point: /vagrant/mqserver

vagrant@ubuntu-xenial:/vagrant/mqserver$ tree . ├── data │ ├── config │ ├── conv │ │ └── table │ │ ├── ccsid_part2.tbl │ │ └── ccsid.tbl │ ├── errors │ │ ├── AMQ15.0.FDC │ │ ├── AMQERR01.json │ │ ├── AMQERR01.LOG │ │ ├── AMQERR02.LOG │ │ └── AMQERR03.LOG │ ├── exits │ │ └── Installation1 │ ├── exits64 │ │ └── Installation1 │ ├── log │ ├── mqclient.ini │ ├── mqft │ │ ├── config │ │ ├── installations │ │ └── logs │ ├── qmgrs │ │ └── @SYSTEM │ ├── service.env │ ├── sockets │ │ └── @SYSTEM │ │ └── qmgrlocl │ │ └── mq-ibm-mq-0 │ │ ├── Enqueue.lck │ │ └── Installation1 │ │ └── Trace.shm │ ├── trace │ └── web │ └── installations │ └── Installation1 │ └── servers │ └── mqweb │ ├── jvm.options │ ├── logs │ ├── mqwebuser.xml │ └── server.xml ├── log └── qmgrs

30 directories, 14 files

Container logs:

2020-07-02T13:44:08.937Z CPU architecture: amd64 2020-07-02T13:44:08.937Z Linux kernel version: 4.4.0-179-generic 2020-07-02T13:44:08.938Z Container runtime: kube 2020-07-02T13:44:08.938Z Base image: Red Hat Enterprise Linux 8.1 (Ootpa) 2020-07-02T13:44:08.938Z Running as user ID 1001 with primary group 0 2020-07-02T13:44:08.938Z Capabilities: none 2020-07-02T13:44:08.938Z seccomp enforcing mode: disabled 2020-07-02T13:44:08.938Z Process security attributes: docker-default (enforce) 2020-07-02T13:44:08.938Z Detected 'vboxsf' volume mounted to /mnt/mqm 2020-07-02T13:44:08.938Z Detected 'vboxsf' volume mounted to /mnt/mqm-log 2020-07-02T13:44:08.938Z Detected 'vboxsf' volume mounted to /mnt/mqm-data 2020-07-02T13:44:08.938Z Multi-instance queue manager: enabled 2020-07-02T13:44:09.076Z Using queue manager name: QMGR01 2020-07-02T13:44:09.765Z Error creating directory structure: AMQ6118S: An internal IBM MQ error has occurred (40406109) 2020-07-02T13:44:09.765Z /opt/mqm/bin/crtmqdir: exit status 20

Kubernetes version

vagrant@ubuntu-xenial:/vagrant/mqserver$ kubectl version Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.3", GitCommit:"2e7996e3e2712684bc73f0dec0200d64eec7fe40", GitTreeState:"clean", BuildDate:"2020-05-20T12:52:00Z", GoVersion:"go1.13.9", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.3", GitCommit:"2e7996e3e2712684bc73f0dec0200d64eec7fe40", GitTreeState:"clean", BuildDate:"2020-05-20T12:43:34Z", GoVersion:"go1.13.9", Compiler:"gc", Platform:"linux/amd64"}

Jul 02 '20 13:07 victorpaulo

Hi, Trying to solve the issue, after looking the MQ go wrapper, I decided to change from vboxsf (Virtual box) filesystem to NFS and the error changed, please can you check below:

ERROR on AMQERR01.LOG file on MQ_MOUNT_POINT/data/error directory

----- amqxfdcx.c : 842 -------------------------------------------------------- 07/02/20 15:19:19 - Process(56.1) User(mqm) Program(crtmqm) Host(mq-ibm-mq-0) Installation(Installation1) VRMF(9.1.5.0) Time(2020-07-02T15:19:19.369Z) ArithInsert1(56) CommentInsert1(QMGR01)

AMQ6184W: An internal IBM MQ error has occurred on queue manager QMGR01.

EXPLANATION: An error has been detected, and the IBM MQ error recording routine has been called. The failing process is process 56. ACTION: Use the standard facilities supplied with your system to record the problem identifier and to save any generated output files. Use either the MQ Support site: http://www.ibm.com/software/integration/wmq/support/, or IBM Support Assistant (ISA): http://www.ibm.com/software/support/isa/, to see whether a solution is already available. If you are unable to find a match, contact your IBM support center. Do not discard these files until the problem has been resolved. ----- amqxfdcx.c : 888 -------------------------------------------------------- 07/02/20 15:22:12 - Process(56.1) User(mqm) Program(crtmqm) Host(mq-ibm-mq-0) Installation(Installation1) VRMF(9.1.5.0) Time(2020-07-02T15:22:12.179Z) ArithInsert1(13) CommentInsert1('13 - ' from mkdir.)

AMQ6119S: An internal IBM MQ error has occurred ('13 - ' from mkdir.)

EXPLANATION: MQ detected an unexpected error when calling the operating system. The MQ error recording routine has been called.

container logs

vagrant@ubuntu-xenial:~$ kubectl logs mq-ibm-mq-0 2020-07-02T15:16:29.150Z CPU architecture: amd64 2020-07-02T15:16:29.150Z Linux kernel version: 4.4.0-184-generic 2020-07-02T15:16:29.150Z Container runtime: kube 2020-07-02T15:16:29.150Z Base image: Red Hat Enterprise Linux 8.1 (Ootpa) 2020-07-02T15:16:29.150Z Running as user ID 1001 with primary group 0 2020-07-02T15:16:29.150Z Capabilities: none 2020-07-02T15:16:29.150Z seccomp enforcing mode: disabled 2020-07-02T15:16:29.150Z Process security attributes: docker-default (enforce) 2020-07-02T15:16:29.150Z Detected 'nfs4' volume mounted to /mnt/mqm 2020-07-02T15:16:29.150Z Detected 'nfs4' volume mounted to /mnt/mqm-log 2020-07-02T15:16:29.150Z Detected 'nfs4' volume mounted to /mnt/mqm-data 2020-07-02T15:16:29.150Z Multi-instance queue manager: enabled 2020-07-02T15:16:29.288Z Using queue manager name: QMGR01 2020-07-02T15:16:29.356Z Created directory structure under /var/mqm 2020-07-02T15:16:29.356Z Image created: 2020-03-31T06:57:13+00:00 2020-07-02T15:16:29.356Z Image tag: ibm-mqadvanced-server-dev:9.1.5.0-r1-amd64 2020-07-02T15:16:29.374Z MQ version: 9.1.5.0 2020-07-02T15:16:29.374Z MQ level: p915-ifix-L200325.DE 2020-07-02T15:16:29.374Z MQ license: Developer 2020-07-02T15:16:31.850Z Creating queue manager QMGR01 2020-07-02T15:16:31.850Z Starting web server **2020-07-02T15:16:31.947Z Error 2 creating queue manager: AMQ6239E: Permission denied attempting to access filesystem location '/mnt/mqm-data/qmgrs/QMGR01'. AMQ7002E: An error occurred manipulating a file.

2020-07-02T15:16:31.948Z /opt/mqm/bin/crtmqm: exit status 2**

Jul 02 '20 15:07 victorpaulo

It looks like UID 1001 isn't able to access the files on the mount points. If you run the container with environment variable DEBUG=false, then the container will print out the permissions of the files involved, which might help. You can do this from Helm by setting the value --set debug=true.

With NFS, sometimes you'll get a specific GID which has write permissions, in which case you need to inject the GID into the container. You can do that in Helm using the values security.context.fsGroup or security.context.supplementalGroups. These settings map onto the Kubernetes security context settings described here: https://v1-17.docs.kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#podsecuritycontext-v1-core

Jul 02 '20 15:07 arthurbarr

Hi, thanks for your reply, I've set --set debug=true and the log output is available below, thanks;

-------- LOG OUTPUT -----------

2020-07-04T08:25:45.535Z CPU architecture: amd64 2020-07-04T08:25:45.535Z Linux kernel version: 4.4.0-184-generic 2020-07-04T08:25:45.535Z Container runtime: kube 2020-07-04T08:25:45.536Z Base image: Red Hat Enterprise Linux 8.1 (Ootpa) 2020-07-04T08:25:45.536Z Running as user ID 1001 with primary group 0 2020-07-04T08:25:45.536Z Capabilities: none 2020-07-04T08:25:45.536Z seccomp enforcing mode: disabled 2020-07-04T08:25:45.536Z Process security attributes: docker-default (enforce) 2020-07-04T08:25:45.536Z Detected 'nfs4' volume mounted to /mnt/mqm-log 2020-07-04T08:25:45.536Z Detected 'nfs4' volume mounted to /mnt/mqm-data 2020-07-04T08:25:45.536Z Detected 'nfs4' volume mounted to /mnt/mqm 2020-07-04T08:25:45.536Z Multi-instance queue manager: enabled 2020-07-04T08:25:45.651Z Using queue manager name: QMGR01 2020-07-04T08:25:45.652Z --- Start Diagnostics --- 2020-07-04T08:25:45.656Z /mnt/: total 12 drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-data drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-log

2020-07-04T08:25:45.710Z /mnt/mqm: total 12 drwxrwsrwx 13 1000 1000 4096 Jul 4 07:58 data drwxrwxrwx 2 1000 1000 4096 Jul 4 07:58 log drwxrwxrwx 2 1000 1000 4096 Jul 4 08:25 qmgrs

2020-07-04T08:25:45.713Z /mnt/mqm/data: total 56 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 config drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 conv drwxrwsrwx 2 1000 1000 4096 Jul 4 08:25 errors drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits64 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 log -rwxrwxrwx 1 1000 1000 571 Jul 4 07:58 mqclient.ini drwxrwsrwx 5 1000 1000 4096 Jul 4 07:58 mqft -rwxrwxrwx 1 1000 1000 1288 Jul 4 07:58 mqs.ini drwxrwsrwx 3 1000 1000 4096 Jul 4 08:25 qmgrs -rwxrwxrwx 1 1000 1000 1941 Jul 4 07:58 service.env drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 sockets drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 trace drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 web

2020-07-04T08:25:45.716Z /mnt/mqm-log/log: total 0

2020-07-04T08:25:45.719Z /mnt/mqm-data/qmgrs: total 0

2020-07-04T08:25:45.721Z /var/mqm: lrwxrwxrwx 1 root root 13 Mar 31 06:58 /var/mqm -> /mnt/mqm/data

2020-07-04T08:25:45.726Z /var/mqm/errors: total 1388 -rw-rw---- 1 1001 1000 221386 Jul 4 08:25 AMQ76.0.FDC -rwxrwxrwx 1 1000 1000 72151 Jul 4 07:58 AMQ77.0.FDC -rwxrwxrwx 1 1000 1000 72108 Jul 4 07:59 AMQ78.0.FDC -rw-rw---- 1 1001 1000 223759 Jul 4 08:24 AMQ78.1.FDC -rw-rw---- 1 1001 1000 222759 Jul 4 08:25 AMQ78.2.FDC -rw-rw---- 1 1001 1000 223546 Jul 4 08:25 AMQ78.3.FDC -rw-rw---- 1 1001 1000 222157 Jul 4 08:23 AMQ79.0.FDC -rwxrwxrwx 1 1000 1000 71805 Jul 4 07:58 AMQ84.0.FDC -rwxrwxrwx 1 1000 1000 31569 Jul 4 08:25 AMQERR01.LOG -rwxrwxrwx 1 1000 1000 19318 Jul 4 08:25 AMQERR01.json -rwxrwxrwx 1 1000 1000 0 Jul 4 08:00 AMQERR01.root.LOG -rw-rw-r-- 1 nobody 1000 0 Jul 4 08:19 AMQERR01.root.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR02.LOG -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR03.LOG

2020-07-04T08:25:45.728Z /etc/mqm: total 32 -rw-r----- 1 1001 root 2392 Jul 4 08:25 10-dev.mqsc -rw-r--r-- 1 1001 root 2401 Mar 31 06:53 10-dev.mqsc.tpl -rw-r--r-- 1 1001 root 745 Mar 31 06:53 15-tls.mqsc.tpl -rw-r--r-- 1 1001 root 803 Mar 31 06:53 20-dev-tls.mqsc.tpl -rw-r--r-- 1 1001 root 3842 Mar 31 06:53 admin.json.tpl -rw-rw---- 1 1001 root 132 Jul 4 08:25 mq.htpasswd -rw-r--r-- 1 1001 root 269 Mar 31 06:53 qm-service-component.ini drwxrwsr-x 1 1001 root 4096 Mar 31 06:59 web

2020-07-04T08:25:45.747Z ffstsummary: AMQ84.0.FDC 2020/07/04 07:58:42.423177 Installation1 crtmqm 84 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ77.0.FDC 2020/07/04 07:58:45.526094 Installation1 crtmqm 77 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ78.0.FDC 2020/07/04 07:59:11.153832 Installation1 crtmqm 78 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ79.0.FDC 2020/07/04 08:23:30.659490 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:34.830032 Installation1 crtmqm 79 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:38.635758 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:06.520440 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:10.536023 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:15.913680 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:54.752931 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:59.748959 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:25:04.119748 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.648496 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.723427 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.819266 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.829916 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.950015 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.970586 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK

2020-07-04T08:25:45.747Z --- End Diagnostics --- 2020-07-04T08:25:45.763Z Warning creating directory structure: AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/config' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/conv' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/conv/table' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/conv/table/ccsid.tbl' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/conv/table/ccsid_part2.tbl' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR01.LOG' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR02.LOG' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR03.LOG' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR01.json' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0' error '1'. AMQ6245E: Error executing system call 'chmod 660' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0/Enqueue.lck' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/log' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/qmgrs' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/qmgrs/@SYSTEM' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits64' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/mqs.ini' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/mqclient.ini' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/service.env' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/mqft' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/mqft/config' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/mqft/installations' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/web' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/web/installations' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0/Installation1/Trace.shm' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits64/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1/servers' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb/logs' error '1'. AMQ6245E: Error executing system call 'chmod 660' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb/server.xml' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb/jvm.options' error '1'.

2020-07-04T08:25:45.764Z Created directory structure under /var/mqm 2020-07-04T08:25:45.764Z --- Start Diagnostics --- 2020-07-04T08:25:45.810Z /mnt/: total 12 drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-data drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-log

2020-07-04T08:25:45.814Z /mnt/mqm: total 12 drwxrwsrwx 13 1000 1000 4096 Jul 4 07:58 data drwxrwxrwx 2 1000 1000 4096 Jul 4 07:58 log drwxrwxrwx 2 1000 1000 4096 Jul 4 08:25 qmgrs

2020-07-04T08:25:45.817Z /mnt/mqm/data: total 56 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 config drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 conv drwxrwsrwx 2 1000 1000 4096 Jul 4 08:25 errors drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits64 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 log -rwxrwxrwx 1 1000 1000 571 Jul 4 07:58 mqclient.ini drwxrwsrwx 5 1000 1000 4096 Jul 4 07:58 mqft -rwxrwxrwx 1 1000 1000 1288 Jul 4 07:58 mqs.ini drwxrwsrwx 3 1000 1000 4096 Jul 4 08:25 qmgrs -rwxrwxrwx 1 1000 1000 1941 Jul 4 07:58 service.env drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 sockets drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 trace drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 web

2020-07-04T08:25:45.821Z /mnt/mqm-log/log: total 0

2020-07-04T08:25:45.824Z /mnt/mqm-data/qmgrs: total 0

2020-07-04T08:25:45.826Z /var/mqm: lrwxrwxrwx 1 root root 13 Mar 31 06:58 /var/mqm -> /mnt/mqm/data

2020-07-04T08:25:45.829Z /var/mqm/errors: total 1388 -rw-rw---- 1 1001 1000 221386 Jul 4 08:25 AMQ76.0.FDC -rwxrwxrwx 1 1000 1000 72151 Jul 4 07:58 AMQ77.0.FDC -rwxrwxrwx 1 1000 1000 72108 Jul 4 07:59 AMQ78.0.FDC -rw-rw---- 1 1001 1000 223759 Jul 4 08:24 AMQ78.1.FDC -rw-rw---- 1 1001 1000 222759 Jul 4 08:25 AMQ78.2.FDC -rw-rw---- 1 1001 1000 223546 Jul 4 08:25 AMQ78.3.FDC -rw-rw---- 1 1001 1000 222157 Jul 4 08:23 AMQ79.0.FDC -rwxrwxrwx 1 1000 1000 71805 Jul 4 07:58 AMQ84.0.FDC -rwxrwxrwx 1 1000 1000 31569 Jul 4 08:25 AMQERR01.LOG -rwxrwxrwx 1 1000 1000 19318 Jul 4 08:25 AMQERR01.json -rwxrwxrwx 1 1000 1000 0 Jul 4 08:00 AMQERR01.root.LOG -rw-rw-r-- 1 nobody 1000 0 Jul 4 08:19 AMQERR01.root.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR02.LOG -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR03.LOG

2020-07-04T08:25:45.832Z /etc/mqm: total 32 -rw-r----- 1 1001 root 2392 Jul 4 08:25 10-dev.mqsc -rw-r--r-- 1 1001 root 2401 Mar 31 06:53 10-dev.mqsc.tpl -rw-r--r-- 1 1001 root 745 Mar 31 06:53 15-tls.mqsc.tpl -rw-r--r-- 1 1001 root 803 Mar 31 06:53 20-dev-tls.mqsc.tpl -rw-r--r-- 1 1001 root 3842 Mar 31 06:53 admin.json.tpl -rw-rw---- 1 1001 root 132 Jul 4 08:25 mq.htpasswd -rw-r--r-- 1 1001 root 269 Mar 31 06:53 qm-service-component.ini drwxrwsr-x 1 1001 root 4096 Mar 31 06:59 web

2020-07-04T08:25:45.849Z ffstsummary: AMQ84.0.FDC 2020/07/04 07:58:42.423177 Installation1 crtmqm 84 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ77.0.FDC 2020/07/04 07:58:45.526094 Installation1 crtmqm 77 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ78.0.FDC 2020/07/04 07:59:11.153832 Installation1 crtmqm 78 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ79.0.FDC 2020/07/04 08:23:30.659490 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:34.830032 Installation1 crtmqm 79 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:38.635758 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:06.520440 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:10.536023 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:15.913680 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:54.752931 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:59.748959 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:25:04.119748 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.648496 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.723427 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.819266 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.829916 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.950015 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.970586 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK

2020-07-04T08:25:45.849Z --- End Diagnostics --- 2020-07-04T08:25:45.849Z Image created: 2020-03-31T06:57:13+00:00 2020-07-04T08:25:45.849Z Image tag: ibm-mqadvanced-server-dev:9.1.5.0-r1-amd64 2020-07-04T08:25:45.917Z MQ version: 9.1.5.0 2020-07-04T08:25:45.917Z MQ level: p915-ifix-L200325.DE 2020-07-04T08:25:45.917Z MQ license: Developer 2020-07-04T08:25:48.360Z Creating queue manager QMGR01 2020-07-04T08:25:48.361Z Starting web server 2020-07-04T08:25:49.018Z Error 71 creating queue manager: Permission denied attempting to access an INI file.

2020-07-04T08:25:49.018Z Writing termination message: /opt/mqm/bin/crtmqm: exit status 71 2020-07-04T08:25:49.018Z /opt/mqm/bin/crtmqm: exit status 71 2020-07-04T08:25:49.018Z --- Start Diagnostics --- 2020-07-04T08:25:49.022Z /mnt/: total 12 drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-data drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-log

2020-07-04T08:25:49.025Z /mnt/mqm: total 12 drwxrwsrwx 13 1000 1000 4096 Jul 4 07:58 data drwxrwxrwx 2 1000 1000 4096 Jul 4 07:58 log drwxrwxrwx 2 1000 1000 4096 Jul 4 08:25 qmgrs

2020-07-04T08:25:49.109Z /mnt/mqm/data: total 56 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 config drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 conv drwxrwsrwx 2 1000 1000 4096 Jul 4 08:25 errors drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits64 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 log -rwxrwxrwx 1 1000 1000 571 Jul 4 07:58 mqclient.ini drwxrwsrwx 5 1000 1000 4096 Jul 4 07:58 mqft -rwxrwxrwx 1 1000 1000 1288 Jul 4 07:58 mqs.ini drwxrwsrwx 3 1000 1000 4096 Jul 4 08:25 qmgrs -rwxrwxrwx 1 1000 1000 1941 Jul 4 07:58 service.env drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 sockets drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 trace drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 web

2020-07-04T08:25:49.115Z /mnt/mqm-log/log: total 0

2020-07-04T08:25:49.119Z /mnt/mqm-data/qmgrs: total 0

2020-07-04T08:25:49.121Z /var/mqm: lrwxrwxrwx 1 root root 13 Mar 31 06:58 /var/mqm -> /mnt/mqm/data

2020-07-04T08:25:49.127Z /var/mqm/errors: total 1616 -rw-rw---- 1 1001 1000 221386 Jul 4 08:25 AMQ76.0.FDC -rw-rw---- 1 1001 1000 221233 Jul 4 08:25 AMQ76.1.FDC -rwxrwxrwx 1 1000 1000 72151 Jul 4 07:58 AMQ77.0.FDC -rwxrwxrwx 1 1000 1000 72108 Jul 4 07:59 AMQ78.0.FDC -rw-rw---- 1 1001 1000 223759 Jul 4 08:24 AMQ78.1.FDC -rw-rw---- 1 1001 1000 222759 Jul 4 08:25 AMQ78.2.FDC -rw-rw---- 1 1001 1000 223546 Jul 4 08:25 AMQ78.3.FDC -rw-rw---- 1 1001 1000 222157 Jul 4 08:23 AMQ79.0.FDC -rwxrwxrwx 1 1000 1000 71805 Jul 4 07:58 AMQ84.0.FDC -rwxrwxrwx 1 1000 1000 36426 Jul 4 08:25 AMQERR01.LOG -rwxrwxrwx 1 1000 1000 22402 Jul 4 08:25 AMQERR01.json -rwxrwxrwx 1 1000 1000 0 Jul 4 08:00 AMQERR01.root.LOG -rw-rw-r-- 1 nobody 1000 0 Jul 4 08:19 AMQERR01.root.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR02.LOG -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR03.LOG

2020-07-04T08:25:49.213Z /etc/mqm: total 36 -rw-r----- 1 1001 root 2392 Jul 4 08:25 10-dev.mqsc -rw-r--r-- 1 1001 root 2401 Mar 31 06:53 10-dev.mqsc.tpl -rw-r----- 1 1001 root 732 Jul 4 08:25 15-tls.mqsc -rw-r--r-- 1 1001 root 745 Mar 31 06:53 15-tls.mqsc.tpl -rw-r--r-- 1 1001 root 803 Mar 31 06:53 20-dev-tls.mqsc.tpl -rw-r--r-- 1 1001 root 3842 Mar 31 06:53 admin.json.tpl -rw-rw---- 1 1001 root 132 Jul 4 08:25 mq.htpasswd -rw-r--r-- 1 1001 root 269 Mar 31 06:53 qm-service-component.ini drwxrwsr-x 1 1001 root 4096 Mar 31 06:59 web

2020-07-04T08:25:49.320Z ffstsummary: AMQ84.0.FDC 2020/07/04 07:58:42.423177 Installation1 crtmqm 84 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ77.0.FDC 2020/07/04 07:58:45.526094 Installation1 crtmqm 77 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ78.0.FDC 2020/07/04 07:59:11.153832 Installation1 crtmqm 78 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ79.0.FDC 2020/07/04 08:23:30.659490 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:34.830032 Installation1 crtmqm 79 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:38.635758 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:06.520440 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:10.536023 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:15.913680 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:54.752931 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:59.748959 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:25:04.119748 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.648496 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.723427 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.819266 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.829916 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.950015 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.970586 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.644019 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.724496 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.816441 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK

2020-07-04T08:25:49.320Z --- End Diagnostics ---

My NFS configuration:

I am using one VirtualBox VM provisioned by Vagrant, the NFS was configured in the following way:

Only one node, the same as where Kubernetes vanilla is running;

$ cat /etc/exports /data 172.28.128.3(rw,sync,no_subtree_check)

$ cat /etc/fstab 172.28.128.3:/data /data nfs rw,sync,hard,intr,nolock,noexec,noacl,nfsvers=3 1000 1000

User 1000 is vagrant, I also tried with root user (uid=0), the same results;

I also provided chmod -R 777 /data and also chown -R vagrant:vagrant /data; The same I did with root user with the same outcome;

--mount command sudo mount -t nfs 172.28.128.3:/data /data

Thanks;

Jul 04 '20 08:07 victorpaulo

Hi,

sorry, I did a new test after defining the parameter --set security.context.fsGroup=1000, please check the output below.

------- LOG output ------------

vagrant@ubuntu-xenial:~$ kubectl logs mq-ibm-mq-0 2020-07-04T09:09:18.522Z CPU architecture: amd64 2020-07-04T09:09:18.522Z Linux kernel version: 4.4.0-184-generic 2020-07-04T09:09:18.522Z Container runtime: kube 2020-07-04T09:09:18.522Z Base image: Red Hat Enterprise Linux 8.1 (Ootpa) 2020-07-04T09:09:18.522Z Running as user ID 1001 with primary group 0, and supplementary groups 1000 2020-07-04T09:09:18.522Z Capabilities: none 2020-07-04T09:09:18.522Z seccomp enforcing mode: disabled 2020-07-04T09:09:18.522Z Process security attributes: docker-default (enforce) 2020-07-04T09:09:18.523Z Detected 'nfs' volume mounted to /mnt/mqm 2020-07-04T09:09:18.523Z Detected 'nfs' volume mounted to /mnt/mqm-log 2020-07-04T09:09:18.523Z Detected 'nfs' volume mounted to /mnt/mqm-data 2020-07-04T09:09:18.523Z Multi-instance queue manager: enabled 2020-07-04T09:09:18.662Z Using queue manager name: QMGR01 2020-07-04T09:09:18.663Z --- Start Diagnostics --- 2020-07-04T09:09:18.665Z /mnt/: total 12 drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-data drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-log

2020-07-04T09:09:18.717Z /mnt/mqm: total 12 drwxrwsrwx 13 1000 1000 4096 Jul 4 09:08 data drwxrwxrwx 3 1000 1000 4096 Jul 4 09:08 log drwxrwxrwx 3 1000 1000 4096 Jul 4 09:08 qmgrs

2020-07-04T09:09:18.723Z /mnt/mqm/data: total 56 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 config drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 conv drwxrwsrwx 2 1000 1000 4096 Jul 4 09:08 errors drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits64 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 log -rwxrwxrwx 1 1000 1000 571 Jul 4 07:58 mqclient.ini drwxrwsrwx 5 1000 1000 4096 Jul 4 07:58 mqft -rwxrwxrwx 1 1000 1000 1498 Jul 4 09:08 mqs.ini drwxrwsrwx 4 1000 1000 4096 Jul 4 09:08 qmgrs -rwxrwxrwx 1 1000 1000 1941 Jul 4 07:58 service.env drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 sockets drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 trace drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 web

2020-07-04T09:09:18.726Z /mnt/mqm-log/log: total 4 drwxrws--- 3 1001 nobody 4096 Jul 4 09:08 QMGR01

2020-07-04T09:09:18.729Z /mnt/mqm-data/qmgrs: total 4 drwxrwsr-x 23 1001 nobody 4096 Jul 4 09:08 QMGR01

2020-07-04T09:09:18.731Z /var/mqm: lrwxrwxrwx 1 root root 13 Mar 31 06:58 /var/mqm -> /mnt/mqm/data

2020-07-04T09:09:18.737Z /var/mqm/errors: total 2716 -rw-rw---- 1 1001 1000 411899 Jul 4 09:08 AMQ114.0.FDC -rw-rw---- 1 1001 1000 221386 Jul 4 08:25 AMQ76.0.FDC -rw-rw---- 1 1001 1000 221233 Jul 4 08:25 AMQ76.1.FDC -rw-rw---- 1 1001 1000 222889 Jul 4 08:26 AMQ76.2.FDC -rw-rw---- 1 1001 1000 221848 Jul 4 08:28 AMQ76.3.FDC -rwxrwxrwx 1 1000 1000 72151 Jul 4 07:58 AMQ77.0.FDC -rwxrwxrwx 1 1000 1000 72108 Jul 4 07:59 AMQ78.0.FDC -rw-rw---- 1 1001 1000 223759 Jul 4 08:24 AMQ78.1.FDC -rw-rw---- 1 1001 1000 222759 Jul 4 08:25 AMQ78.2.FDC -rw-rw---- 1 1001 1000 223546 Jul 4 08:25 AMQ78.3.FDC -rw-rw---- 1 1001 1000 223317 Jul 4 08:27 AMQ78.4.FDC -rw-rw---- 1 1001 1000 222157 Jul 4 08:23 AMQ79.0.FDC -rwxrwxrwx 1 1000 1000 71805 Jul 4 07:58 AMQ84.0.FDC -rwxrwxrwx 1 1000 1000 56337 Jul 4 09:08 AMQERR01.LOG -rwxrwxrwx 1 1000 1000 35258 Jul 4 09:08 AMQERR01.json -rwxrwxrwx 1 1000 1000 0 Jul 4 08:00 AMQERR01.root.LOG -rw-rw-r-- 1 nobody 1000 0 Jul 4 08:19 AMQERR01.root.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR02.LOG -rw-rw-r-- 1 1001 1000 0 Jul 4 09:08 AMQERR02.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR03.LOG -rw-rw-r-- 1 1001 1000 0 Jul 4 09:08 AMQERR03.json

2020-07-04T09:09:18.739Z /etc/mqm: total 32 -rw-r----- 1 1001 root 2392 Jul 4 09:09 10-dev.mqsc -rw-r--r-- 1 1001 root 2401 Mar 31 06:53 10-dev.mqsc.tpl -rw-r--r-- 1 1001 root 745 Mar 31 06:53 15-tls.mqsc.tpl -rw-r--r-- 1 1001 root 803 Mar 31 06:53 20-dev-tls.mqsc.tpl -rw-r--r-- 1 1001 root 3842 Mar 31 06:53 admin.json.tpl -rw-rw---- 1 1001 root 132 Jul 4 09:09 mq.htpasswd -rw-r--r-- 1 1001 root 269 Mar 31 06:53 qm-service-component.ini drwxrwsr-x 1 1001 root 4096 Mar 31 06:59 web

2020-07-04T09:09:18.817Z ffstsummary: AMQ84.0.FDC 2020/07/04 07:58:42.423177 Installation1 crtmqm AMQ77.0.FDC 2020/07/04 07:58:45.526094 Installation1 crtmqm AMQ78.0.FDC 2020/07/04 07:59:11.153832 Installation1 crtmqm AMQ79.0.FDC 2020/07/04 08:23:30.659490 Installation1 crtmqm AMQ79.0.FDC 2020/07/04 08:23:34.830032 Installation1 crtmqm AMQ79.0.FDC 2020/07/04 08:23:38.635758 Installation1 crtmqm AMQ78.1.FDC 2020/07/04 08:24:06.520440 Installation1 crtmqm AMQ78.1.FDC 2020/07/04 08:24:10.536023 Installation1 crtmqm AMQ78.1.FDC 2020/07/04 08:24:15.913680 Installation1 crtmqm AMQ78.2.FDC 2020/07/04 08:24:54.752931 Installation1 crtmqm AMQ78.2.FDC 2020/07/04 08:24:59.748959 Installation1 crtmqm AMQ78.2.FDC 2020/07/04 08:25:04.119748 Installation1 crtmqm AMQ78.3.FDC 2020/07/04 08:25:21.648496 Installation1 crtmqm AMQ78.3.FDC 2020/07/04 08:25:21.723427 Installation1 crtmqm AMQ78.3.FDC 2020/07/04 08:25:21.819266 Installation1 crtmqm AMQ76.0.FDC 2020/07/04 08:25:25.829916 Installation1 crtmqm AMQ76.0.FDC 2020/07/04 08:25:25.950015 Installation1 crtmqm AMQ76.0.FDC 2020/07/04 08:25:25.970586 Installation1 crtmqm AMQ76.1.FDC 2020/07/04 08:25:48.644019 Installation1 crtmqm AMQ76.1.FDC 2020/07/04 08:25:48.724496 Installation1 crtmqm AMQ76.1.FDC 2020/07/04 08:25:48.816441 Installation1 crtmqm AMQ76.2.FDC 2020/07/04 08:26:17.427893 Installation1 crtmqm AMQ76.2.FDC 2020/07/04 08:26:17.446556 Installation1 crtmqm AMQ76.2.FDC 2020/07/04 08:26:17.530601 Installation1 crtmqm AMQ78.4.FDC 2020/07/04 08:27:09.548660 Installation1 crtmqm AMQ78.4.FDC 2020/07/04 08:27:09.642103 Installation1 crtmqm AMQ78.4.FDC 2020/07/04 08:27:09.816598 Installation1 crtmqm AMQ76.3.FDC 2020/07/04 08:28:43.236769 Installation1 crtmqm AMQ76.3.FDC 2020/07/04 08:28:43.319435 Installation1 crtmqm AMQ76.3.FDC 2020/07/04 08:28:43.414816 Installation1 crtmqm AMQ114.0.FDC 2020/07/04 09:08:34.340913 Installation1 AMQ114.0.FDC 2020/07/04 09:08:41.128183 Installation1 AMQ114.0.FDC 2020/07/04 09:08:48.718017 Installation1 84 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK 77 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK 78 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 79 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK amqzxma0 114 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK amqzxma0 114 1 ZX000040 zxcExecutionController xecU_W_INI_ACCESS_DENIED OK amqzxma0 114 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK

2020-07-04T09:09:18.817Z --- End Diagnostics --- 2020-07-04T09:09:18.850Z Warning creating directory structure: AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/config' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/conv' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/conv/table' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/conv/table/ccsid.tbl' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/conv/table/ccsid_part2.tbl' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR01.LOG' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR02.LOG' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR03.LOG' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/errors/AMQERR01.json' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0' error '1'. AMQ6245E: Error executing system call 'chmod 660' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0/Enqueue.lck' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/log' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/qmgrs' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/qmgrs/@SYSTEM' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits64' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/mqs.ini' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/mqclient.ini' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/service.env' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/mqft' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/mqft/config' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/mqft/installations' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/web' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/web/installations' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/sockets/@SYSTEM/qmgrlocl/mq-ibm-mq-0/Installation1/Trace.shm' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 2775' on file '/mnt/mqm/data/exits64/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1/servers' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb' error '1'. AMQ6245E: Error executing system call 'chmod 2770' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb/logs' error '1'. AMQ6245E: Error executing system call 'chmod 660' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb/server.xml' error '1'. AMQ6245E: Error executing system call 'chmod 664' on file '/mnt/mqm/data/web/installations/Installation1/servers/mqweb/jvm.options' error '1'.

2020-07-04T09:09:18.850Z Created directory structure under /var/mqm 2020-07-04T09:09:18.850Z --- Start Diagnostics --- 2020-07-04T09:09:18.853Z /mnt/: total 12 drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-data drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-log

2020-07-04T09:09:18.856Z /mnt/mqm: total 12 drwxrwsrwx 13 1000 1000 4096 Jul 4 09:08 data drwxrwxrwx 3 1000 1000 4096 Jul 4 09:08 log drwxrwxrwx 3 1000 1000 4096 Jul 4 09:08 qmgrs

2020-07-04T09:09:18.859Z /mnt/mqm/data: total 56 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 config drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 conv drwxrwsrwx 2 1000 1000 4096 Jul 4 09:08 errors drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits64 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 log -rwxrwxrwx 1 1000 1000 571 Jul 4 07:58 mqclient.ini drwxrwsrwx 5 1000 1000 4096 Jul 4 07:58 mqft -rwxrwxrwx 1 1000 1000 1498 Jul 4 09:08 mqs.ini drwxrwsrwx 4 1000 1000 4096 Jul 4 09:08 qmgrs -rwxrwxrwx 1 1000 1000 1941 Jul 4 07:58 service.env drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 sockets drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 trace drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 web

2020-07-04T09:09:18.863Z /mnt/mqm-log/log: total 4 drwxrws--- 3 1001 nobody 4096 Jul 4 09:08 QMGR01

2020-07-04T09:09:18.866Z /mnt/mqm-data/qmgrs: total 4 drwxrwsr-x 23 1001 nobody 4096 Jul 4 09:08 QMGR01

2020-07-04T09:09:18.868Z /var/mqm: lrwxrwxrwx 1 root root 13 Mar 31 06:58 /var/mqm -> /mnt/mqm/data

2020-07-04T09:09:18.871Z /var/mqm/errors: total 2716 -rw-rw---- 1 1001 1000 411899 Jul 4 09:08 AMQ114.0.FDC -rw-rw---- 1 1001 1000 221386 Jul 4 08:25 AMQ76.0.FDC -rw-rw---- 1 1001 1000 221233 Jul 4 08:25 AMQ76.1.FDC -rw-rw---- 1 1001 1000 222889 Jul 4 08:26 AMQ76.2.FDC -rw-rw---- 1 1001 1000 221848 Jul 4 08:28 AMQ76.3.FDC -rwxrwxrwx 1 1000 1000 72151 Jul 4 07:58 AMQ77.0.FDC -rwxrwxrwx 1 1000 1000 72108 Jul 4 07:59 AMQ78.0.FDC -rw-rw---- 1 1001 1000 223759 Jul 4 08:24 AMQ78.1.FDC -rw-rw---- 1 1001 1000 222759 Jul 4 08:25 AMQ78.2.FDC -rw-rw---- 1 1001 1000 223546 Jul 4 08:25 AMQ78.3.FDC -rw-rw---- 1 1001 1000 223317 Jul 4 08:27 AMQ78.4.FDC -rw-rw---- 1 1001 1000 222157 Jul 4 08:23 AMQ79.0.FDC -rwxrwxrwx 1 1000 1000 71805 Jul 4 07:58 AMQ84.0.FDC -rwxrwxrwx 1 1000 1000 56337 Jul 4 09:08 AMQERR01.LOG -rwxrwxrwx 1 1000 1000 35258 Jul 4 09:08 AMQERR01.json -rwxrwxrwx 1 1000 1000 0 Jul 4 08:00 AMQERR01.root.LOG -rw-rw-r-- 1 nobody 1000 0 Jul 4 08:19 AMQERR01.root.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR02.LOG -rw-rw-r-- 1 1001 1000 0 Jul 4 09:08 AMQERR02.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR03.LOG -rw-rw-r-- 1 1001 1000 0 Jul 4 09:08 AMQERR03.json

2020-07-04T09:09:18.874Z /etc/mqm: total 32 -rw-r----- 1 1001 root 2392 Jul 4 09:09 10-dev.mqsc -rw-r--r-- 1 1001 root 2401 Mar 31 06:53 10-dev.mqsc.tpl -rw-r--r-- 1 1001 root 745 Mar 31 06:53 15-tls.mqsc.tpl -rw-r--r-- 1 1001 root 803 Mar 31 06:53 20-dev-tls.mqsc.tpl -rw-r--r-- 1 1001 root 3842 Mar 31 06:53 admin.json.tpl -rw-rw---- 1 1001 root 132 Jul 4 09:09 mq.htpasswd -rw-r--r-- 1 1001 root 269 Mar 31 06:53 qm-service-component.ini drwxrwsr-x 1 1001 root 4096 Mar 31 06:59 web

2020-07-04T09:09:18.942Z ffstsummary: AMQ84.0.FDC 2020/07/04 07:58:42.423177 Installation1 crtmqm 84 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ77.0.FDC 2020/07/04 07:58:45.526094 Installation1 crtmqm 77 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ78.0.FDC 2020/07/04 07:59:11.153832 Installation1 crtmqm 78 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ79.0.FDC 2020/07/04 08:23:30.659490 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:34.830032 Installation1 crtmqm 79 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:38.635758 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:06.520440 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:10.536023 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:15.913680 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:54.752931 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:59.748959 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:25:04.119748 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.648496 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.723427 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.819266 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.829916 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.950015 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.970586 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.644019 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.724496 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.816441 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.2.FDC 2020/07/04 08:26:17.427893 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.2.FDC 2020/07/04 08:26:17.446556 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.2.FDC 2020/07/04 08:26:17.530601 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.4.FDC 2020/07/04 08:27:09.548660 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.4.FDC 2020/07/04 08:27:09.642103 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.4.FDC 2020/07/04 08:27:09.816598 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.3.FDC 2020/07/04 08:28:43.236769 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.3.FDC 2020/07/04 08:28:43.319435 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.3.FDC 2020/07/04 08:28:43.414816 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ114.0.FDC 2020/07/04 09:08:34.340913 Installation1 amqzxma0 114 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ114.0.FDC 2020/07/04 09:08:41.128183 Installation1 amqzxma0 114 1 ZX000040 zxcExecutionController xecU_W_INI_ACCESS_DENIED OK AMQ114.0.FDC 2020/07/04 09:08:48.718017 Installation1 amqzxma0 114 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK

2020-07-04T09:09:18.942Z --- End Diagnostics --- 2020-07-04T09:09:18.942Z Image created: 2020-03-31T06:57:13+00:00 2020-07-04T09:09:18.942Z Image tag: ibm-mqadvanced-server-dev:9.1.5.0-r1-amd64 2020-07-04T09:09:18.961Z MQ version: 9.1.5.0 2020-07-04T09:09:18.961Z MQ level: p915-ifix-L200325.DE 2020-07-04T09:09:18.961Z MQ license: Developer 2020-07-04T09:09:20.319Z Creating queue manager QMGR01 2020-07-04T09:09:20.319Z Starting web server 2020-07-04T09:09:20.335Z Detected existing queue manager QMGR01 2020-07-04T09:09:20.336Z Seeking offset 35258 in file /var/mqm/errors/AMQERR01.json 2020-07-04T09:09:20.346Z Removing existing ServiceComponent configuration 2020-07-04T09:09:20.346Z Seeking offset 2886 in file /mnt/mqm-data/qmgrs/QMGR01/errors/AMQERR01.json 2020-07-04T09:09:20.346Z Starting queue manager 2020-07-04T09:09:20.427Z Error 119 starting queue manager: AMQ7077E: You are not authorized to perform the requested operation.

2020-07-04T09:09:20.427Z Writing termination message: /opt/mqm/bin/strmqm: exit status 119 2020-07-04T09:09:20.427Z /opt/mqm/bin/strmqm: exit status 119 2020-07-04T09:09:20.427Z --- Start Diagnostics --- 2020-07-04T09:09:20.430Z /mnt/: total 12 drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-data drwxrwxrwx 5 1000 1000 4096 Jul 4 07:58 mqm-log

2020-07-04T09:09:20.433Z /mnt/mqm: total 12 drwxrwsrwx 13 1000 1000 4096 Jul 4 09:08 data drwxrwxrwx 3 1000 1000 4096 Jul 4 09:08 log drwxrwxrwx 3 1000 1000 4096 Jul 4 09:08 qmgrs

2020-07-04T09:09:20.436Z /mnt/mqm/data: total 56 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 config drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 conv drwxrwsrwx 2 1000 1000 4096 Jul 4 09:08 errors drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 exits64 drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 log -rwxrwxrwx 1 1000 1000 571 Jul 4 07:58 mqclient.ini drwxrwsrwx 5 1000 1000 4096 Jul 4 07:58 mqft -rwxrwxrwx 1 1000 1000 1498 Jul 4 09:08 mqs.ini drwxrwsrwx 4 1000 1000 4096 Jul 4 09:08 qmgrs -rwxrwxrwx 1 1000 1000 1941 Jul 4 07:58 service.env drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 sockets drwxrwsrwx 2 1000 1000 4096 Jul 4 07:58 trace drwxrwsrwx 3 1000 1000 4096 Jul 4 07:58 web

2020-07-04T09:09:20.515Z /mnt/mqm-log/log: total 4 drwxrws--- 3 1001 nobody 4096 Jul 4 09:08 QMGR01

2020-07-04T09:09:20.521Z /mnt/mqm-data/qmgrs: total 4 drwxrwsr-x 23 1001 nobody 4096 Jul 4 09:08 QMGR01

2020-07-04T09:09:20.523Z /var/mqm: lrwxrwxrwx 1 root root 13 Mar 31 06:58 /var/mqm -> /mnt/mqm/data

2020-07-04T09:09:20.526Z /var/mqm/errors: total 2716 -rw-rw---- 1 1001 1000 411899 Jul 4 09:08 AMQ114.0.FDC -rw-rw---- 1 1001 1000 221386 Jul 4 08:25 AMQ76.0.FDC -rw-rw---- 1 1001 1000 221233 Jul 4 08:25 AMQ76.1.FDC -rw-rw---- 1 1001 1000 222889 Jul 4 08:26 AMQ76.2.FDC -rw-rw---- 1 1001 1000 221848 Jul 4 08:28 AMQ76.3.FDC -rwxrwxrwx 1 1000 1000 72151 Jul 4 07:58 AMQ77.0.FDC -rwxrwxrwx 1 1000 1000 72108 Jul 4 07:59 AMQ78.0.FDC -rw-rw---- 1 1001 1000 223759 Jul 4 08:24 AMQ78.1.FDC -rw-rw---- 1 1001 1000 222759 Jul 4 08:25 AMQ78.2.FDC -rw-rw---- 1 1001 1000 223546 Jul 4 08:25 AMQ78.3.FDC -rw-rw---- 1 1001 1000 223317 Jul 4 08:27 AMQ78.4.FDC -rw-rw---- 1 1001 1000 222157 Jul 4 08:23 AMQ79.0.FDC -rwxrwxrwx 1 1000 1000 71805 Jul 4 07:58 AMQ84.0.FDC -rwxrwxrwx 1 1000 1000 56337 Jul 4 09:08 AMQERR01.LOG -rwxrwxrwx 1 1000 1000 35258 Jul 4 09:08 AMQERR01.json -rwxrwxrwx 1 1000 1000 0 Jul 4 08:00 AMQERR01.root.LOG -rw-rw-r-- 1 nobody 1000 0 Jul 4 08:19 AMQERR01.root.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR02.LOG -rw-rw-r-- 1 1001 1000 0 Jul 4 09:08 AMQERR02.json -rwxrwxrwx 1 1000 1000 0 Jul 4 07:58 AMQERR03.LOG -rw-rw-r-- 1 1001 1000 0 Jul 4 09:08 AMQERR03.json

2020-07-04T09:09:20.529Z /etc/mqm: total 36 -rw-r----- 1 1001 root 2392 Jul 4 09:09 10-dev.mqsc -rw-r--r-- 1 1001 root 2401 Mar 31 06:53 10-dev.mqsc.tpl -rw-r----- 1 1001 root 732 Jul 4 09:09 15-tls.mqsc -rw-r--r-- 1 1001 root 745 Mar 31 06:53 15-tls.mqsc.tpl -rw-r--r-- 1 1001 root 803 Mar 31 06:53 20-dev-tls.mqsc.tpl -rw-r--r-- 1 1001 root 3842 Mar 31 06:53 admin.json.tpl -rw-rw---- 1 1001 root 132 Jul 4 09:09 mq.htpasswd -rw-r--r-- 1 1001 root 269 Mar 31 06:53 qm-service-component.ini drwxrwsr-x 1 1001 root 4096 Mar 31 06:59 web

2020-07-04T09:09:20.632Z ffstsummary: AMQ84.0.FDC 2020/07/04 07:58:42.423177 Installation1 crtmqm 84 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ77.0.FDC 2020/07/04 07:58:45.526094 Installation1 crtmqm 77 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ78.0.FDC 2020/07/04 07:59:11.153832 Installation1 crtmqm 78 1 XC560030 xcsCreateDirectory xecF_E_UNEXPECTED_SYSTEM_RC OK AMQ79.0.FDC 2020/07/04 08:23:30.659490 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:34.830032 Installation1 crtmqm 79 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ79.0.FDC 2020/07/04 08:23:38.635758 Installation1 crtmqm 79 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:06.520440 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:10.536023 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.1.FDC 2020/07/04 08:24:15.913680 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:54.752931 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:24:59.748959 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.2.FDC 2020/07/04 08:25:04.119748 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.648496 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.723427 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.3.FDC 2020/07/04 08:25:21.819266 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.829916 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.950015 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.0.FDC 2020/07/04 08:25:25.970586 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.644019 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.724496 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.1.FDC 2020/07/04 08:25:48.816441 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.2.FDC 2020/07/04 08:26:17.427893 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.2.FDC 2020/07/04 08:26:17.446556 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.2.FDC 2020/07/04 08:26:17.530601 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.4.FDC 2020/07/04 08:27:09.548660 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ78.4.FDC 2020/07/04 08:27:09.642103 Installation1 crtmqm 78 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ78.4.FDC 2020/07/04 08:27:09.816598 Installation1 crtmqm 78 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.3.FDC 2020/07/04 08:28:43.236769 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ76.3.FDC 2020/07/04 08:28:43.319435 Installation1 crtmqm 76 1 ZT044001 zutDeleteQMStanza xecU_W_INI_ACCESS_DENIED OK AMQ76.3.FDC 2020/07/04 08:28:43.414816 Installation1 crtmqm 76 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ114.0.FDC 2020/07/04 09:08:34.340913 Installation1 amqzxma0 114 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK AMQ114.0.FDC 2020/07/04 09:08:41.128183 Installation1 amqzxma0 114 1 ZX000040 zxcExecutionController xecU_W_INI_ACCESS_DENIED OK AMQ114.0.FDC 2020/07/04 09:08:48.718017 Installation1 amqzxma0 114 1 XY019009 xufOpenIniEdit xecU_W_INI_ACCESS_DENIED OK

2020-07-04T09:09:20.632Z --- End Diagnostics --- 2020-07-04T09:09:20.632Z Cancel log mirroring 2020-07-04T09:09:20.632Z Waiting for log mirroring to complete 2020-07-04T09:09:20.836Z Context cancelled for mirroring /var/mqm/errors/AMQERR01.json 2020-07-04T09:09:20.836Z Context cancelled for mirroring /var/mqm/errors/AMQERR01.json 2020-07-04T09:09:20.836Z Shutting down mirror for /var/mqm/errors/AMQERR01.json 2020-07-04T09:09:20.836Z Finished monitoring /var/mqm/errors/AMQERR01.json 2020-07-04T09:09:20.918Z Context cancelled for mirroring /mnt/mqm-data/qmgrs/QMGR01/errors/AMQERR01.json 2020-07-04T09:09:20.918Z Context cancelled for mirroring /mnt/mqm-data/qmgrs/QMGR01/errors/AMQERR01.json 2020-07-04T09:09:20.918Z Shutting down mirror for /mnt/mqm-data/qmgrs/QMGR01/errors/AMQERR01.json 2020-07-04T09:09:20.918Z Finished monitoring /mnt/mqm-data/qmgrs/QMGR01/errors/AMQERR01.json

----------END LOG output $ kubectl get pods mq-ibm-mq-0 -o yaml

containerStatuses:

containerID: docker://e324ecc163cbb9b5608243c68352ee5c2c5ebe52cde98fc2fef9c35d0a2fa1fd image: ibmcom/mq:9.1.5.0-r1 imageID: docker-pullable://ibmcom/mq@sha256:08bb3063a7802bed9b49da0af63d87bb2ddd81aa631819ef122e2ad9031c86fa lastState: terminated: containerID: docker://e324ecc163cbb9b5608243c68352ee5c2c5ebe52cde98fc2fef9c35d0a2fa1fd exitCode: 1 finishedAt: "2020-07-04T09:15:07Z" message: '/opt/mqm/bin/strmqm: exit status 119' reason: Error startedAt: "2020-07-04T09:15:04Z" name: qmgr ready: false restartCount: 6 started: false state: waiting: message: back-off 5m0s restarting failed container=qmgr pod=mq-ibm-mq-0_default(2c988006-f00a-4ac5-b598-62e5ea7d9e88) reason: CrashLoopBackOff

Jul 04 '20 09:07 victorpaulo

I'm not sure what's going on here - it seems a bit unusual, and not something we've seen before. It could be that if you're using the same persistent volume for each of the above attempts, that the problem on the volume is persisting. So in the first instance, I'd make sure that this still fails with a fresh volume. If so, then I think we'll need to see the FDCs that are being generated on the volume. To get the FDCs, you will need to run another Pod using the same PersistentVolume, and then use kubectl cp to copy the FDC files out.

Jul 06 '20 13:07 arthurbarr

Hi Arthur, I was able to fix the previous issue (crashloopbackoff) by fixing my NFS configuration. Now I have a different error, not sure if I need to open a new issue or not.

The MQ container is in running state however failing in readiness probe (kubectl describe pod mq-ibm-mq-0): Readiness probe failed: dial tcp 127.0.0.1:1414: connect: connection refused

$ kubectl get pods NAME READY STATUS RESTARTS AGE mq-ibm-mq-0 0/1 Running 0 8m35s

I am able to run the same command as chkmqhealthy utility with a different outcome:

$ kubectl exec -it mq-ibm-mq-0 /bin/sh sh-4.4$ dspmq -n -m QMGR01 QMNAME(QMGR01) STATUS(RUNNING)

I think, due this problem I cannot scale the statefulset; $ kubectl scale statefulset mq-ibm-mq --replicas=3

//nothing happens after issuing the above command;

Thanks, Victor

Jul 13 '20 15:07 victorpaulo