scst
scst copied to clipboard
bvanassche
Oracle Linux 8
I posted this to the dist list but figured it's best to post here as well so all the details are in one place.
I built the scst packages in a VMWare VM of OL8 fully updated with latest UEK. Followed the instructions perfectly here: https://github.com/bvanassche/scst/wiki/1-Installation
Everything built perfectly with make rpm. Both the built VM and the bare-metal server have matching kernels.
Clean install of OL8. QLE2562 cards (driver 2.21, firmware 5.04.001). Reused scst.conf from previous CentOS 8 install on same server etc.
# uname -r
5.4.17-2102.204.4.4.el8uek.x86_64
# cat /etc/oracle-release
Oracle Linux Server release 8.4
I have tried the latest git clone on Github, 3.5.0 from SourceForge and the previous version of Orabuntu (he just updated it and I haven't tried it yet). All install ok with no errors but dmesg always reports the same failures. There is zero difference in configuration either via software (other than OS) or physically. I'm not aware of any firmware updates applied.
Per email from Bart, I tried the iommu=pt in the kernel command line. No impact. The driver being used for the card is qla2x00t.
Per a post from Vlad, CTIO with error status 0x10 received shows hardware failure but it was just working before the change of the OS.
I have attached the console output from the build so maybe Bart or Vlad can spot something off in there. I did see some warnings but everything seemed to complete.
This is an inventory of the server so you can see what's all on there.
FRMW, Firmware for - Disk 0 in Backplane 1 of PERC H710 Mini Controller 0 ( Version : FEFE )
6. FRMW, Firmware for - Disk 0 in External Enclosure 1 on Connector 0 of PERC H800 Adapter Controller 1 in Slot 6 ( Version : A228 )
...
40. FRMW, Firmware for - Disk 11 in Backplane 1 of PERC H710 Mini Controller 0 ( Version : A222 )
...
43. FRMW, PERC H710 Mini Controller 0 Firmware ( Version : 21.3.5-0002 )
44. FRMW, PERC H800 Adapter Controller 1 Firmware ( Version : 12.10.6-0001 )
45. FRMW, PowerVault MD1200-0 EMM-0 Firmware ( Version : 1.01 )
46. FRMW, PowerVault MD1200-0 EMM-1 Firmware ( Version : 1.01 )
47. FRMW, PowerVault MD1200-1 EMM-0 Firmware ( Version : 1.01 )
48. FRMW, PowerVault MD1200-1 EMM-1 Firmware ( Version : 1.01 )
49. FRMW, 12G SEP Firmware ( Version : 1.00 )
50. FRMW, 12G Backplane Expander FW (Firmware) ( Version : 1.07 )
...
55. FRMW, QLogic QLE2562 Adapter ( Version : 09.01.07 )
56. FRMW, QLogic QLE2562 Adapter ( Version : 09.01.07 )
57. FRMW, QLogic QLE2562 Adapter ( Version : 09.01.07 )
...
60. APAC, Dell 64 Bit uEFI Diagnostics, version 4247, 4247A1, 4247.2 ( Version : 4247A1 )
61. APAC, Dell OS Driver Pack, 15.07.07, A00 ( Version : 15.07.07 )
...
63. FRMW, System CPLD ( Version : 1.0.3 )
Below is the tell-all SCST report from dmesg
[ 1.739275] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 1.739441] qla2xxx_scst: module verification failed: signature and/or required key missing - tainting kernel
[ 1.740390] qla2xxx [0000:00:00.0]-0005:
[ 1.740653] qla2xxx [0000:41:00.0]-001d:
[ 1.741231] qla2xxx 0000:41:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 1.798198] scsi host1: qla2xxx
[ 1.800060] qla2xxx [0000:41:00.0]-00fb:1:
[ 1.800068] qla2xxx [0000:41:00.0]-00fc:1:
[ 1.800214] qla2xxx [0000:41:00.1]-001d:
[ 1.800646] qla2xxx 0000:41:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 1.862184] scsi host2: qla2xxx
[ 1.864525] qla2xxx [0000:41:00.1]-00fb:2:
[ 1.864535] qla2xxx [0000:41:00.1]-00fc:2:
[ 1.864758] qla2xxx [0000:44:00.0]-001d:
[ 1.865316] qla2xxx 0000:44:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 1.925248] scsi host4: qla2xxx
[ 1.926954] qla2xxx [0000:44:00.0]-00fb:4:
[ 1.926962] qla2xxx [0000:44:00.0]-00fc:4:
[ 1.927147] qla2xxx [0000:44:00.1]-001d:
[ 1.927541] qla2xxx 0000:44:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 1.986898] scsi host5: qla2xxx
[ 1.988538] qla2xxx [0000:44:00.1]-00fb:5:
[ 1.988546] qla2xxx [0000:44:00.1]-00fc:5:
[ 1.988700] qla2xxx [0000:45:00.0]-001d:
[ 1.989082] qla2xxx 0000:45:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 2.051669] scsi host6: qla2xxx
[ 2.053618] qla2xxx [0000:45:00.0]-00fb:6:
[ 2.053625] qla2xxx [0000:45:00.0]-00fc:6:
[ 2.053819] qla2xxx [0000:45:00.1]-001d:
[ 2.054223] qla2xxx 0000:45:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.114091] scsi host7: qla2xxx
[ 2.115928] qla2xxx [0000:45:00.1]-00fb:7:
[ 2.115936] qla2xxx [0000:45:00.1]-00fc:7:
[ 2.116118] qla2xxx [0000:4a:00.0]-001d:
[ 2.116522] qla2xxx 0000:4a:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 2.173758] scsi host8: qla2xxx
[ 2.175927] qla2xxx [0000:4a:00.0]-00fb:8:
[ 2.175934] qla2xxx [0000:4a:00.0]-00fc:8:
[ 2.176099] qla2xxx [0000:4a:00.1]-001d:
[ 2.176551] qla2xxx 0000:4a:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.233552] qla2xxx [0000:44:00.0]-505f:4:
[ 2.234056] scsi host9: qla2xxx
[ 2.236144] qla2xxx [0000:4a:00.1]-00fb:9:
[ 2.236151] qla2xxx [0000:4a:00.1]-00fc:9:
[ 2.295032] qla2xxx [0000:44:00.1]-505f:5:
[ 2.359724] qla2xxx [0000:45:00.0]-505f:6:
[ 2.422038] qla2xxx [0000:45:00.1]-505f:7:
[ 10.692554] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 10.692560] Error: Driver 'qla2xxx' is already registered, aborting...
[ 10.692561] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 10.748534] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 10.748540] Error: Driver 'qla2xxx' is already registered, aborting...
[ 10.748541] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 10.854295] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 10.854299] Error: Driver 'qla2xxx' is already registered, aborting...
[ 10.854300] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 10.895340] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 10.895343] Error: Driver 'qla2xxx' is already registered, aborting...
[ 10.895344] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 10.964338] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 10.964344] Error: Driver 'qla2xxx' is already registered, aborting...
[ 10.964345] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 11.024391] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 11.024397] Error: Driver 'qla2xxx' is already registered, aborting...
[ 11.024398] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 11.079943] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 11.079951] Error: Driver 'qla2xxx' is already registered, aborting...
[ 11.079953] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 11.122628] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.103-k.
[ 11.122631] Error: Driver 'qla2xxx' is already registered, aborting...
[ 11.122632] qla2xxx [0000:00:00.0]-0006: : pci_register_driver failed...ret=-16 Failing load!.
[ 24.040347] qla2xxx [0000:41:00.0]-8038:1:
[ 24.104376] qla2xxx [0000:41:00.1]-8038:2:
[ 24.360349] qla2xxx [0000:4a:00.0]-8038:8:
[ 24.424326] qla2xxx [0000:4a:00.1]-8038:9:
[ 308.601590] [3546]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre
[ 308.601645] [3546]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully
[ 308.601649] [3546]: scst: Target template qla2x00t registered successfully
[ 308.601673] [3546]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully
[ 308.601692] [3546]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully
[ 308.601711] [3546]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully
[ 308.601727] [3546]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully
[ 308.601744] [3546]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully
[ 308.601760] [3546]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully
[ 308.601777] [3546]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully
[ 308.601793] [3546]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully
[ 308.875894] [3505]: qla2x00t(1): Enabling target mode
[ 308.875930] qla2xxx [0000:41:00.0]-00af:1:
[ 308.886299] qla2xxx [0000:41:00.0]-1073:1:
[ 329.083254] qla2xxx [0000:41:00.0]-8038:1:
[ 329.341864] [3505]: qla2x00t(2): Enabling target mode
[ 329.341910] qla2xxx [0000:41:00.1]-00af:2:
[ 329.351788] qla2xxx [0000:41:00.1]-1073:2:
[ 349.554946] qla2xxx [0000:41:00.1]-8038:2:
[ 349.821627] [3505]: qla2x00t(8): Enabling target mode
[ 349.821685] qla2xxx [0000:4a:00.0]-00af:8:
[ 349.832074] qla2xxx [0000:4a:00.0]-1073:8:
[ 370.034707] qla2xxx [0000:4a:00.0]-8038:8:
[ 370.301227] [3505]: qla2x00t(9): Enabling target mode
[ 370.301272] qla2xxx [0000:4a:00.1]-00af:9:
[ 370.311229] qla2xxx [0000:4a:00.1]-1073:9:
[ 390.514383] qla2xxx [0000:4a:00.1]-8038:9:
[ 390.781110] [3505]: qla2x00t(4): Enabling target mode
[ 390.781166] [3505]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added
[ 390.781173] qla2xxx [0000:44:00.0]-00af:4:
[ 390.781920] [617]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 390.793195] qla2xxx [0000:44:00.0]-1073:4:
[ 391.099300] [0]: qla2x00t(4): LIP reset occurred
[ 391.136536] [0]: qla2x00t(4): LIP occurred
[ 391.139392] [0]: qla2x00t(4): Loop up occurred
[ 391.139825] qla2xxx [0000:44:00.0]-505f:4:
[ 391.338403] [617]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2
[ 391.341490] [628]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 391.349152] [0]: ***ERROR***: qla2x00t(4): CTIO with error status 0x10 received (state 3, scst_cmd 0000000007f1eec9, op INQUIRY)
[ 391.804701] [3505]: qla2x00t(5): Enabling target mode
[ 391.804742] [3505]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 391.804818] qla2xxx [0000:44:00.1]-00af:5:
[ 391.805021] [623]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 391.816295] qla2xxx [0000:44:00.1]-1073:5:
[ 392.122744] [0]: qla2x00t(5): LIP reset occurred
[ 392.157618] [0]: qla2x00t(5): LIP occurred
[ 392.160474] [0]: qla2x00t(5): Loop up occurred
[ 392.160909] qla2xxx [0000:44:00.1]-505f:5:
[ 392.362554] [623]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2
[ 392.366021] [628]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 392.372347] [0]: ***ERROR***: qla2x00t(5): CTIO with error status 0x10 received (state 3, scst_cmd 00000000e67caa97, op INQUIRY)
[ 392.828814] [3505]: qla2x00t(6): Enabling target mode
[ 392.828854] [3505]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 392.828930] qla2xxx [0000:45:00.0]-00af:6:
[ 392.829679] [638]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 392.840966] qla2xxx [0000:45:00.0]-1073:6:
[ 393.147181] [0]: qla2x00t(6): LIP reset occurred
[ 393.182105] [0]: qla2x00t(6): LIP occurred
[ 393.184958] [0]: qla2x00t(6): Loop up occurred
[ 393.185394] qla2xxx [0000:45:00.0]-505f:6:
[ 393.386378] [638]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2
[ 393.389381] [2671]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 393.396108] [0]: ***ERROR***: qla2x00t(6): CTIO with error status 0x10 received (state 3, scst_cmd 00000000f0e5aeea, op INQUIRY)
[ 393.852954] [3505]: qla2x00t(7): Enabling target mode
[ 393.852991] [3505]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 393.852997] qla2xxx [0000:45:00.1]-00af:7:
[ 393.853208] [646]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 393.864501] qla2xxx [0000:45:00.1]-1073:7:
[ 394.170619] [0]: qla2x00t(7): LIP reset occurred
[ 394.205518] [0]: qla2x00t(7): LIP occurred
[ 394.208375] [0]: qla2x00t(7): Loop up occurred
[ 394.208807] qla2xxx [0000:45:00.1]-505f:7:
[ 394.410366] [646]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2
[ 394.413460] [627]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 394.420782] [0]: ***ERROR***: qla2x00t(7): CTIO with error status 0x10 received (state 3, scst_cmd 00000000b149ff6c, op INQUIRY)
[ 451.129055] [628]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 455.224562] [628]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 455.224621] [2671]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 455.225005] [627]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
While waiting, I completely wiped the server and reinstalled the OS a 4th time. Rebuilt all the packages and then scp'd to the server and installed. No change. Still getting the failures.
# dmesg | grep qla
[ 1.751783] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 1.751784] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 1.766972] qla2xxx_scst: module verification failed: signature and/or required key missing - tainting kernel
[ 1.768385] qla2xxx [0000:00:00.0]-0005:
[ 1.768566] qla2xxx [0000:41:00.0]-001d:
[ 1.768995] qla2xxx 0000:41:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 1.825528] scsi host1: qla2xxx
[ 1.827349] qla2xxx [0000:41:00.0]-00fb:1:
[ 1.827357] qla2xxx [0000:41:00.0]-00fc:1:
[ 1.827513] qla2xxx [0000:41:00.1]-001d:
[ 1.827935] qla2xxx 0000:41:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 1.884096] scsi host2: qla2xxx
[ 1.885827] qla2xxx [0000:41:00.1]-00fb:2:
[ 1.885841] qla2xxx [0000:41:00.1]-00fc:2:
[ 1.886048] qla2xxx [0000:44:00.0]-001d:
[ 1.886456] qla2xxx 0000:44:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 1.946709] scsi host4: qla2xxx
[ 1.948649] qla2xxx [0000:44:00.0]-00fb:4:
[ 1.948658] qla2xxx [0000:44:00.0]-00fc:4:
[ 1.948857] qla2xxx [0000:44:00.1]-001d:
[ 1.949253] qla2xxx 0000:44:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.009284] scsi host5: qla2xxx
[ 2.011083] qla2xxx [0000:44:00.1]-00fb:5:
[ 2.011091] qla2xxx [0000:44:00.1]-00fc:5:
[ 2.011187] qla2xxx [0000:45:00.0]-001d:
[ 2.011596] qla2xxx 0000:45:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 2.073465] scsi host6: qla2xxx
[ 2.075203] qla2xxx [0000:45:00.0]-00fb:6:
[ 2.075212] qla2xxx [0000:45:00.0]-00fc:6:
[ 2.075403] qla2xxx [0000:45:00.1]-001d:
[ 2.075803] qla2xxx 0000:45:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.135463] scsi host7: qla2xxx
[ 2.137170] qla2xxx [0000:45:00.1]-00fb:7:
[ 2.137177] qla2xxx [0000:45:00.1]-00fc:7:
[ 2.137339] qla2xxx [0000:4a:00.0]-001d:
[ 2.137750] qla2xxx 0000:4a:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 2.195357] scsi host8: qla2xxx
[ 2.197495] qla2xxx [0000:4a:00.0]-00fb:8:
[ 2.197501] qla2xxx [0000:4a:00.0]-00fc:8:
[ 2.197614] qla2xxx [0000:4a:00.1]-001d:
[ 2.198059] qla2xxx 0000:4a:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.254955] scsi host9: qla2xxx
[ 2.256981] qla2xxx [0000:44:00.0]-505f:4:
[ 2.257006] qla2xxx [0000:4a:00.1]-00fb:9:
[ 2.257012] qla2xxx [0000:4a:00.1]-00fc:9:
[ 2.317328] qla2xxx [0000:44:00.1]-505f:5:
[ 2.381584] qla2xxx [0000:45:00.0]-505f:6:
[ 2.443586] qla2xxx [0000:45:00.1]-505f:7:
[ 24.040352] qla2xxx [0000:41:00.0]-8038:1:
[ 24.104403] qla2xxx [0000:41:00.1]-8038:2:
[ 24.424395] qla2xxx [0000:4a:00.0]-8038:8:
[ 24.488408] qla2xxx [0000:4a:00.1]-8038:9:
[ 289.388364] [2537]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre
[ 289.388419] [2537]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully
[ 289.388423] [2537]: scst: Target template qla2x00t registered successfully
[ 289.388450] [2537]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully
[ 289.388469] [2537]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully
[ 289.388492] [2537]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully
[ 289.388509] [2537]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully
[ 289.388526] [2537]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully
[ 289.388542] [2537]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully
[ 289.388558] [2537]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully
[ 289.388575] [2537]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully
[ 289.766163] [2496]: qla2x00t(1): Enabling target mode
[ 289.766203] qla2xxx [0000:41:00.0]-00af:1:
[ 289.776680] qla2xxx [0000:41:00.0]-1073:1:
[ 309.973664] qla2xxx [0000:41:00.0]-8038:1:
[ 310.272532] [2496]: qla2x00t(2): Enabling target mode
[ 310.272565] qla2xxx [0000:41:00.1]-00af:2:
[ 310.282409] qla2xxx [0000:41:00.1]-1073:2:
[ 330.485379] qla2xxx [0000:41:00.1]-8038:2:
[ 330.751826] [2496]: qla2x00t(8): Enabling target mode
[ 330.751859] qla2xxx [0000:4a:00.0]-00af:8:
[ 330.762200] qla2xxx [0000:4a:00.0]-1073:8:
[ 350.965078] qla2xxx [0000:4a:00.0]-8038:8:
[ 351.231807] [2496]: qla2x00t(9): Enabling target mode
[ 351.231838] qla2xxx [0000:4a:00.1]-00af:9:
[ 351.241674] qla2xxx [0000:4a:00.1]-1073:9:
[ 371.444813] qla2xxx [0000:4a:00.1]-8038:9:
[ 371.711363] [2496]: qla2x00t(4): Enabling target mode
[ 371.711414] [2496]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added
[ 371.711421] qla2xxx [0000:44:00.0]-00af:4:
[ 371.712174] [625]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 371.723483] qla2xxx [0000:44:00.0]-1073:4:
[ 372.029876] [0]: qla2x00t(4): LIP reset occurred
[ 372.064882] [0]: qla2x00t(4): LIP occurred
[ 372.067736] [0]: qla2x00t(4): Loop up occurred
[ 372.068172] qla2xxx [0000:44:00.0]-505f:4:
[ 372.268937] [625]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2
[ 372.272132] [43]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 372.278134] [0]: ***ERROR***: qla2x00t(4): CTIO with error status 0x10 received (state 3, scst_cmd 00000000afb4b219, op INQUIRY)
[ 372.735137] [2496]: qla2x00t(5): Enabling target mode
[ 372.735171] [2496]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 372.735178] qla2xxx [0000:44:00.1]-00af:5:
[ 372.735379] [635]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 372.746702] qla2xxx [0000:44:00.1]-1073:5:
[ 373.053467] [0]: qla2x00t(5): LIP reset occurred
[ 373.088351] [0]: qla2x00t(5): LIP occurred
[ 373.091209] [0]: qla2x00t(5): Loop up occurred
[ 373.091643] qla2xxx [0000:44:00.1]-505f:5:
[ 373.292932] [635]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2
[ 373.296163] [587]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 373.302127] [0]: ***ERROR***: qla2x00t(5): CTIO with error status 0x10 received (state 3, scst_cmd 00000000a3a373c8, op INQUIRY)
[ 373.759160] [2496]: qla2x00t(6): Enabling target mode
[ 373.759197] [2496]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 373.759230] qla2xxx [0000:45:00.0]-00af:6:
[ 373.759975] [643]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 373.771229] qla2xxx [0000:45:00.0]-1073:6:
[ 374.077823] [0]: qla2x00t(6): LIP reset occurred
[ 374.112679] [0]: qla2x00t(6): LIP occurred
[ 374.115535] [0]: qla2x00t(6): Loop up occurred
[ 374.115969] qla2xxx [0000:45:00.0]-505f:6:
[ 374.316890] [643]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2
[ 374.320124] [18]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 374.326542] [0]: ***ERROR***: qla2x00t(6): CTIO with error status 0x10 received (state 3, scst_cmd 00000000925792e1, op INQUIRY)
[ 374.783367] [2496]: qla2x00t(7): Enabling target mode
[ 374.783397] [2496]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 374.783446] qla2xxx [0000:45:00.1]-00af:7:
[ 374.783655] [647]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 374.794903] qla2xxx [0000:45:00.1]-1073:7:
[ 375.101154] [0]: qla2x00t(7): LIP reset occurred
[ 375.136017] [0]: qla2x00t(7): LIP occurred
[ 375.138870] [0]: qla2x00t(7): Loop up occurred
[ 375.139303] qla2xxx [0000:45:00.1]-505f:7:
[ 375.340874] [647]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2
[ 375.344102] [1111]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 375.351034] [0]: ***ERROR***: qla2x00t(7): CTIO with error status 0x10 received (state 3, scst_cmd 00000000c6bdeb32, op INQUIRY)
[ 435.578769] [43]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 435.578791] [1111]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 435.578814] [587]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 435.580036] [18]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
After messing around with this all day yesterday and today using process of elimination, I have found that scst is ONLY complaining about the 4 ports that are plugged in. "ERROR: qla2x00t(6): CTIO with error status 0x10 received (state 3, scst_cmd 0000000067d2fd4d, op INQUIRY)"
Is this an issue with the scst qla2x00t driver?
The other 4 unplugged ports shown below are reported as ok.
[ 7296.537931] [9319]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94
[ 7296.537935] [9319]: qla2x00t(1): Enabling target mode
[ 7296.898227] qla2xxx [0000:41:00.0]-00af:1:
[ 7296.908601] qla2xxx [0000:41:00.0]-1073:1:
[ 7317.107071] qla2xxx [0000:41:00.0]-8038:1:
[ 7318.147037] qla2xxx [0000:41:00.1]-8038:2:
[ 7318.468000] qla2xxx [0000:4a:00.0]-8038:8:
[ 7318.531040] qla2xxx [0000:4a:00.1]-8038:9:
[ 7337.266807] qla2xxx [0000:41:00.0]-8038:1:
[ 7337.541331] [9319]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95
[ 7337.541335] [9319]: qla2x00t(2): Enabling target mode
[ 7337.541371] qla2xxx [0000:41:00.1]-00af:2:
[ 7337.551223] qla2xxx [0000:41:00.1]-1073:2:
[ 7357.754498] qla2xxx [0000:41:00.1]-8038:2:
[ 7358.020938] [9319]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc
[ 7358.020942] [9319]: qla2x00t(8): Enabling target mode
[ 7358.021000] qla2xxx [0000:4a:00.0]-00af:8:
[ 7358.031342] qla2xxx [0000:4a:00.0]-1073:8:
[ 7378.234183] qla2xxx [0000:4a:00.0]-8038:8:
[ 7378.500635] [9319]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd
[ 7378.500639] [9319]: qla2x00t(9): Enabling target mode
[ 7378.500680] qla2xxx [0000:4a:00.1]-00af:9:
[ 7378.510671] qla2xxx [0000:4a:00.1]-1073:9:
[ 7398.713942] qla2xxx [0000:4a:00.1]-8038:9:
The qla2x00t-32gbit driver works best with 32 Gbit adapters and the qla2x00t driver works better for 8 Gbit and 16 Gbit adapters than the qla2x00t-32gbit driver. I propose to try building and reinstalling SCST after having run export QLA_32GBIT=no. An additional note is that I noticed in the past that the RHEL-compatible kernel is more reliable than the UEK kernel. Not sure if that is still the case today.
I just tried that as you suggested and it made no change. Same errors. Shall I wipe and reinstall from scratch again?
The reason for trying to use the UEK is because it continues to support drivers that RHEL had removed.
# dmesg | egrep "scst|qla"
[ 1.755515] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 1.755693] qla2xxx_scst: module verification failed: signature and/or required key missing - tainting kernel
[ 1.756550] qla2xxx [0000:00:00.0]-0005:
[ 1.756741] qla2xxx [0000:41:00.0]-001d:
[ 1.757163] qla2xxx 0000:41:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 1.813526] scsi host1: qla2xxx
[ 1.815627] qla2xxx [0000:41:00.0]-00fb:1:
[ 1.815637] qla2xxx [0000:41:00.0]-00fc:1:
[ 1.815893] qla2xxx [0000:41:00.1]-001d:
[ 1.816342] qla2xxx 0000:41:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 1.872643] scsi host2: qla2xxx
[ 1.874829] qla2xxx [0000:41:00.1]-00fb:2:
[ 1.874838] qla2xxx [0000:41:00.1]-00fc:2:
[ 1.875015] qla2xxx [0000:44:00.0]-001d:
[ 1.875568] qla2xxx 0000:44:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 1.935619] scsi host3: qla2xxx
[ 1.937377] qla2xxx [0000:44:00.0]-00fb:3:
[ 1.937386] qla2xxx [0000:44:00.0]-00fc:3:
[ 1.937521] qla2xxx [0000:44:00.1]-001d:
[ 1.937913] qla2xxx 0000:44:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 1.997397] scsi host4: qla2xxx
[ 1.999136] qla2xxx [0000:44:00.1]-00fb:4:
[ 1.999144] qla2xxx [0000:44:00.1]-00fc:4:
[ 1.999243] qla2xxx [0000:45:00.0]-001d:
[ 1.999658] qla2xxx 0000:45:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 2.062354] scsi host6: qla2xxx
[ 2.064461] qla2xxx [0000:45:00.0]-00fb:6:
[ 2.064469] qla2xxx [0000:45:00.0]-00fc:6:
[ 2.064702] qla2xxx [0000:45:00.1]-001d:
[ 2.065110] qla2xxx 0000:45:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.124236] scsi host7: qla2xxx
[ 2.126277] qla2xxx [0000:45:00.1]-00fb:7:
[ 2.126286] qla2xxx [0000:45:00.1]-00fc:7:
[ 2.126471] qla2xxx [0000:4a:00.0]-001d:
[ 2.126904] qla2xxx 0000:4a:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 2.184137] scsi host8: qla2xxx
[ 2.185985] qla2xxx [0000:4a:00.0]-00fb:8:
[ 2.185992] qla2xxx [0000:4a:00.0]-00fc:8:
[ 2.186143] qla2xxx [0000:4a:00.1]-001d:
[ 2.186545] qla2xxx 0000:4a:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 2.243827] qla2xxx [0000:44:00.0]-505f:3:
[ 2.245722] scsi host9: qla2xxx
[ 2.247805] qla2xxx [0000:4a:00.1]-00fb:9:
[ 2.247812] qla2xxx [0000:4a:00.1]-00fc:9:
[ 2.307760] qla2xxx [0000:44:00.1]-505f:4:
[ 2.372665] qla2xxx [0000:45:00.0]-505f:6:
[ 2.434553] qla2xxx [0000:45:00.1]-505f:7:
[ 24.040449] qla2xxx [0000:41:00.0]-8038:1:
[ 24.120349] qla2xxx [0000:41:00.1]-8038:2:
[ 24.424421] qla2xxx [0000:4a:00.0]-8038:8:
[ 24.488404] qla2xxx [0000:4a:00.1]-8038:9:
[ 247.336874] [3698]: scst: User interface thread started
[ 247.342379] [3692]: scst: Attached to scsi0, channel 2, id 0, lun 0, type 0
[ 247.342407] [3692]: scst: Attached to scsi0, channel 2, id 1, lun 0, type 0
[ 247.342426] [3692]: scst: Attached to scsi5, channel 2, id 0, lun 0, type 0
[ 247.345835] [3733]: scst: Init thread started
[ 247.345894] [3734]: scst: Task management thread started
[ 247.345957] [3735]: scst: Management thread started
[ 247.345964] [3692]: scst: Target template copy_manager registered successfully
[ 247.346001] [3692]: scst: Target copy_manager_tgt for template copy_manager registered successfully
[ 247.346008] [3692]: scst: Using security group "copy_manager_tgt" for initiator "copy_manager_sess" (target copy_manager_tgt)
[ 247.346042] [3692]: scst: SCST version 3.6.0-pre loaded successfully (global max mem for commands ignored, per device 19293MB)
[ 247.346043] [3692]: scst: Enabled features: TRACING
[ 247.351953] [3737]: scst: Virtual device handler vdisk_fileio for type 0 registered successfully
[ 247.351958] [3737]: scst: Virtual device handler vdisk_blockio for type 0 registered successfully
[ 247.351961] [3737]: scst: Virtual device handler vdisk_nullio for type 0 registered successfully
[ 247.351963] [3737]: scst: Virtual device handler vcdrom for type 5 registered successfully
[ 247.358614] [3739]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre
[ 247.358682] [3739]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully
[ 247.358687] [3739]: scst: Target template qla2x00t registered successfully
[ 247.358715] [3739]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully
[ 247.358735] [3739]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully
[ 247.358752] [3739]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully
[ 247.358770] [3739]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully
[ 247.358786] [3739]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully
[ 247.358803] [3739]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully
[ 247.358821] [3739]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully
[ 247.358840] [3739]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully
[ 247.514087] [3698]: scst: Removed all devices from group copy_manager_tgt
[ 247.517283] [3698]: scst: Removed all devices from group 21:00:00:24:ff:57:76:94
[ 247.519892] [3698]: scst: Removed all devices from group 21:00:00:24:ff:57:76:95
[ 247.522737] [3698]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bc
[ 247.525111] [3698]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bd
[ 247.527754] [3698]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bc
[ 247.530177] [3698]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bd
[ 247.532743] [3698]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:be
[ 247.535322] [3698]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bf
[ 247.649179] [3698]: scst: Added device disk01 to group copy_manager_tgt (LUN 0, flags 0x4) to target copy_manager_tgt
[ 247.649194] [3698]: scst: Attached to virtual device disk01 (id 1)
[ 247.649667] [3698]: scst: Added device dummy to group copy_manager_tgt (LUN 1, flags 0x4) to target copy_manager_tgt
[ 247.649671] [3698]: scst: Attached to virtual device dummy (id 2)
[ 247.652341] [3698]: scst: Added device dummy to group 21:00:00:24:ff:57:76:94 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:94
[ 247.652458] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:94 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:94
[ 247.655080] [3698]: scst: Added device dummy to group 21:00:00:24:ff:57:76:95 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:95
[ 247.655238] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:95 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:95
[ 247.657853] [3698]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bc
[ 247.658054] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bc
[ 247.660656] [3698]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bd
[ 247.660827] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bd
[ 247.663033] [3698]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc
[ 247.663195] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc
[ 247.665601] [3698]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd
[ 247.665768] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd
[ 247.668178] [3698]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:be (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:be
[ 247.668342] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:be (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:be
[ 247.670646] [3698]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bf (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf
[ 247.670790] [3698]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bf (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf
[ 247.673138] [3698]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94
[ 247.673142] [3698]: qla2x00t(1): Enabling target mode
[ 247.673197] qla2xxx [0000:41:00.0]-00af:1:
[ 247.683568] qla2xxx [0000:41:00.0]-1073:1:
[ 267.883795] qla2xxx [0000:41:00.0]-8038:1:
[ 268.157969] [3698]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95
[ 268.157973] [3698]: qla2x00t(2): Enabling target mode
[ 268.158022] qla2xxx [0000:41:00.1]-00af:2:
[ 268.167915] qla2xxx [0000:41:00.1]-1073:2:
[ 288.371575] qla2xxx [0000:41:00.1]-8038:2:
[ 288.638281] [3698]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc
[ 288.638286] [3698]: qla2x00t(8): Enabling target mode
[ 288.638314] qla2xxx [0000:4a:00.0]-00af:8:
[ 288.648764] qla2xxx [0000:4a:00.0]-1073:8:
[ 308.851299] qla2xxx [0000:4a:00.0]-8038:8:
[ 309.117963] [3698]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd
[ 309.117967] [3698]: qla2x00t(9): Enabling target mode
[ 309.118023] qla2xxx [0000:4a:00.1]-00af:9:
[ 309.127867] qla2xxx [0000:4a:00.1]-1073:9:
[ 329.331048] qla2xxx [0000:4a:00.1]-8038:9:
[ 329.597736] [3698]: scst: Using autogenerated relative target id 5 for target 21:00:00:24:ff:6c:c5:bc
[ 329.597748] [3698]: qla2x00t(3): Enabling target mode
[ 329.597790] [3698]: qla2x00t(3): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added
[ 329.597798] qla2xxx [0000:44:00.0]-00af:3:
[ 329.597818] [3735]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc)
[ 329.598546] [619]: qla2x00t(3): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 329.609804] qla2xxx [0000:44:00.0]-1073:3:
[ 329.916290] [0]: qla2x00t(3): LIP reset occurred
[ 329.952365] [0]: qla2x00t(3): LIP occurred
[ 329.955219] [0]: qla2x00t(3): Loop up occurred
[ 329.955657] qla2xxx [0000:44:00.0]-505f:3:
[ 330.155117] [619]: qla2x00t(3): LIP reset (loop 0xffff), subcode 2
[ 330.158400] [530]: qla2x00t(3): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 330.164868] [0]: ***ERROR***: qla2x00t(3): CTIO with error status 0x10 received (state 3, scst_cmd 00000000062a886f, op INQUIRY)
[ 330.621626] [3698]: scst: Using autogenerated relative target id 6 for target 21:00:00:24:ff:6c:c5:bd
[ 330.621630] [3698]: qla2x00t(4): Enabling target mode
[ 330.621665] [3698]: qla2x00t(4): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 330.621741] [3735]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd)
[ 330.621741] qla2xxx [0000:44:00.1]-00af:4:
[ 330.621954] [632]: qla2x00t(4): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 330.633223] qla2xxx [0000:44:00.1]-1073:4:
[ 330.939284] [0]: qla2x00t(4): LIP reset occurred
[ 330.976357] [0]: qla2x00t(4): LIP occurred
[ 330.979213] [0]: qla2x00t(4): Loop up occurred
[ 330.979654] qla2xxx [0000:44:00.1]-505f:4:
[ 331.178958] [632]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2
[ 331.181809] [402]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 331.190006] [0]: ***ERROR***: qla2x00t(4): CTIO with error status 0x10 received (state 3, scst_cmd 0000000011fe8e03, op INQUIRY)
[ 331.645485] [3698]: scst: Using autogenerated relative target id 7 for target 21:00:00:24:ff:6c:c5:be
[ 331.645489] [3698]: qla2x00t(6): Enabling target mode
[ 331.645527] [3698]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 331.645604] qla2xxx [0000:45:00.0]-00af:6:
[ 331.645607] [3735]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be)
[ 331.646356] [636]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 331.657630] qla2xxx [0000:45:00.0]-1073:6:
[ 331.964334] [0]: qla2x00t(6): LIP reset occurred
[ 331.999203] [0]: qla2x00t(6): LIP occurred
[ 332.002056] [0]: qla2x00t(6): Loop up occurred
[ 332.002490] qla2xxx [0000:45:00.0]-505f:6:
[ 332.203091] [636]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2
[ 332.206439] [249]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 332.212730] [0]: ***ERROR***: qla2x00t(6): CTIO with error status 0x10 received (state 3, scst_cmd 00000000ef8af6fc, op INQUIRY)
[ 332.669417] [3698]: scst: Using autogenerated relative target id 8 for target 21:00:00:24:ff:6c:c5:bf
[ 332.669421] [3698]: qla2x00t(7): Enabling target mode
[ 332.669459] [3698]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 332.669528] qla2xxx [0000:45:00.1]-00af:7:
[ 332.669545] [3735]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
[ 332.669750] [644]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 332.681543] qla2xxx [0000:45:00.1]-1073:7:
[ 332.988315] [0]: qla2x00t(7): LIP reset occurred
[ 333.023162] [0]: qla2x00t(7): LIP occurred
[ 333.026010] [0]: qla2x00t(7): Loop up occurred
[ 333.026452] qla2xxx [0000:45:00.1]-505f:7:
[ 333.227155] [644]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2
[ 333.230528] [310]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 333.236951] [0]: ***ERROR***: qla2x00t(7): CTIO with error status 0x10 received (state 3, scst_cmd 00000000140a67f5, op INQUIRY)
Is it possible that my scst.conf file could cause this? It's the same as it was on the old install.
I don't think that it is necessary to reinstall Oracle Linux or to modify scst.conf. Please check the qla2xxx_scst kernel module settings, especially the qlini_mode parameter.
$ modinfo qla2xxx|grep qlini_mode:
parm: qlini_mode:Determines when initiator mode will be enabled. Possible values: "exclusive" - initiator mode will be enabled on load, disabled on enabling target mode and then on disabling target mode enabled back; "disabled" - initiator mode will never be enabled; "dual" - Initiator Modes will be enabled. Target Mode can be activated when ready "enabled" (default) - initiator mode will always stay enabled. (charp)
I wish I'd have received this sooner. I've already wiped and installed CentOS 8 on it already. I just wiped again and am putting OL8 on it again so I can check that. Do I still need to blacklist the module as well as set the qlini_mode to disabled?
Reinstalled OL8 for the 9th time today. Built scst as you said with the export QLA_32GBIT=no in my build VM then copied over to the new install.
Executed the following:
echo 'options qla2xxx qlini_mode="disabled"' > /usr/lib/modprobe.d/qla2xxx.conf
echo blacklist qla2xxx >/etc/modprobe.d/blacklist-qla2xxx.conf
rmmod qla2xxx
dracut -f
shutdown -r now
...
dnf -y localinstall scst-5.4.17-2102.204.4.4.el8uek.x86_64-3.6.0.8464-1.el8.x86_64.rpm scstadmin-1.0.0-1.x86_64.rpm
dracut -f
shutdown -r now
...
<< created the scst.conf >>
/etc/init.d/scst start
<< captured the dmesg below >>
Sadly, no change. Help!
# dmesg | egrep "qla|scst"
[ 5.565659] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 5.565659] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 5.565660] qla2xxx_scst: loading out-of-tree module taints kernel.
[ 5.585688] qla2xxx_scst: module verification failed: signature and/or required key missing - tainting kernel
[ 5.587484] qla2xxx [0000:00:00.0]-0005:
[ 5.587687] qla2xxx [0000:41:00.0]-001d:
[ 5.588104] qla2xxx 0000:41:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 5.723663] scsi host2: qla2xxx
[ 5.725701] qla2xxx [0000:41:00.0]-00fb:2:
[ 5.725709] qla2xxx [0000:41:00.0]-00fc:2:
[ 5.725952] qla2xxx [0000:41:00.1]-001d:
[ 5.726378] qla2xxx 0000:41:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 5.782262] scsi host3: qla2xxx
[ 5.783981] qla2xxx [0000:41:00.1]-00fb:3:
[ 5.783988] qla2xxx [0000:41:00.1]-00fc:3:
[ 5.784192] qla2xxx [0000:44:00.0]-001d:
[ 5.784590] qla2xxx 0000:44:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 5.844428] scsi host4: qla2xxx
[ 5.846188] qla2xxx [0000:44:00.0]-00fb:4:
[ 5.846197] qla2xxx [0000:44:00.0]-00fc:4:
[ 5.846369] qla2xxx [0000:44:00.1]-001d:
[ 5.846819] qla2xxx 0000:44:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 5.905945] scsi host5: qla2xxx
[ 5.907875] qla2xxx [0000:44:00.1]-00fb:5:
[ 5.907885] qla2xxx [0000:44:00.1]-00fc:5:
[ 5.908078] qla2xxx [0000:45:00.0]-001d:
[ 5.908504] qla2xxx 0000:45:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 5.968340] scsi host6: qla2xxx
[ 5.970190] qla2xxx [0000:45:00.0]-00fb:6:
[ 5.970198] qla2xxx [0000:45:00.0]-00fc:6:
[ 5.970499] qla2xxx [0000:45:00.1]-001d:
[ 5.970891] qla2xxx 0000:45:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 6.030946] scsi host7: qla2xxx
[ 6.032784] qla2xxx [0000:45:00.1]-00fb:7:
[ 6.032793] qla2xxx [0000:45:00.1]-00fc:7:
[ 6.032982] qla2xxx [0000:4a:00.0]-001d:
[ 6.033398] qla2xxx 0000:4a:00.0: DMAR: 32bit DMA uses non-identity mapping
[ 6.089908] scsi host8: qla2xxx
[ 6.091638] qla2xxx [0000:4a:00.0]-00fb:8:
[ 6.091645] qla2xxx [0000:4a:00.0]-00fc:8:
[ 6.091804] qla2xxx [0000:4a:00.1]-001d:
[ 6.092220] qla2xxx 0000:4a:00.1: DMAR: 32bit DMA uses non-identity mapping
[ 6.148334] scsi host9: qla2xxx
[ 6.150158] qla2xxx [0000:4a:00.1]-00fb:9:
[ 6.150165] qla2xxx [0000:4a:00.1]-00fc:9:
[ 6.152743] qla2xxx [0000:44:00.0]-505f:4:
[ 6.214059] qla2xxx [0000:44:00.1]-505f:5:
[ 6.276431] qla2xxx [0000:45:00.0]-505f:6:
[ 6.339067] qla2xxx [0000:45:00.1]-505f:7:
[ 27.945215] qla2xxx [0000:41:00.0]-8038:2:
[ 28.009207] qla2xxx [0000:41:00.1]-8038:3:
[ 28.329195] qla2xxx [0000:4a:00.0]-8038:8:
[ 28.393161] qla2xxx [0000:4a:00.1]-8038:9:
[ 157.608689] [6932]: scst: User interface thread started
[ 157.615088] [6926]: scst: Attached to scsi0, channel 2, id 0, lun 0, type 0
[ 157.615110] [6926]: scst: Attached to scsi0, channel 2, id 1, lun 0, type 0
[ 157.615129] [6926]: scst: Attached to scsi1, channel 2, id 0, lun 0, type 0
[ 157.616943] [6967]: scst: Init thread started
[ 157.616971] [6968]: scst: Task management thread started
[ 157.616997] [6969]: scst: Management thread started
[ 157.617018] [6926]: scst: Target template copy_manager registered successfully
[ 157.617038] [6926]: scst: Target copy_manager_tgt for template copy_manager registered successfully
[ 157.617045] [6926]: scst: Using security group "copy_manager_tgt" for initiator "copy_manager_sess" (target copy_manager_tgt)
[ 157.617072] [6926]: scst: SCST version 3.6.0-pre loaded successfully (global max mem for commands ignored, per device 19293MB)
[ 157.617072] [6926]: scst: Enabled features: TRACING
[ 157.627088] [6971]: scst: Virtual device handler vdisk_fileio for type 0 registered successfully
[ 157.627092] [6971]: scst: Virtual device handler vdisk_blockio for type 0 registered successfully
[ 157.627094] [6971]: scst: Virtual device handler vdisk_nullio for type 0 registered successfully
[ 157.627097] [6971]: scst: Virtual device handler vcdrom for type 5 registered successfully
[ 157.634961] [6972]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre
[ 157.635025] [6972]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully
[ 157.635028] [6972]: scst: Target template qla2x00t registered successfully
[ 157.635055] [6972]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully
[ 157.635074] [6972]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully
[ 157.635091] [6972]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully
[ 157.635108] [6972]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully
[ 157.635125] [6972]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully
[ 157.635141] [6972]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully
[ 157.635158] [6972]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully
[ 157.635174] [6972]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully
[ 157.894095] [6932]: scst: Removed all devices from group copy_manager_tgt
[ 157.896778] [6932]: scst: Removed all devices from group 21:00:00:24:ff:57:76:94
[ 157.898796] [6932]: scst: Removed all devices from group 21:00:00:24:ff:57:76:95
[ 157.901336] [6932]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bc
[ 157.903870] [6932]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bd
[ 157.906374] [6932]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bc
[ 157.908861] [6932]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bd
[ 157.911148] [6932]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:be
[ 157.913673] [6932]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bf
[ 158.022587] [6932]: scst: Added device disk01 to group copy_manager_tgt (LUN 0, flags 0x4) to target copy_manager_tgt
[ 158.022610] [6932]: scst: Attached to virtual device disk01 (id 1)
[ 158.023086] [6932]: scst: Added device dummy to group copy_manager_tgt (LUN 1, flags 0x4) to target copy_manager_tgt
[ 158.023090] [6932]: scst: Attached to virtual device dummy (id 2)
[ 158.026031] [6932]: scst: Added device dummy to group 21:00:00:24:ff:57:76:94 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:94
[ 158.026162] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:94 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:94
[ 158.028168] [6932]: scst: Added device dummy to group 21:00:00:24:ff:57:76:95 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:95
[ 158.028320] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:95 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:95
[ 158.030759] [6932]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bc
[ 158.030921] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bc
[ 158.033333] [6932]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bd
[ 158.033462] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bd
[ 158.035963] [6932]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc
[ 158.036107] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc
[ 158.037872] [6932]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd
[ 158.037958] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd
[ 158.039684] [6932]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:be (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:be
[ 158.039799] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:be (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:be
[ 158.042207] [6932]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bf (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf
[ 158.042372] [6932]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bf (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf
[ 158.044686] [6932]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94
[ 158.044690] [6932]: qla2x00t(2): Enabling target mode
[ 158.044747] qla2xxx [0000:41:00.0]-00af:2:
[ 158.055110] qla2xxx [0000:41:00.0]-1073:2:
[ 178.253364] qla2xxx [0000:41:00.0]-8038:2:
[ 178.527876] [6932]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95
[ 178.527881] [6932]: qla2x00t(3): Enabling target mode
[ 178.527948] qla2xxx [0000:41:00.1]-00af:3:
[ 178.537860] qla2xxx [0000:41:00.1]-1073:3:
[ 198.741014] qla2xxx [0000:41:00.1]-8038:3:
[ 199.007544] [6932]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc
[ 199.007548] [6932]: qla2x00t(8): Enabling target mode
[ 199.007607] qla2xxx [0000:4a:00.0]-00af:8:
[ 199.017958] qla2xxx [0000:4a:00.0]-1073:8:
[ 219.220433] qla2xxx [0000:4a:00.0]-8038:8:
[ 219.486723] [6932]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd
[ 219.486728] [6932]: qla2x00t(9): Enabling target mode
[ 219.486787] qla2xxx [0000:4a:00.1]-00af:9:
[ 219.496662] qla2xxx [0000:4a:00.1]-1073:9:
[ 239.699341] qla2xxx [0000:4a:00.1]-8038:9:
[ 239.965881] [6932]: scst: Using autogenerated relative target id 5 for target 21:00:00:24:ff:6c:c5:bc
[ 239.965885] [6932]: qla2x00t(4): Enabling target mode
[ 239.965926] [6932]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added
[ 239.965990] [6969]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc)
[ 239.966004] qla2xxx [0000:44:00.0]-00af:4:
[ 239.966762] [1085]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 239.978506] qla2xxx [0000:44:00.0]-1073:4:
[ 240.284937] [0]: qla2x00t(4): LIP reset occurred
[ 240.319924] [0]: qla2x00t(4): LIP occurred
[ 240.322780] [0]: qla2x00t(4): Loop up occurred
[ 240.323218] qla2xxx [0000:44:00.0]-505f:4:
[ 240.523488] [1085]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2
[ 240.526939] [311]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 240.989914] [6932]: scst: Using autogenerated relative target id 6 for target 21:00:00:24:ff:6c:c5:bd
[ 240.989918] [6932]: qla2x00t(5): Enabling target mode
[ 240.989952] [6932]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 240.989958] qla2xxx [0000:44:00.1]-00af:5:
[ 240.989973] [6969]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd)
[ 240.990166] [1091]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 241.001466] qla2xxx [0000:44:00.1]-1073:5:
[ 241.282451] [0]: ***ERROR***: qla2x00t(4): CTIO with error status 0x10 received (state 3, scst_cmd 00000000d5d44872, op INQUIRY)
[ 241.308207] [0]: qla2x00t(5): LIP reset occurred
[ 241.373452] [0]: qla2x00t(5): LIP occurred
[ 241.376307] [0]: qla2x00t(5): Loop up occurred
[ 241.376743] qla2xxx [0000:44:00.1]-505f:5:
[ 241.547379] [1091]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2
[ 241.550606] [317]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 241.556811] [0]: ***ERROR***: qla2x00t(5): CTIO with error status 0x10 received (state 3, scst_cmd 0000000083edcfc3, op INQUIRY)
[ 242.013550] [6932]: scst: Using autogenerated relative target id 7 for target 21:00:00:24:ff:6c:c5:be
[ 242.013554] [6932]: qla2x00t(6): Enabling target mode
[ 242.013594] [6932]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 242.013669] [6969]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be)
[ 242.013669] qla2xxx [0000:45:00.0]-00af:6:
[ 242.014421] [1096]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 242.025681] qla2xxx [0000:45:00.0]-1073:6:
[ 242.332277] [0]: qla2x00t(6): LIP reset occurred
[ 242.367170] [0]: qla2x00t(6): LIP occurred
[ 242.370023] [0]: qla2x00t(6): Loop up occurred
[ 242.370459] qla2xxx [0000:45:00.0]-505f:6:
[ 242.571364] [1096]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2
[ 242.574568] [412]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 242.580325] [0]: ***ERROR***: qla2x00t(6): CTIO with error status 0x10 received (state 3, scst_cmd 000000005ec51c8a, op INQUIRY)
[ 243.037691] [6932]: scst: Using autogenerated relative target id 8 for target 21:00:00:24:ff:6c:c5:bf
[ 243.037695] [6932]: qla2x00t(7): Enabling target mode
[ 243.037729] [6932]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 243.037807] qla2xxx [0000:45:00.1]-00af:7:
[ 243.037808] [6969]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
[ 243.038019] [1100]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 243.049273] qla2xxx [0000:45:00.1]-1073:7:
[ 243.355783] [0]: qla2x00t(7): LIP reset occurred
[ 243.390684] [0]: qla2x00t(7): LIP occurred
[ 243.393541] [0]: qla2x00t(7): Loop up occurred
[ 243.393976] qla2xxx [0000:45:00.1]-505f:7:
[ 243.591285] [1100]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2
[ 243.594812] [249]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 243.600907] [0]: ***ERROR***: qla2x00t(7): CTIO with error status 0x10 received (state 3, scst_cmd 00000000486b8e3e, op INQUIRY)
[ 300.056573] [311]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 304.152030] [412]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 304.152149] [249]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 304.153061] [317]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 341.016428] [311]: qla2x00t(4): local session for loop_id 0 deleted
[ 345.112304] [249]: qla2x00t(7): local session for loop_id 0 deleted
[ 345.112316] [317]: qla2x00t(5): local session for loop_id 0 deleted
[ 345.112319] [412]: qla2x00t(6): local session for loop_id 0 deleted
In waiting for help from Bart/Vlad, I decided to reinstall CentOS and build scst against the latest kernel. As you'll see below, I don't have bad equipment and everything works. It seems there's some kind of issue with OL8 and SCST that still needs to be worked out.
Clean C8 install gives this:
# dmesg | egrep "qla|scst"
[ 1.639762] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.104-k.
[ 1.639968] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 75 iobase 0x(____ptrval____).
[ 1.677696] qla2xxx [0000:41:00.0]-ffff:1: FC4 priority set to FCP
[ 2.053257] scsi host1: qla2xxx
[ 2.054770] qla2xxx [0000:41:00.0]-00fb:1: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
[ 2.054775] qla2xxx [0000:41:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.0 hdma+ host#=1 fw=8.07.00 (90d5).
[ 2.054902] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 102 iobase 0x(____ptrval____).
[ 2.091672] qla2xxx [0000:41:00.1]-ffff:3: FC4 priority set to FCP
[ 2.473079] scsi host3: qla2xxx
[ 2.474568] qla2xxx [0000:41:00.1]-00fb:3: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
[ 2.474572] qla2xxx [0000:41:00.1]-00fc:3: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.1 hdma+ host#=3 fw=8.07.00 (90d5).
[ 2.474700] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 115 iobase 0x0000000062ddeb2b.
[ 2.514343] qla2xxx [0000:44:00.0]-ffff:4: FC4 priority set to FCP
[ 2.886191] scsi host4: qla2xxx
[ 2.888044] qla2xxx [0000:44:00.0]-00fb:4: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA.
[ 2.888048] qla2xxx [0000:44:00.0]-00fc:4: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.0 hdma+ host#=4 fw=8.07.00 (90d5).
[ 2.888282] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x0000000007c56550.
[ 2.927324] qla2xxx [0000:44:00.1]-ffff:5: FC4 priority set to FCP
[ 3.129842] qla2xxx [0000:44:00.0]-500a:4: LOOP UP detected (8 Gbps).
[ 3.299194] scsi host5: qla2xxx
[ 3.300948] qla2xxx [0000:44:00.1]-00fb:5: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA.
[ 3.300952] qla2xxx [0000:44:00.1]-00fc:5: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.1 hdma+ host#=5 fw=8.07.00 (90d5).
[ 3.301088] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x000000008b7a7c0a.
[ 3.340356] qla2xxx [0000:45:00.0]-ffff:6: FC4 priority set to FCP
[ 3.542725] qla2xxx [0000:44:00.1]-500a:5: LOOP UP detected (8 Gbps).
[ 3.712202] scsi host6: qla2xxx
[ 3.713977] qla2xxx [0000:45:00.0]-00fb:6: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA.
[ 3.713981] qla2xxx [0000:45:00.0]-00fc:6: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.0 hdma+ host#=6 fw=8.07.00 (90d5).
[ 3.714199] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 123 iobase 0x00000000886b6d1d.
[ 3.753370] qla2xxx [0000:45:00.1]-ffff:7: FC4 priority set to FCP
[ 3.955700] qla2xxx [0000:45:00.0]-500a:6: LOOP UP detected (8 Gbps).
[ 4.125240] scsi host7: qla2xxx
[ 4.126953] qla2xxx [0000:45:00.1]-00fb:7: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA.
[ 4.126957] qla2xxx [0000:45:00.1]-00fc:7: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.1 hdma+ host#=7 fw=8.07.00 (90d5).
[ 4.127177] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 126 iobase 0x0000000071e2b922.
[ 4.163698] qla2xxx [0000:4a:00.0]-ffff:8: FC4 priority set to FCP
[ 4.368700] qla2xxx [0000:45:00.1]-500a:7: LOOP UP detected (8 Gbps).
[ 4.535202] scsi host8: qla2xxx
[ 4.536865] qla2xxx [0000:4a:00.0]-00fb:8: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
[ 4.536868] qla2xxx [0000:4a:00.0]-00fc:8: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.0 hdma+ host#=8 fw=8.07.00 (90d5).
[ 4.537028] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 36 iobase 0x00000000ad9668c4.
[ 4.573703] qla2xxx [0000:4a:00.1]-ffff:9: FC4 priority set to FCP
[ 4.945239] scsi host9: qla2xxx
[ 4.947072] qla2xxx [0000:4a:00.1]-00fb:9: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
[ 4.947076] qla2xxx [0000:4a:00.1]-00fc:9: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.1 hdma+ host#=9 fw=8.07.00 (90d5).
[ 23.265006] qla2xxx [0000:41:00.0]-8038:1: Cable is unplugged...
[ 23.649020] qla2xxx [0000:41:00.1]-8038:3: Cable is unplugged...
[ 25.697031] qla2xxx [0000:4a:00.0]-8038:8: Cable is unplugged...
[ 26.145010] qla2xxx [0000:4a:00.1]-8038:9: Cable is unplugged...
After installing SCST, we can see it starts up ok. I tested from all four active nodes and they're working as expected again.
[ 3904.261220] [6540]: scst: User interface thread started
[ 3904.287296] [6534]: scst: Attached to scsi0, channel 2, id 0, lun 0, type 0
[ 3904.287320] [6534]: scst: Attached to scsi0, channel 2, id 1, lun 0, type 0
[ 3904.287337] [6534]: scst: Attached to scsi1, channel 2, id 0, lun 0, type 0
[ 3904.291090] [6574]: scst: Init thread started
[ 3904.291115] [6575]: scst: Task management thread started
[ 3904.291144] [6576]: scst: Management thread started
[ 3904.291148] [6534]: scst: Target template copy_manager registered successfully
[ 3904.291181] [6534]: scst: Target copy_manager_tgt for template copy_manager registered successfully
[ 3904.291187] [6534]: scst: Using security group "copy_manager_tgt" for initiator "copy_manager_sess" (target copy_manager_tgt)
[ 3904.291218] [6534]: scst: SCST version 3.6.0-pre loaded successfully (global max mem for commands ignored, per device 19312MB)
[ 3904.291219] [6534]: scst: Enabled features: TRACING
[ 3904.303134] [6577]: scst: Virtual device handler vdisk_fileio for type 0 registered successfully
[ 3904.303137] [6577]: scst: Virtual device handler vdisk_blockio for type 0 registered successfully
[ 3904.303140] [6577]: scst: Virtual device handler vdisk_nullio for type 0 registered successfully
[ 3904.303142] [6577]: scst: Virtual device handler vcdrom for type 5 registered successfully
[ 3904.309042] [6580]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre
[ 3904.309141] [6580]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully
[ 3904.309146] [6580]: scst: Target template qla2x00t registered successfully
[ 3904.309173] [6580]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully
[ 3904.309190] [6580]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully
[ 3904.309206] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully
[ 3904.309221] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully
[ 3904.309236] [6580]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully
[ 3904.309251] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully
[ 3904.309267] [6580]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully
[ 3904.309282] [6580]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully
[ 3904.435412] [6540]: scst: Removed all devices from group copy_manager_tgt
[ 3904.437717] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:94
[ 3904.439721] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:95
[ 3904.441673] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bc
[ 3904.443554] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bd
[ 3904.445490] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bc
[ 3904.447375] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bd
[ 3904.449275] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:be
[ 3904.451186] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bf
[ 3904.562083] [6540]: scst: Added device disk01 to group copy_manager_tgt (LUN 0, flags 0x4) to target copy_manager_tgt
[ 3904.562099] [6540]: scst: Attached to virtual device disk01 (id 1)
[ 3904.562748] [6540]: scst: Added device dummy to group copy_manager_tgt (LUN 1, flags 0x4) to target copy_manager_tgt
[ 3904.562760] [6540]: scst: Attached to virtual device dummy (id 2)
[ 3904.565805] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:94 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:94
[ 3904.565886] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:94 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:94
[ 3904.567691] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:95 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:95
[ 3904.567777] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:95 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:95
[ 3904.569601] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bc
[ 3904.569689] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bc
[ 3904.571375] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bd
[ 3904.571460] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bd
[ 3904.573244] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc
[ 3904.573330] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc
[ 3904.575062] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd
[ 3904.575147] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd
[ 3904.576860] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:be (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:be
[ 3904.576950] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:be (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:be
[ 3904.578666] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bf (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf
[ 3904.578761] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bf (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf
[ 3904.580441] [6540]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94
[ 3904.580443] [6540]: qla2x00t(2): Enabling target mode
[ 3904.580451] qla2xxx [0000:41:00.0]-00af:2:
[ 3904.590835] qla2xxx [0000:41:00.0]-1073:2:
[ 3924.793502] qla2xxx [0000:41:00.0]-8038:2:
[ 3925.075512] [6540]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95
[ 3925.075515] [6540]: qla2x00t(3): Enabling target mode
[ 3925.075536] qla2xxx [0000:41:00.1]-00af:3:
[ 3925.085463] qla2xxx [0000:41:00.1]-1073:3:
[ 3945.289266] qla2xxx [0000:41:00.1]-8038:3:
[ 3945.555278] [6540]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc
[ 3945.555281] [6540]: qla2x00t(8): Enabling target mode
[ 3945.555292] qla2xxx [0000:4a:00.0]-00af:8:
[ 3945.565706] qla2xxx [0000:4a:00.0]-1073:8:
[ 3965.769034] qla2xxx [0000:4a:00.0]-8038:8:
[ 3966.034753] [6540]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd
[ 3966.034755] [6540]: qla2x00t(9): Enabling target mode
[ 3966.034787] qla2xxx [0000:4a:00.1]-00af:9:
[ 3966.044678] qla2xxx [0000:4a:00.1]-1073:9:
[ 3986.248795] qla2xxx [0000:4a:00.1]-8038:9:
[ 3986.514445] [6540]: scst: Using autogenerated relative target id 5 for target 21:00:00:24:ff:6c:c5:bc
[ 3986.514447] [6540]: qla2x00t(4): Enabling target mode
[ 3986.514475] [6540]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added
[ 3986.514484] qla2xxx [0000:44:00.0]-00af:4:
[ 3986.514529] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc)
[ 3986.515231] [2137]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 3986.526552] qla2xxx [0000:44:00.0]-1073:4:
[ 3986.833111] [0]: qla2x00t(4): LIP reset occurred
[ 3986.868151] [0]: qla2x00t(4): LIP occurred
[ 3986.871005] [0]: qla2x00t(4): Loop up occurred
[ 3986.871443] qla2xxx [0000:44:00.0]-505f:4:
[ 3987.072916] [2137]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2
[ 3987.076030] [2719]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 3987.539057] [6540]: scst: Using autogenerated relative target id 6 for target 21:00:00:24:ff:6c:c5:bd
[ 3987.539059] [6540]: qla2x00t(5): Enabling target mode
[ 3987.539068] [6540]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 3987.539108] qla2xxx [0000:44:00.1]-00af:5:
[ 3987.539120] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd)
[ 3987.539312] [2141]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 3987.550804] qla2xxx [0000:44:00.1]-1073:5:
[ 3987.857643] [0]: qla2x00t(5): LIP reset occurred
[ 3987.892588] [0]: qla2x00t(5): LIP occurred
[ 3987.895432] [0]: qla2x00t(5): Loop up occurred
[ 3987.895868] qla2xxx [0000:44:00.1]-505f:5:
[ 3988.096917] [2141]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2
[ 3988.100171] [2682]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 3988.562572] [6540]: scst: Using autogenerated relative target id 7 for target 21:00:00:24:ff:6c:c5:be
[ 3988.562573] [6540]: qla2x00t(6): Enabling target mode
[ 3988.562605] [6540]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 3988.562630] qla2xxx [0000:45:00.0]-00af:6:
[ 3988.562652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be)
[ 3988.563369] [2146]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 3988.574630] qla2xxx [0000:45:00.0]-1073:6:
[ 3988.881234] [0]: qla2x00t(6): LIP reset occurred
[ 3988.917093] [0]: qla2x00t(6): LIP occurred
[ 3988.919943] [0]: qla2x00t(6): Loop up occurred
[ 3988.920379] qla2xxx [0000:45:00.0]-505f:6:
[ 3989.120899] [2146]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2
[ 3989.124175] [19]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 3989.586283] [6540]: scst: Using autogenerated relative target id 8 for target 21:00:00:24:ff:6c:c5:bf
[ 3989.586285] [6540]: qla2x00t(7): Enabling target mode
[ 3989.586299] [6540]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 3989.586329] qla2xxx [0000:45:00.1]-00af:7:
[ 3989.586347] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
[ 3989.586533] [2155]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 3989.597930] qla2xxx [0000:45:00.1]-1073:7:
[ 3989.904539] [0]: qla2x00t(7): LIP reset occurred
[ 3989.939350] [0]: qla2x00t(7): LIP occurred
[ 3989.942202] [0]: qla2x00t(7): Loop up occurred
[ 3989.942639] qla2xxx [0000:45:00.1]-505f:7:
[ 3990.144812] [2155]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2
[ 3990.148121] [273]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 4047.376705] [2719]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs
[ 4051.471061] [2682]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs
[ 4051.471221] [2094]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs
[ 4051.474927] [19]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs
[ 4088.335673] [2719]: qla2x00t(4): local session for loop_id 0 deleted
[ 4092.431627] [19]: qla2x00t(6): local session for loop_id 0 deleted
[ 4092.431652] [2682]: qla2x00t(5): local session for loop_id 0 deleted
[ 4092.431658] [2094]: qla2x00t(7): local session for loop_id 0 deleted
[ 4241.478163] [257]: ***WARNING***: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef
[ 4241.624262] [19]: ***WARNING***: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8
[ 4242.338187] [571]: ***WARNING***: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef
[ 4242.654111] [280]: ***WARNING***: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef
[ 4271.733128] [0]: ***WARNING***: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4271.738192] [257]: ***WARNING***: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef
[ 4272.335127] [0]: ***WARNING***: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4272.336941] [19]: ***WARNING***: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8
[ 4273.333548] [0]: ***WARNING***: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4273.900065] [0]: ***WARNING***: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4273.906835] [280]: ***WARNING***: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef
[ 4274.351844] [571]: ***WARNING***: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef
[ 4275.773438] [0]: ***WARNING***: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4276.300498] [0]: ***WARNING***: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4277.325981] [0]: ***WARNING***: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4277.896404] [0]: ***WARNING***: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a)
[ 4279.824787] [257]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 4279.827112] [257]: qla2x00t(5): local session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 4279.827139] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd)
[ 4280.351888] [19]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 4280.353929] [19]: qla2x00t(4): local session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added
[ 4280.353969] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc)
[ 4281.377267] [571]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 4281.379418] [571]: qla2x00t(6): local session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 4281.379444] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be)
[ 4281.947709] [280]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups)
[ 4281.950627] [280]: qla2x00t(7): local session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added
[ 4281.950652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
It's a shame that OL8 is giving issues because I really think that with the UEK is the appropriate path forward.
You could run OL8 in an LXD Linux Container on a CentOS 8 physical host or vice versa. That setup might give the best of both worlds for your use case. We could discuss that approach it's actually very easy to implement. I just need to understand again what was driving the switch to OL8.
On Sep 16, 2021 at 5:45 PM, Steffan Cline @.***> wrote:
In waiting for help from Bart/Vlad, I decided to reinstall CentOS and build scst against the latest kernel. As you'll see below, I don't have bad equipment and everything works. It seems there's some kind of issue with OL8 and SCST that still needs to be worked out.
Clean C8 install gives this:
dmesg | egrep "qla|scst"
[ 1.639762] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.104-k. [ 1.639968] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 75 iobase 0x(ptrval). [ 1.677696] qla2xxx [0000:41:00.0]-ffff:1: FC4 priority set to FCP [ 2.053257] scsi host1: qla2xxx [ 2.054770] qla2xxx [0000:41:00.0]-00fb:1: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 2.054775] qla2xxx [0000:41:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.0 hdma+ host#=1 fw=8.07.00 (90d5). [ 2.054902] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 102 iobase 0x(ptrval). [ 2.091672] qla2xxx [0000:41:00.1]-ffff:3: FC4 priority set to FCP [ 2.473079] scsi host3: qla2xxx [ 2.474568] qla2xxx [0000:41:00.1]-00fb:3: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 2.474572] qla2xxx [0000:41:00.1]-00fc:3: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.1 hdma+ host#=3 fw=8.07.00 (90d5). [ 2.474700] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 115 iobase 0x0000000062ddeb2b. [ 2.514343] qla2xxx [0000:44:00.0]-ffff:4: FC4 priority set to FCP [ 2.886191] scsi host4: qla2xxx [ 2.888044] qla2xxx [0000:44:00.0]-00fb:4: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 2.888048] qla2xxx [0000:44:00.0]-00fc:4: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.0 hdma+ host#=4 fw=8.07.00 (90d5). [ 2.888282] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x0000000007c56550. [ 2.927324] qla2xxx [0000:44:00.1]-ffff:5: FC4 priority set to FCP [ 3.129842] qla2xxx [0000:44:00.0]-500a:4: LOOP UP detected (8 Gbps). [ 3.299194] scsi host5: qla2xxx [ 3.300948] qla2xxx [0000:44:00.1]-00fb:5: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 3.300952] qla2xxx [0000:44:00.1]-00fc:5: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.1 hdma+ host#=5 fw=8.07.00 (90d5). [ 3.301088] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x000000008b7a7c0a. [ 3.340356] qla2xxx [0000:45:00.0]-ffff:6: FC4 priority set to FCP [ 3.542725] qla2xxx [0000:44:00.1]-500a:5: LOOP UP detected (8 Gbps). [ 3.712202] scsi host6: qla2xxx [ 3.713977] qla2xxx [0000:45:00.0]-00fb:6: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 3.713981] qla2xxx [0000:45:00.0]-00fc:6: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.0 hdma+ host#=6 fw=8.07.00 (90d5). [ 3.714199] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 123 iobase 0x00000000886b6d1d. [ 3.753370] qla2xxx [0000:45:00.1]-ffff:7: FC4 priority set to FCP [ 3.955700] qla2xxx [0000:45:00.0]-500a:6: LOOP UP detected (8 Gbps). [ 4.125240] scsi host7: qla2xxx [ 4.126953] qla2xxx [0000:45:00.1]-00fb:7: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 4.126957] qla2xxx [0000:45:00.1]-00fc:7: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.1 hdma+ host#=7 fw=8.07.00 (90d5). [ 4.127177] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 126 iobase 0x0000000071e2b922. [ 4.163698] qla2xxx [0000:4a:00.0]-ffff:8: FC4 priority set to FCP [ 4.368700] qla2xxx [0000:45:00.1]-500a:7: LOOP UP detected (8 Gbps). [ 4.535202] scsi host8: qla2xxx [ 4.536865] qla2xxx [0000:4a:00.0]-00fb:8: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 4.536868] qla2xxx [0000:4a:00.0]-00fc:8: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.0 hdma+ host#=8 fw=8.07.00 (90d5). [ 4.537028] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 36 iobase 0x00000000ad9668c4. [ 4.573703] qla2xxx [0000:4a:00.1]-ffff:9: FC4 priority set to FCP [ 4.945239] scsi host9: qla2xxx [ 4.947072] qla2xxx [0000:4a:00.1]-00fb:9: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 4.947076] qla2xxx [0000:4a:00.1]-00fc:9: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.1 hdma+ host#=9 fw=8.07.00 (90d5). [ 23.265006] qla2xxx [0000:41:00.0]-8038:1: Cable is unplugged... [ 23.649020] qla2xxx [0000:41:00.1]-8038:3: Cable is unplugged... [ 25.697031] qla2xxx [0000:4a:00.0]-8038:8: Cable is unplugged... [ 26.145010] qla2xxx [0000:4a:00.1]-8038:9: Cable is unplugged...
After installing SCST, we can see it starts up ok. I tested from all four active nodes and they're working as expected again.
[ 3904.261220] [6540]: scst: User interface thread started [ 3904.287296] [6534]: scst: Attached to scsi0, channel 2, id 0, lun 0, type 0 [ 3904.287320] [6534]: scst: Attached to scsi0, channel 2, id 1, lun 0, type 0 [ 3904.287337] [6534]: scst: Attached to scsi1, channel 2, id 0, lun 0, type 0 [ 3904.291090] [6574]: scst: Init thread started [ 3904.291115] [6575]: scst: Task management thread started [ 3904.291144] [6576]: scst: Management thread started [ 3904.291148] [6534]: scst: Target template copy_manager registered successfully [ 3904.291181] [6534]: scst: Target copy_manager_tgt for template copy_manager registered successfully [ 3904.291187] [6534]: scst: Using security group "copy_manager_tgt" for initiator "copy_manager_sess" (target copy_manager_tgt) [ 3904.291218] [6534]: scst: SCST version 3.6.0-pre loaded successfully (global max mem for commands ignored, per device 19312MB) [ 3904.291219] [6534]: scst: Enabled features: TRACING [ 3904.303134] [6577]: scst: Virtual device handler vdisk_fileio for type 0 registered successfully [ 3904.303137] [6577]: scst: Virtual device handler vdisk_blockio for type 0 registered successfully [ 3904.303140] [6577]: scst: Virtual device handler vdisk_nullio for type 0 registered successfully [ 3904.303142] [6577]: scst: Virtual device handler vcdrom for type 5 registered successfully [ 3904.309042] [6580]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre [ 3904.309141] [6580]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully [ 3904.309146] [6580]: scst: Target template qla2x00t registered successfully [ 3904.309173] [6580]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully [ 3904.309190] [6580]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully [ 3904.309206] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully [ 3904.309221] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully [ 3904.309236] [6580]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully [ 3904.309251] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully [ 3904.309267] [6580]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully [ 3904.309282] [6580]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully [ 3904.435412] [6540]: scst: Removed all devices from group copy_manager_tgt [ 3904.437717] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:94 [ 3904.439721] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:95 [ 3904.441673] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bc [ 3904.443554] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bd [ 3904.445490] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bc [ 3904.447375] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bd [ 3904.449275] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:be [ 3904.451186] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bf [ 3904.562083] [6540]: scst: Added device disk01 to group copy_manager_tgt (LUN 0, flags 0x4) to target copy_manager_tgt [ 3904.562099] [6540]: scst: Attached to virtual device disk01 (id 1) [ 3904.562748] [6540]: scst: Added device dummy to group copy_manager_tgt (LUN 1, flags 0x4) to target copy_manager_tgt [ 3904.562760] [6540]: scst: Attached to virtual device dummy (id 2) [ 3904.565805] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:94 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:94 [ 3904.565886] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:94 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:94 [ 3904.567691] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:95 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:95 [ 3904.567777] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:95 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:95 [ 3904.569601] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bc [ 3904.569689] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bc [ 3904.571375] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bd [ 3904.571460] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bd [ 3904.573244] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc [ 3904.573330] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc [ 3904.575062] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd [ 3904.575147] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd [ 3904.576860] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:be (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:be [ 3904.576950] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:be (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:be [ 3904.578666] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bf (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf [ 3904.578761] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bf (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf [ 3904.580441] [6540]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94 [ 3904.580443] [6540]: qla2x00t(2): Enabling target mode [ 3904.580451] qla2xxx [0000:41:00.0]-00af:2: [ 3904.590835] qla2xxx [0000:41:00.0]-1073:2: [ 3924.793502] qla2xxx [0000:41:00.0]-8038:2: [ 3925.075512] [6540]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95 [ 3925.075515] [6540]: qla2x00t(3): Enabling target mode [ 3925.075536] qla2xxx [0000:41:00.1]-00af:3: [ 3925.085463] qla2xxx [0000:41:00.1]-1073:3: [ 3945.289266] qla2xxx [0000:41:00.1]-8038:3: [ 3945.555278] [6540]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc [ 3945.555281] [6540]: qla2x00t(8): Enabling target mode [ 3945.555292] qla2xxx [0000:4a:00.0]-00af:8: [ 3945.565706] qla2xxx [0000:4a:00.0]-1073:8: [ 3965.769034] qla2xxx [0000:4a:00.0]-8038:8: [ 3966.034753] [6540]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd [ 3966.034755] [6540]: qla2x00t(9): Enabling target mode [ 3966.034787] qla2xxx [0000:4a:00.1]-00af:9: [ 3966.044678] qla2xxx [0000:4a:00.1]-1073:9: [ 3986.248795] qla2xxx [0000:4a:00.1]-8038:9: [ 3986.514445] [6540]: scst: Using autogenerated relative target id 5 for target 21:00:00:24:ff:6c:c5:bc [ 3986.514447] [6540]: qla2x00t(4): Enabling target mode [ 3986.514475] [6540]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added [ 3986.514484] qla2xxx [0000:44:00.0]-00af:4: [ 3986.514529] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc) [ 3986.515231] [2137]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs [ 3986.526552] qla2xxx [0000:44:00.0]-1073:4: [ 3986.833111] [0]: qla2x00t(4): LIP reset occurred [ 3986.868151] [0]: qla2x00t(4): LIP occurred [ 3986.871005] [0]: qla2x00t(4): Loop up occurred [ 3986.871443] qla2xxx [0000:44:00.0]-505f:4: [ 3987.072916] [2137]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2 [ 3987.076030] [2719]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3987.539057] [6540]: scst: Using autogenerated relative target id 6 for target 21:00:00:24:ff:6c:c5:bd [ 3987.539059] [6540]: qla2x00t(5): Enabling target mode [ 3987.539068] [6540]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3987.539108] qla2xxx [0000:44:00.1]-00af:5: [ 3987.539120] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd) [ 3987.539312] [2141]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs [ 3987.550804] qla2xxx [0000:44:00.1]-1073:5: [ 3987.857643] [0]: qla2x00t(5): LIP reset occurred [ 3987.892588] [0]: qla2x00t(5): LIP occurred [ 3987.895432] [0]: qla2x00t(5): Loop up occurred [ 3987.895868] qla2xxx [0000:44:00.1]-505f:5: [ 3988.096917] [2141]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2 [ 3988.100171] [2682]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3988.562572] [6540]: scst: Using autogenerated relative target id 7 for target 21:00:00:24:ff:6c:c5:be [ 3988.562573] [6540]: qla2x00t(6): Enabling target mode [ 3988.562605] [6540]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3988.562630] qla2xxx [0000:45:00.0]-00af:6: [ 3988.562652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be) [ 3988.563369] [2146]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs [ 3988.574630] qla2xxx [0000:45:00.0]-1073:6: [ 3988.881234] [0]: qla2x00t(6): LIP reset occurred [ 3988.917093] [0]: qla2x00t(6): LIP occurred [ 3988.919943] [0]: qla2x00t(6): Loop up occurred [ 3988.920379] qla2xxx [0000:45:00.0]-505f:6: [ 3989.120899] [2146]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2 [ 3989.124175] [19]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3989.586283] [6540]: scst: Using autogenerated relative target id 8 for target 21:00:00:24:ff:6c:c5:bf [ 3989.586285] [6540]: qla2x00t(7): Enabling target mode [ 3989.586299] [6540]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3989.586329] qla2xxx [0000:45:00.1]-00af:7: [ 3989.586347] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf) [ 3989.586533] [2155]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs [ 3989.597930] qla2xxx [0000:45:00.1]-1073:7: [ 3989.904539] [0]: qla2x00t(7): LIP reset occurred [ 3989.939350] [0]: qla2x00t(7): LIP occurred [ 3989.942202] [0]: qla2x00t(7): Loop up occurred [ 3989.942639] qla2xxx [0000:45:00.1]-505f:7: [ 3990.144812] [2155]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2 [ 3990.148121] [273]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4047.376705] [2719]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs [ 4051.471061] [2682]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs [ 4051.471221] [2094]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs [ 4051.474927] [19]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs [ 4088.335673] [2719]: qla2x00t(4): local session for loop_id 0 deleted [ 4092.431627] [19]: qla2x00t(6): local session for loop_id 0 deleted [ 4092.431652] [2682]: qla2x00t(5): local session for loop_id 0 deleted [ 4092.431658] [2094]: qla2x00t(7): local session for loop_id 0 deleted [ 4241.478163] [257]: WARNING: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef [ 4241.624262] [19]: WARNING: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8 [ 4242.338187] [571]: WARNING: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef [ 4242.654111] [280]: WARNING: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef [ 4271.733128] [0]: WARNING: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4271.738192] [257]: WARNING: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef [ 4272.335127] [0]: WARNING: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4272.336941] [19]: WARNING: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8 [ 4273.333548] [0]: WARNING: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4273.900065] [0]: WARNING: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4273.906835] [280]: WARNING: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef [ 4274.351844] [571]: WARNING: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef [ 4275.773438] [0]: WARNING: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4276.300498] [0]: WARNING: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4277.325981] [0]: WARNING: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4277.896404] [0]: WARNING: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4279.824787] [257]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4279.827112] [257]: qla2x00t(5): local session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4279.827139] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd) [ 4280.351888] [19]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4280.353929] [19]: qla2x00t(4): local session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added [ 4280.353969] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc) [ 4281.377267] [571]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4281.379418] [571]: qla2x00t(6): local session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4281.379444] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be) [ 4281.947709] [280]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4281.950627] [280]: qla2x00t(7): local session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4281.950652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
It's a shame that OL8 is giving issues because I really think that with the UEK is the appropriate path forward.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/bvanassche/scst/issues/48#issuecomment-921309731, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACMBJYOGN4SFHWZEQUYBCGTUCJXSFANCNFSM5EC3XVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
Also did you try running the RH compatible kernel instead of the UEK kernel that ships with OL 8 ?
Then the other "dramatic" option would be to use an Ubuntu Linux server as Ubuntu is well-known for having lots of older drivers supported.
Just throwing out some options...
On Sep 16, 2021 at 5:45 PM, Steffan Cline @.***> wrote:
In waiting for help from Bart/Vlad, I decided to reinstall CentOS and build scst against the latest kernel. As you'll see below, I don't have bad equipment and everything works. It seems there's some kind of issue with OL8 and SCST that still needs to be worked out.
Clean C8 install gives this:
dmesg | egrep "qla|scst"
[ 1.639762] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.104-k. [ 1.639968] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 75 iobase 0x(ptrval). [ 1.677696] qla2xxx [0000:41:00.0]-ffff:1: FC4 priority set to FCP [ 2.053257] scsi host1: qla2xxx [ 2.054770] qla2xxx [0000:41:00.0]-00fb:1: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 2.054775] qla2xxx [0000:41:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.0 hdma+ host#=1 fw=8.07.00 (90d5). [ 2.054902] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 102 iobase 0x(ptrval). [ 2.091672] qla2xxx [0000:41:00.1]-ffff:3: FC4 priority set to FCP [ 2.473079] scsi host3: qla2xxx [ 2.474568] qla2xxx [0000:41:00.1]-00fb:3: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 2.474572] qla2xxx [0000:41:00.1]-00fc:3: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.1 hdma+ host#=3 fw=8.07.00 (90d5). [ 2.474700] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 115 iobase 0x0000000062ddeb2b. [ 2.514343] qla2xxx [0000:44:00.0]-ffff:4: FC4 priority set to FCP [ 2.886191] scsi host4: qla2xxx [ 2.888044] qla2xxx [0000:44:00.0]-00fb:4: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 2.888048] qla2xxx [0000:44:00.0]-00fc:4: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.0 hdma+ host#=4 fw=8.07.00 (90d5). [ 2.888282] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x0000000007c56550. [ 2.927324] qla2xxx [0000:44:00.1]-ffff:5: FC4 priority set to FCP [ 3.129842] qla2xxx [0000:44:00.0]-500a:4: LOOP UP detected (8 Gbps). [ 3.299194] scsi host5: qla2xxx [ 3.300948] qla2xxx [0000:44:00.1]-00fb:5: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 3.300952] qla2xxx [0000:44:00.1]-00fc:5: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.1 hdma+ host#=5 fw=8.07.00 (90d5). [ 3.301088] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x000000008b7a7c0a. [ 3.340356] qla2xxx [0000:45:00.0]-ffff:6: FC4 priority set to FCP [ 3.542725] qla2xxx [0000:44:00.1]-500a:5: LOOP UP detected (8 Gbps). [ 3.712202] scsi host6: qla2xxx [ 3.713977] qla2xxx [0000:45:00.0]-00fb:6: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 3.713981] qla2xxx [0000:45:00.0]-00fc:6: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.0 hdma+ host#=6 fw=8.07.00 (90d5). [ 3.714199] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 123 iobase 0x00000000886b6d1d. [ 3.753370] qla2xxx [0000:45:00.1]-ffff:7: FC4 priority set to FCP [ 3.955700] qla2xxx [0000:45:00.0]-500a:6: LOOP UP detected (8 Gbps). [ 4.125240] scsi host7: qla2xxx [ 4.126953] qla2xxx [0000:45:00.1]-00fb:7: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 4.126957] qla2xxx [0000:45:00.1]-00fc:7: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.1 hdma+ host#=7 fw=8.07.00 (90d5). [ 4.127177] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 126 iobase 0x0000000071e2b922. [ 4.163698] qla2xxx [0000:4a:00.0]-ffff:8: FC4 priority set to FCP [ 4.368700] qla2xxx [0000:45:00.1]-500a:7: LOOP UP detected (8 Gbps). [ 4.535202] scsi host8: qla2xxx [ 4.536865] qla2xxx [0000:4a:00.0]-00fb:8: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 4.536868] qla2xxx [0000:4a:00.0]-00fc:8: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.0 hdma+ host#=8 fw=8.07.00 (90d5). [ 4.537028] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 36 iobase 0x00000000ad9668c4. [ 4.573703] qla2xxx [0000:4a:00.1]-ffff:9: FC4 priority set to FCP [ 4.945239] scsi host9: qla2xxx [ 4.947072] qla2xxx [0000:4a:00.1]-00fb:9: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 4.947076] qla2xxx [0000:4a:00.1]-00fc:9: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.1 hdma+ host#=9 fw=8.07.00 (90d5). [ 23.265006] qla2xxx [0000:41:00.0]-8038:1: Cable is unplugged... [ 23.649020] qla2xxx [0000:41:00.1]-8038:3: Cable is unplugged... [ 25.697031] qla2xxx [0000:4a:00.0]-8038:8: Cable is unplugged... [ 26.145010] qla2xxx [0000:4a:00.1]-8038:9: Cable is unplugged...
After installing SCST, we can see it starts up ok. I tested from all four active nodes and they're working as expected again.
[ 3904.261220] [6540]: scst: User interface thread started [ 3904.287296] [6534]: scst: Attached to scsi0, channel 2, id 0, lun 0, type 0 [ 3904.287320] [6534]: scst: Attached to scsi0, channel 2, id 1, lun 0, type 0 [ 3904.287337] [6534]: scst: Attached to scsi1, channel 2, id 0, lun 0, type 0 [ 3904.291090] [6574]: scst: Init thread started [ 3904.291115] [6575]: scst: Task management thread started [ 3904.291144] [6576]: scst: Management thread started [ 3904.291148] [6534]: scst: Target template copy_manager registered successfully [ 3904.291181] [6534]: scst: Target copy_manager_tgt for template copy_manager registered successfully [ 3904.291187] [6534]: scst: Using security group "copy_manager_tgt" for initiator "copy_manager_sess" (target copy_manager_tgt) [ 3904.291218] [6534]: scst: SCST version 3.6.0-pre loaded successfully (global max mem for commands ignored, per device 19312MB) [ 3904.291219] [6534]: scst: Enabled features: TRACING [ 3904.303134] [6577]: scst: Virtual device handler vdisk_fileio for type 0 registered successfully [ 3904.303137] [6577]: scst: Virtual device handler vdisk_blockio for type 0 registered successfully [ 3904.303140] [6577]: scst: Virtual device handler vdisk_nullio for type 0 registered successfully [ 3904.303142] [6577]: scst: Virtual device handler vcdrom for type 5 registered successfully [ 3904.309042] [6580]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre [ 3904.309141] [6580]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully [ 3904.309146] [6580]: scst: Target template qla2x00t registered successfully [ 3904.309173] [6580]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully [ 3904.309190] [6580]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully [ 3904.309206] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully [ 3904.309221] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully [ 3904.309236] [6580]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully [ 3904.309251] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully [ 3904.309267] [6580]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully [ 3904.309282] [6580]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully [ 3904.435412] [6540]: scst: Removed all devices from group copy_manager_tgt [ 3904.437717] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:94 [ 3904.439721] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:95 [ 3904.441673] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bc [ 3904.443554] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bd [ 3904.445490] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bc [ 3904.447375] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bd [ 3904.449275] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:be [ 3904.451186] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bf [ 3904.562083] [6540]: scst: Added device disk01 to group copy_manager_tgt (LUN 0, flags 0x4) to target copy_manager_tgt [ 3904.562099] [6540]: scst: Attached to virtual device disk01 (id 1) [ 3904.562748] [6540]: scst: Added device dummy to group copy_manager_tgt (LUN 1, flags 0x4) to target copy_manager_tgt [ 3904.562760] [6540]: scst: Attached to virtual device dummy (id 2) [ 3904.565805] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:94 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:94 [ 3904.565886] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:94 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:94 [ 3904.567691] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:95 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:95 [ 3904.567777] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:95 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:95 [ 3904.569601] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bc [ 3904.569689] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bc [ 3904.571375] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bd [ 3904.571460] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bd [ 3904.573244] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc [ 3904.573330] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc [ 3904.575062] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd [ 3904.575147] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd [ 3904.576860] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:be (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:be [ 3904.576950] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:be (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:be [ 3904.578666] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bf (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf [ 3904.578761] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bf (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf [ 3904.580441] [6540]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94 [ 3904.580443] [6540]: qla2x00t(2): Enabling target mode [ 3904.580451] qla2xxx [0000:41:00.0]-00af:2: [ 3904.590835] qla2xxx [0000:41:00.0]-1073:2: [ 3924.793502] qla2xxx [0000:41:00.0]-8038:2: [ 3925.075512] [6540]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95 [ 3925.075515] [6540]: qla2x00t(3): Enabling target mode [ 3925.075536] qla2xxx [0000:41:00.1]-00af:3: [ 3925.085463] qla2xxx [0000:41:00.1]-1073:3: [ 3945.289266] qla2xxx [0000:41:00.1]-8038:3: [ 3945.555278] [6540]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc [ 3945.555281] [6540]: qla2x00t(8): Enabling target mode [ 3945.555292] qla2xxx [0000:4a:00.0]-00af:8: [ 3945.565706] qla2xxx [0000:4a:00.0]-1073:8: [ 3965.769034] qla2xxx [0000:4a:00.0]-8038:8: [ 3966.034753] [6540]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd [ 3966.034755] [6540]: qla2x00t(9): Enabling target mode [ 3966.034787] qla2xxx [0000:4a:00.1]-00af:9: [ 3966.044678] qla2xxx [0000:4a:00.1]-1073:9: [ 3986.248795] qla2xxx [0000:4a:00.1]-8038:9: [ 3986.514445] [6540]: scst: Using autogenerated relative target id 5 for target 21:00:00:24:ff:6c:c5:bc [ 3986.514447] [6540]: qla2x00t(4): Enabling target mode [ 3986.514475] [6540]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added [ 3986.514484] qla2xxx [0000:44:00.0]-00af:4: [ 3986.514529] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc) [ 3986.515231] [2137]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs [ 3986.526552] qla2xxx [0000:44:00.0]-1073:4: [ 3986.833111] [0]: qla2x00t(4): LIP reset occurred [ 3986.868151] [0]: qla2x00t(4): LIP occurred [ 3986.871005] [0]: qla2x00t(4): Loop up occurred [ 3986.871443] qla2xxx [0000:44:00.0]-505f:4: [ 3987.072916] [2137]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2 [ 3987.076030] [2719]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3987.539057] [6540]: scst: Using autogenerated relative target id 6 for target 21:00:00:24:ff:6c:c5:bd [ 3987.539059] [6540]: qla2x00t(5): Enabling target mode [ 3987.539068] [6540]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3987.539108] qla2xxx [0000:44:00.1]-00af:5: [ 3987.539120] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd) [ 3987.539312] [2141]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs [ 3987.550804] qla2xxx [0000:44:00.1]-1073:5: [ 3987.857643] [0]: qla2x00t(5): LIP reset occurred [ 3987.892588] [0]: qla2x00t(5): LIP occurred [ 3987.895432] [0]: qla2x00t(5): Loop up occurred [ 3987.895868] qla2xxx [0000:44:00.1]-505f:5: [ 3988.096917] [2141]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2 [ 3988.100171] [2682]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3988.562572] [6540]: scst: Using autogenerated relative target id 7 for target 21:00:00:24:ff:6c:c5:be [ 3988.562573] [6540]: qla2x00t(6): Enabling target mode [ 3988.562605] [6540]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3988.562630] qla2xxx [0000:45:00.0]-00af:6: [ 3988.562652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be) [ 3988.563369] [2146]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs [ 3988.574630] qla2xxx [0000:45:00.0]-1073:6: [ 3988.881234] [0]: qla2x00t(6): LIP reset occurred [ 3988.917093] [0]: qla2x00t(6): LIP occurred [ 3988.919943] [0]: qla2x00t(6): Loop up occurred [ 3988.920379] qla2xxx [0000:45:00.0]-505f:6: [ 3989.120899] [2146]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2 [ 3989.124175] [19]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3989.586283] [6540]: scst: Using autogenerated relative target id 8 for target 21:00:00:24:ff:6c:c5:bf [ 3989.586285] [6540]: qla2x00t(7): Enabling target mode [ 3989.586299] [6540]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3989.586329] qla2xxx [0000:45:00.1]-00af:7: [ 3989.586347] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf) [ 3989.586533] [2155]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs [ 3989.597930] qla2xxx [0000:45:00.1]-1073:7: [ 3989.904539] [0]: qla2x00t(7): LIP reset occurred [ 3989.939350] [0]: qla2x00t(7): LIP occurred [ 3989.942202] [0]: qla2x00t(7): Loop up occurred [ 3989.942639] qla2xxx [0000:45:00.1]-505f:7: [ 3990.144812] [2155]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2 [ 3990.148121] [273]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4047.376705] [2719]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs [ 4051.471061] [2682]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs [ 4051.471221] [2094]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs [ 4051.474927] [19]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs [ 4088.335673] [2719]: qla2x00t(4): local session for loop_id 0 deleted [ 4092.431627] [19]: qla2x00t(6): local session for loop_id 0 deleted [ 4092.431652] [2682]: qla2x00t(5): local session for loop_id 0 deleted [ 4092.431658] [2094]: qla2x00t(7): local session for loop_id 0 deleted [ 4241.478163] [257]: WARNING: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef [ 4241.624262] [19]: WARNING: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8 [ 4242.338187] [571]: WARNING: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef [ 4242.654111] [280]: WARNING: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef [ 4271.733128] [0]: WARNING: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4271.738192] [257]: WARNING: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef [ 4272.335127] [0]: WARNING: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4272.336941] [19]: WARNING: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8 [ 4273.333548] [0]: WARNING: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4273.900065] [0]: WARNING: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4273.906835] [280]: WARNING: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef [ 4274.351844] [571]: WARNING: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef [ 4275.773438] [0]: WARNING: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4276.300498] [0]: WARNING: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4277.325981] [0]: WARNING: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4277.896404] [0]: WARNING: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4279.824787] [257]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4279.827112] [257]: qla2x00t(5): local session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4279.827139] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd) [ 4280.351888] [19]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4280.353929] [19]: qla2x00t(4): local session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added [ 4280.353969] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc) [ 4281.377267] [571]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4281.379418] [571]: qla2x00t(6): local session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4281.379444] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be) [ 4281.947709] [280]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4281.950627] [280]: qla2x00t(7): local session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4281.950652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
It's a shame that OL8 is giving issues because I really think that with the UEK is the appropriate path forward.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/bvanassche/scst/issues/48#issuecomment-921309731, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACMBJYOGN4SFHWZEQUYBCGTUCJXSFANCNFSM5EC3XVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
What is the model and brand info of the hardware that is throwing the error with Oracle Linux ?
On Sep 16, 2021 at 6:10 PM, Steffan Cline @.***> wrote:
Since you’re in the US, would you mind a quick call?
You can probably help give me some better direction than what I’m doing.
Thank you,
Steffan Cline
@.***
602-793-0014
On 9/16/21, 4:06 PM, "Gilbert Standen" @.***> wrote:
Also did you try running the RH compatible kernel instead of the UEK kernel that ships with OL 8 ?
Then the other "dramatic" option would be to use an Ubuntu Linux server as Ubuntu is well-known for having lots of older drivers supported.
Just throwing out some options...
On Sep 16, 2021 at 5:45 PM, Steffan Cline @.***> wrote:
In waiting for help from Bart/Vlad, I decided to reinstall CentOS and build scst against the latest kernel. As you'll see below, I don't have bad equipment and everything works. It seems there's some kind of issue with OL8 and SCST that still needs to be worked out.
Clean C8 install gives this:
dmesg | egrep "qla|scst"
[ 1.639762] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.02.00.104-k. [ 1.639968] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 75 iobase 0x(ptrval). [ 1.677696] qla2xxx [0000:41:00.0]-ffff:1: FC4 priority set to FCP [ 2.053257] scsi host1: qla2xxx [ 2.054770] qla2xxx [0000:41:00.0]-00fb:1: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 2.054775] qla2xxx [0000:41:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.0 hdma+ host#=1 fw=8.07.00 (90d5). [ 2.054902] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 102 iobase 0x(ptrval). [ 2.091672] qla2xxx [0000:41:00.1]-ffff:3: FC4 priority set to FCP [ 2.473079] scsi host3: qla2xxx [ 2.474568] qla2xxx [0000:41:00.1]-00fb:3: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 2.474572] qla2xxx [0000:41:00.1]-00fc:3: ISP2532: PCIe (5.0GT/s x8) @ 0000:41:00.1 hdma+ host#=3 fw=8.07.00 (90d5). [ 2.474700] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 115 iobase 0x0000000062ddeb2b. [ 2.514343] qla2xxx [0000:44:00.0]-ffff:4: FC4 priority set to FCP [ 2.886191] scsi host4: qla2xxx [ 2.888044] qla2xxx [0000:44:00.0]-00fb:4: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 2.888048] qla2xxx [0000:44:00.0]-00fc:4: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.0 hdma+ host#=4 fw=8.07.00 (90d5). [ 2.888282] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x0000000007c56550. [ 2.927324] qla2xxx [0000:44:00.1]-ffff:5: FC4 priority set to FCP [ 3.129842] qla2xxx [0000:44:00.0]-500a:4: LOOP UP detected (8 Gbps). [ 3.299194] scsi host5: qla2xxx [ 3.300948] qla2xxx [0000:44:00.1]-00fb:5: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 3.300952] qla2xxx [0000:44:00.1]-00fc:5: ISP2532: PCIe (5.0GT/s x8) @ 0000:44:00.1 hdma+ host#=5 fw=8.07.00 (90d5). [ 3.301088] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 118 iobase 0x000000008b7a7c0a. [ 3.340356] qla2xxx [0000:45:00.0]-ffff:6: FC4 priority set to FCP [ 3.542725] qla2xxx [0000:44:00.1]-500a:5: LOOP UP detected (8 Gbps). [ 3.712202] scsi host6: qla2xxx [ 3.713977] qla2xxx [0000:45:00.0]-00fb:6: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 3.713981] qla2xxx [0000:45:00.0]-00fc:6: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.0 hdma+ host#=6 fw=8.07.00 (90d5). [ 3.714199] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 123 iobase 0x00000000886b6d1d. [ 3.753370] qla2xxx [0000:45:00.1]-ffff:7: FC4 priority set to FCP [ 3.955700] qla2xxx [0000:45:00.0]-500a:6: LOOP UP detected (8 Gbps). [ 4.125240] scsi host7: qla2xxx [ 4.126953] qla2xxx [0000:45:00.1]-00fb:7: QLogic QLE2564 - PCI-Express Quad Channel 8Gb Fibre Channel HBA. [ 4.126957] qla2xxx [0000:45:00.1]-00fc:7: ISP2532: PCIe (5.0GT/s x8) @ 0000:45:00.1 hdma+ host#=7 fw=8.07.00 (90d5). [ 4.127177] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 126 iobase 0x0000000071e2b922. [ 4.163698] qla2xxx [0000:4a:00.0]-ffff:8: FC4 priority set to FCP [ 4.368700] qla2xxx [0000:45:00.1]-500a:7: LOOP UP detected (8 Gbps). [ 4.535202] scsi host8: qla2xxx [ 4.536865] qla2xxx [0000:4a:00.0]-00fb:8: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 4.536868] qla2xxx [0000:4a:00.0]-00fc:8: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.0 hdma+ host#=8 fw=8.07.00 (90d5). [ 4.537028] qla2xxx [0000:00:00.0]-001d: : Found an ISP2532 irq 36 iobase 0x00000000ad9668c4. [ 4.573703] qla2xxx [0000:4a:00.1]-ffff:9: FC4 priority set to FCP [ 4.945239] scsi host9: qla2xxx [ 4.947072] qla2xxx [0000:4a:00.1]-00fb:9: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA. [ 4.947076] qla2xxx [0000:4a:00.1]-00fc:9: ISP2532: PCIe (5.0GT/s x8) @ 0000:4a:00.1 hdma+ host#=9 fw=8.07.00 (90d5). [ 23.265006] qla2xxx [0000:41:00.0]-8038:1: Cable is unplugged... [ 23.649020] qla2xxx [0000:41:00.1]-8038:3: Cable is unplugged... [ 25.697031] qla2xxx [0000:4a:00.0]-8038:8: Cable is unplugged... [ 26.145010] qla2xxx [0000:4a:00.1]-8038:9: Cable is unplugged...
After installing SCST, we can see it starts up ok. I tested from all four active nodes and they're working as expected again.
[ 3904.261220] [6540]: scst: User interface thread started [ 3904.287296] [6534]: scst: Attached to scsi0, channel 2, id 0, lun 0, type 0 [ 3904.287320] [6534]: scst: Attached to scsi0, channel 2, id 1, lun 0, type 0 [ 3904.287337] [6534]: scst: Attached to scsi1, channel 2, id 0, lun 0, type 0 [ 3904.291090] [6574]: scst: Init thread started [ 3904.291115] [6575]: scst: Task management thread started [ 3904.291144] [6576]: scst: Management thread started [ 3904.291148] [6534]: scst: Target template copy_manager registered successfully [ 3904.291181] [6534]: scst: Target copy_manager_tgt for template copy_manager registered successfully [ 3904.291187] [6534]: scst: Using security group "copy_manager_tgt" for initiator "copy_manager_sess" (target copy_manager_tgt) [ 3904.291218] [6534]: scst: SCST version 3.6.0-pre loaded successfully (global max mem for commands ignored, per device 19312MB) [ 3904.291219] [6534]: scst: Enabled features: TRACING [ 3904.303134] [6577]: scst: Virtual device handler vdisk_fileio for type 0 registered successfully [ 3904.303137] [6577]: scst: Virtual device handler vdisk_blockio for type 0 registered successfully [ 3904.303140] [6577]: scst: Virtual device handler vdisk_nullio for type 0 registered successfully [ 3904.303142] [6577]: scst: Virtual device handler vcdrom for type 5 registered successfully [ 3904.309042] [6580]: qla2x00t: Initializing QLogic Fibre Channel HBA Driver target mode addon version 3.6.0-pre [ 3904.309141] [6580]: qla2x00t: Target mode driver for QLogic 2x00 controller registered successfully [ 3904.309146] [6580]: scst: Target template qla2x00t registered successfully [ 3904.309173] [6580]: scst: Target 21:00:00:24:ff:57:76:94 for template qla2x00t registered successfully [ 3904.309190] [6580]: scst: Target 21:00:00:24:ff:57:76:95 for template qla2x00t registered successfully [ 3904.309206] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bc for template qla2x00t registered successfully [ 3904.309221] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bd for template qla2x00t registered successfully [ 3904.309236] [6580]: scst: Target 21:00:00:24:ff:6c:c5:be for template qla2x00t registered successfully [ 3904.309251] [6580]: scst: Target 21:00:00:24:ff:6c:c5:bf for template qla2x00t registered successfully [ 3904.309267] [6580]: scst: Target 21:00:00:24:ff:5a:df:bc for template qla2x00t registered successfully [ 3904.309282] [6580]: scst: Target 21:00:00:24:ff:5a:df:bd for template qla2x00t registered successfully [ 3904.435412] [6540]: scst: Removed all devices from group copy_manager_tgt [ 3904.437717] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:94 [ 3904.439721] [6540]: scst: Removed all devices from group 21:00:00:24:ff:57:76:95 [ 3904.441673] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bc [ 3904.443554] [6540]: scst: Removed all devices from group 21:00:00:24:ff:5a:df:bd [ 3904.445490] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bc [ 3904.447375] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bd [ 3904.449275] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:be [ 3904.451186] [6540]: scst: Removed all devices from group 21:00:00:24:ff:6c:c5:bf [ 3904.562083] [6540]: scst: Added device disk01 to group copy_manager_tgt (LUN 0, flags 0x4) to target copy_manager_tgt [ 3904.562099] [6540]: scst: Attached to virtual device disk01 (id 1) [ 3904.562748] [6540]: scst: Added device dummy to group copy_manager_tgt (LUN 1, flags 0x4) to target copy_manager_tgt [ 3904.562760] [6540]: scst: Attached to virtual device dummy (id 2) [ 3904.565805] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:94 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:94 [ 3904.565886] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:94 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:94 [ 3904.567691] [6540]: scst: Added device dummy to group 21:00:00:24:ff:57:76:95 (LUN 0, flags 0x2) to target 21:00:00:24:ff:57:76:95 [ 3904.567777] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:57:76:95 (LUN 1, flags 0x2) to target 21:00:00:24:ff:57:76:95 [ 3904.569601] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bc [ 3904.569689] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bc [ 3904.571375] [6540]: scst: Added device dummy to group 21:00:00:24:ff:5a:df:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:5a:df:bd [ 3904.571460] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:5a:df:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:5a:df:bd [ 3904.573244] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bc (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc [ 3904.573330] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bc (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bc [ 3904.575062] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bd (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd [ 3904.575147] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bd (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bd [ 3904.576860] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:be (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:be [ 3904.576950] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:be (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:be [ 3904.578666] [6540]: scst: Added device dummy to group 21:00:00:24:ff:6c:c5:bf (LUN 0, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf [ 3904.578761] [6540]: scst: Added device disk01 to group 21:00:00:24:ff:6c:c5:bf (LUN 1, flags 0x2) to target 21:00:00:24:ff:6c:c5:bf [ 3904.580441] [6540]: scst: Using autogenerated relative target id 1 for target 21:00:00:24:ff:57:76:94 [ 3904.580443] [6540]: qla2x00t(2): Enabling target mode [ 3904.580451] qla2xxx [0000:41:00.0]-00af:2: [ 3904.590835] qla2xxx [0000:41:00.0]-1073:2: [ 3924.793502] qla2xxx [0000:41:00.0]-8038:2: [ 3925.075512] [6540]: scst: Using autogenerated relative target id 2 for target 21:00:00:24:ff:57:76:95 [ 3925.075515] [6540]: qla2x00t(3): Enabling target mode [ 3925.075536] qla2xxx [0000:41:00.1]-00af:3: [ 3925.085463] qla2xxx [0000:41:00.1]-1073:3: [ 3945.289266] qla2xxx [0000:41:00.1]-8038:3: [ 3945.555278] [6540]: scst: Using autogenerated relative target id 3 for target 21:00:00:24:ff:5a:df:bc [ 3945.555281] [6540]: qla2x00t(8): Enabling target mode [ 3945.555292] qla2xxx [0000:4a:00.0]-00af:8: [ 3945.565706] qla2xxx [0000:4a:00.0]-1073:8: [ 3965.769034] qla2xxx [0000:4a:00.0]-8038:8: [ 3966.034753] [6540]: scst: Using autogenerated relative target id 4 for target 21:00:00:24:ff:5a:df:bd [ 3966.034755] [6540]: qla2x00t(9): Enabling target mode [ 3966.034787] qla2xxx [0000:4a:00.1]-00af:9: [ 3966.044678] qla2xxx [0000:4a:00.1]-1073:9: [ 3986.248795] qla2xxx [0000:4a:00.1]-8038:9: [ 3986.514445] [6540]: scst: Using autogenerated relative target id 5 for target 21:00:00:24:ff:6c:c5:bc [ 3986.514447] [6540]: qla2x00t(4): Enabling target mode [ 3986.514475] [6540]: qla2x00t(4): session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added [ 3986.514484] qla2xxx [0000:44:00.0]-00af:4: [ 3986.514529] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc) [ 3986.515231] [2137]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs [ 3986.526552] qla2xxx [0000:44:00.0]-1073:4: [ 3986.833111] [0]: qla2x00t(4): LIP reset occurred [ 3986.868151] [0]: qla2x00t(4): LIP occurred [ 3986.871005] [0]: qla2x00t(4): Loop up occurred [ 3986.871443] qla2xxx [0000:44:00.0]-505f:4: [ 3987.072916] [2137]: qla2x00t(4): LIP reset (loop 0xffff), subcode 2 [ 3987.076030] [2719]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3987.539057] [6540]: scst: Using autogenerated relative target id 6 for target 21:00:00:24:ff:6c:c5:bd [ 3987.539059] [6540]: qla2x00t(5): Enabling target mode [ 3987.539068] [6540]: qla2x00t(5): session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3987.539108] qla2xxx [0000:44:00.1]-00af:5: [ 3987.539120] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd) [ 3987.539312] [2141]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs [ 3987.550804] qla2xxx [0000:44:00.1]-1073:5: [ 3987.857643] [0]: qla2x00t(5): LIP reset occurred [ 3987.892588] [0]: qla2x00t(5): LIP occurred [ 3987.895432] [0]: qla2x00t(5): Loop up occurred [ 3987.895868] qla2xxx [0000:44:00.1]-505f:5: [ 3988.096917] [2141]: qla2x00t(5): LIP reset (loop 0xffff), subcode 2 [ 3988.100171] [2682]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3988.562572] [6540]: scst: Using autogenerated relative target id 7 for target 21:00:00:24:ff:6c:c5:be [ 3988.562573] [6540]: qla2x00t(6): Enabling target mode [ 3988.562605] [6540]: qla2x00t(6): session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3988.562630] qla2xxx [0000:45:00.0]-00af:6: [ 3988.562652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be) [ 3988.563369] [2146]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs [ 3988.574630] qla2xxx [0000:45:00.0]-1073:6: [ 3988.881234] [0]: qla2x00t(6): LIP reset occurred [ 3988.917093] [0]: qla2x00t(6): LIP occurred [ 3988.919943] [0]: qla2x00t(6): Loop up occurred [ 3988.920379] qla2xxx [0000:45:00.0]-505f:6: [ 3989.120899] [2146]: qla2x00t(6): LIP reset (loop 0xffff), subcode 2 [ 3989.124175] [19]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 3989.586283] [6540]: scst: Using autogenerated relative target id 8 for target 21:00:00:24:ff:6c:c5:bf [ 3989.586285] [6540]: qla2x00t(7): Enabling target mode [ 3989.586299] [6540]: qla2x00t(7): session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 3989.586329] qla2xxx [0000:45:00.1]-00af:7: [ 3989.586347] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf) [ 3989.586533] [2155]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs [ 3989.597930] qla2xxx [0000:45:00.1]-1073:7: [ 3989.904539] [0]: qla2x00t(7): LIP reset occurred [ 3989.939350] [0]: qla2x00t(7): LIP occurred [ 3989.942202] [0]: qla2x00t(7): Loop up occurred [ 3989.942639] qla2xxx [0000:45:00.1]-505f:7: [ 3990.144812] [2155]: qla2x00t(7): LIP reset (loop 0xffff), subcode 2 [ 3990.148121] [273]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4047.376705] [2719]: qla2x00t(4): session for port 21:00:f4:e9:d4:50:84:a3 (loop_id 0) scheduled for deletion in 40 secs [ 4051.471061] [2682]: qla2x00t(5): session for port 21:00:00:24:ff:57:14:f9 (loop_id 0) scheduled for deletion in 40 secs [ 4051.471221] [2094]: qla2x00t(7): session for port 21:00:00:24:ff:57:14:45 (loop_id 0) scheduled for deletion in 40 secs [ 4051.474927] [19]: qla2x00t(6): session for port 21:00:00:24:ff:56:b8:4f (loop_id 0) scheduled for deletion in 40 secs [ 4088.335673] [2719]: qla2x00t(4): local session for loop_id 0 deleted [ 4092.431627] [19]: qla2x00t(6): local session for loop_id 0 deleted [ 4092.431652] [2682]: qla2x00t(5): local session for loop_id 0 deleted [ 4092.431658] [2094]: qla2x00t(7): local session for loop_id 0 deleted [ 4241.478163] [257]: WARNING: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef [ 4241.624262] [19]: WARNING: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8 [ 4242.338187] [571]: WARNING: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef [ 4242.654111] [280]: WARNING: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef [ 4271.733128] [0]: WARNING: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4271.738192] [257]: WARNING: qla2x00t(5): Unable to find initiator with S_ID 0:0:ef [ 4272.335127] [0]: WARNING: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4272.336941] [19]: WARNING: qla2x00t(4): Unable to find initiator with S_ID 0:0:e8 [ 4273.333548] [0]: WARNING: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4273.900065] [0]: WARNING: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4273.906835] [280]: WARNING: qla2x00t(7): Unable to find initiator with S_ID 0:0:ef [ 4274.351844] [571]: WARNING: qla2x00t(6): Unable to find initiator with S_ID 0:0:ef [ 4275.773438] [0]: WARNING: qla2x00t(5): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4276.300498] [0]: WARNING: qla2x00t(4): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4277.325981] [0]: WARNING: qla2x00t(6): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4277.896404] [0]: WARNING: qla2x00t(7): ABTS_RESP_24XX failed 31 (subcode 19:a) [ 4279.824787] [257]: qla2x00t(5): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4279.827112] [257]: qla2x00t(5): local session for wwn 21:00:00:24:ff:57:14:f9 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4279.827139] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bd" for initiator "21:00:00:24:ff:57:14:f9" (target 21:00:00:24:ff:6c:c5:bd) [ 4280.351888] [19]: qla2x00t(4): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4280.353929] [19]: qla2x00t(4): local session for wwn 21:00:f4:e9:d4:50:84:a3 (loop_id 0, s_id 0:0:e8, confirmed completion supported) added [ 4280.353969] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bc" for initiator "21:00:f4:e9:d4:50:84:a3" (target 21:00:00:24:ff:6c:c5:bc) [ 4281.377267] [571]: qla2x00t(6): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4281.379418] [571]: qla2x00t(6): local session for wwn 21:00:00:24:ff:56:b8:4f (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4281.379444] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:be" for initiator "21:00:00:24:ff:56:b8:4f" (target 21:00:00:24:ff:6c:c5:be) [ 4281.947709] [280]: qla2x00t(7): RSCN registration failed: 0x2 (OK for non-fabric setups) [ 4281.950627] [280]: qla2x00t(7): local session for wwn 21:00:00:24:ff:57:14:45 (loop_id 0, s_id 0:0:ef, confirmed completion supported) added [ 4281.950652] [6576]: scst: Using security group "21:00:00:24:ff:6c:c5:bf" for initiator "21:00:00:24:ff:57:14:45" (target 21:00:00:24:ff:6c:c5:bf)
It's a shame that OL8 is giving issues because I really think that with the UEK is the appropriate path forward.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/bvanassche/scst/issues/48#issuecomment-921309731, or unsubscribe < https://github.com/notifications/unsubscribe-auth/ACMBJYOGN4SFHWZEQUYBCGTUCJXSFANCNFSM5EC3XVQQ
. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/bvanassche/scst/issues/48#issuecomment-921323129, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACMBJYJ33XYHDBGUHO7JPZLUCJ2N7ANCNFSM5EC3XVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
@gstanden the original post contains the nearly full system inventory. The server is a Dell R720xd with 3x QLogic QLE2562 - PCI-Express Dual Channel 4 port 8Gb Fibre Channel HBA.
55. FRMW, QLogic QLE2562 Adapter ( Version : 09.01.07 )
56. FRMW, QLogic QLE2562 Adapter ( Version : 09.01.07 )
57. FRMW, QLogic QLE2562 Adapter ( Version : 09.01.07 )
I didn't try the RHEL kernel in OL8 since it was missing the modules to support my PERC H800 RAID SAS controller card. The UEK maintains all the drivers that were removed in CentOS 8.
Bart/Vlad, I posted to the OL8 Forum to see if anyone has run into this before.
https://community.oracle.com/tech/apps-infra/discussion/4489243/ol8-uek-and-qlogic-driver-issues/p1
I ran into this issue after upgrading my Debian boxes from buster (Linux 4.19) to bullseye (Linux 5.10) yesterday. These boxes have been running flawlessly for a year with scst version 3.3.0. After the upgrade the initiator machine would hang on boot and the target machine showed this repeatedly:
ERROR: qla2x00t(16): CTIO with error status 0x10 received (state 3, scst_cmd 00000000101446c1, op INQUIRY)
In my case this issue was caused by IOMMU DMAR - DMA remapping. After turning VT-d support OFF in the BIOS of the target machine i was up and running again.
VT-d on: $ sudo dmesg | grep IOMMU [ 0.033346] DMAR: IOMMU enabled [ 1.339111] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel [email protected] [ 1.339112] AMD-Vi: AMD IOMMUv2 functionality not available on this system $ sudo dmesg | grep DMAR [ 0.033346] DMAR: IOMMU enabled [ 0.078741] DMAR: Host address width 36 [ 0.078743] DMAR: DRHD base: 0x000000fe710000 flags: 0x0 [ 0.078747] DMAR: dmar0: reg_base_addr fe710000 ver 1:0 cap c9008020e30272 ecap 1000 [ 0.078748] DMAR: DRHD base: 0x000000fe711000 flags: 0x0 [ 0.078750] DMAR: dmar1: reg_base_addr fe711000 ver 1:0 cap c0000020230272 ecap 1000 [ 0.078751] DMAR: DRHD base: 0x000000fe713000 flags: 0x1 [ 0.078753] DMAR: dmar2: reg_base_addr fe713000 ver 1:0 cap c9008020630272 ecap 1000 [ 0.078754] DMAR: RMRR base: 0x000000bb7d0000 end: 0x000000bb7e7fff [ 0.078755] DMAR: RMRR base: 0x000000bdc00000 end: 0x000000bfffffff [ 0.078756] DMAR-IR: Not enabling interrupt remapping [ 0.415462] pci 0000:00:00.0: DMAR: Disabling batched IOTLB flush on Ironlake [ 1.194621] DMAR: No ATSR found [ 1.194675] DMAR: dmar1: Using Register based invalidation [ 1.194688] DMAR: dmar2: Using Register based invalidation [ 1.333478] DMAR: Intel(R) Virtualization Technology for Directed I/O [ 1.913905] i915 0000:00:02.0: [drm] DMAR active, disabling use of stolen memory
VT-d off: $ sudo dmesg | grep DMAR [ 0.018007] ACPI: _MAR 0x00000000BB7B367B 000030 (v01 Intel OEMDMAR 00060000 LOHR 00000001) [ 0.416977] pci 0000:00:00.0: DMAR: BIOS has allocated no shadow GTT; disabling IOMMU for graphics
$ sudo modinfo qla2x00tgt filename: /lib/modules/5.10.0-8-amd64/updates/dkms/qla2x00tgt.ko version: 3.5.0 import_ns: QLA16GB import_ns: SCST license: GPL description: Target mode addon for qla2[2,3,4,5+]xx author: Vladislav Bolkhovitin and others srcversion: 0714B96245E37ED13CF1DD0 depends: qla2xxx_scst,scst retpoline: Y name: qla2x00tgt vermagic: 5.10.0-8-amd64 SMP mod_unload modversions [...]
Trying git HEAD did not fix this error for me either. I was not able to compile scst versions <=3.4.0 against Kernel 5.10. I did not try any Kernel boot parameters to work around.
Thank you for your awesome work.
“In my case this issue was caused by IOMMU DMAR - DMA remapping. After turning VT-d support OFF in the BIOS of the target machine i was up and running again.”
What all does that affect?
Turning off VT-d turns off virtualization support, correct?
Thank you,
Steffan Cline
@.***
602-793-0014
On 9/21/21, 12:22 AM, "disdos10" @.***> wrote:
I ran into this issue after upgrading my Debian boxes from buster (Linux 4.19) to bullseye (Linux 5.10) yesterday. These boxes have been running flawlessly for a year with scst version 3.1.0. After the upgrade the initiator machine would hang on boot and the target machine showed this repeatedly:
ERROR: qla2x00t(16): CTIO with error status 0x10 received (state 3, scst_cmd 00000000101446c1, op INQUIRY)
In my case this issue was caused by IOMMU DMAR - DMA remapping. After turning VT-d support OFF in the BIOS of the target machine i was up and running again.
VT-d on: dmesg | grep IOMMU [ 0.033346] DMAR: IOMMU enabled [ 1.339111] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel @.*** [ 1.339112] AMD-Vi: AMD IOMMUv2 functionality not available on this system @.***:~$ sudo dmesg | grep DMAR [ 0.033346] DMAR: IOMMU enabled [ 0.078741] DMAR: Host address width 36 [ 0.078743] DMAR: DRHD base: 0x000000fe710000 flags: 0x0 [ 0.078747] DMAR: dmar0: reg_base_addr fe710000 ver 1:0 cap c9008020e30272 ecap 1000 [ 0.078748] DMAR: DRHD base: 0x000000fe711000 flags: 0x0 [ 0.078750] DMAR: dmar1: reg_base_addr fe711000 ver 1:0 cap c0000020230272 ecap 1000 [ 0.078751] DMAR: DRHD base: 0x000000fe713000 flags: 0x1 [ 0.078753] DMAR: dmar2: reg_base_addr fe713000 ver 1:0 cap c9008020630272 ecap 1000 [ 0.078754] DMAR: RMRR base: 0x000000bb7d0000 end: 0x000000bb7e7fff [ 0.078755] DMAR: RMRR base: 0x000000bdc00000 end: 0x000000bfffffff [ 0.078756] DMAR-IR: Not enabling interrupt remapping [ 0.415462] pci 0000:00:00.0: DMAR: Disabling batched IOTLB flush on Ironlake [ 1.194621] DMAR: No ATSR found [ 1.194675] DMAR: dmar1: Using Register based invalidation [ 1.194688] DMAR: dmar2: Using Register based invalidation [ 1.333478] DMAR: Intel(R) Virtualization Technology for Directed I/O [ 1.913905] i915 0000:00:02.0: [drm] DMAR active, disabling use of stolen memory
VT-d off: dmesg | grep DMAR [ 0.018007] ACPI: _MAR 0x00000000BB7B367B 000030 (v01 Intel OEMDMAR 00060000 LOHR 00000001) [ 0.416977] pci 0000:00:00.0: DMAR: BIOS has allocated no shadow GTT; disabling IOMMU for graphics modinfo qla2x00tgt filename: /lib/modules/5.10.0-8-amd64/updates/dkms/qla2x00tgt.ko version: 3.5.0 import_ns: QLA16GB import_ns: SCST license: GPL description: Target mode addon for qla2[2,3,4,5+]xx author: Vladislav Bolkhovitin and others srcversion: 0714B96245E37ED13CF1DD0 depends: qla2xxx_scst,scst retpoline: Y name: qla2x00tgt vermagic: 5.10.0-8-amd64 SMP mod_unload modversions [...]
Trying git HEAD did not fix this error for me either. I was not able to compile scst versions <=3.4.0 against Kernel 5.10. I did not try any Kernel boot parameters to work around.
Thank you for your awesome work.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.
I am running VMs using libvirt KVM/QEMU hypervisor on this host. VT-x support is still turned ON. This is mandatory for running any kind of hypervisor. VT-d would allow for exposing PCIe devices to the guest VMs. Since none of the guest VMs on this hosts require this feature i am fine for now. However i am using this on a different machine for GPU passthrough.
Regards.
In my case, this is a SAN running on bare metal so I’d probably be ok. On my VM hosts, I use Xen and in reading up on it, I’d need the VT-d for the HVMs (Windows in my case). PV would be ok. I suppose as long as this change is not needed on the initiators, it shouldn’t be a problem.
Good to know of the work around but surely someone can find out why it comes up on some kernels and not others.
Thank you,
Steffan Cline
@.***
602-793-0014
On 9/21/21, 12:59 AM, "disdos10" @.***> wrote:
I am running VMs using libvirt KVM/QEMU hypervisor on this host. VT-x support is still turned ON. This is mandatory for running any kind of hypervisor. VT-d would allow for exposing PCIe devices to the guest VMs. Since none of the guest VMs on this hosts require this feature am fine for now. However I am using this on a different machine for GPU passthrough.
Regards.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.
Yes, I’d say it’s needed. I never did get a solid fix.
Thanks, Steffan Cline @.*** 602-793-0014
On Sep 27, 2021, at 8:48 PM, Bart Van Assche @.***> wrote:
Does this issue need further attention? If not, can it be closed?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.
How about the approach to disable VT-d? Did that approach work? Is it an acceptable solution?
Fortunately on this server, I don’t run Xen virt but I do on my others and the docs for Xen say that it’s needed. It hasn’t been an issue with the CentOS 8 default kernel and earlier versions of the OS so I’m unsure why the UEK would need it. I haven’t been able to figure out why the drivers show a hardware failure with the UEK and not with C8. Any suggestions of what else to check?
Thanks, Steffan Cline @.*** 602-793-0014
On Sep 27, 2021, at 8:50 PM, Bart Van Assche @.***> wrote:
How about the approach to disable VT-d? Did that approach work? Is it an acceptable solution?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.
My experience from a few years ago is that RHEL / CentOS kernels are more stable than upstream and also that upstream kernels are more stable than UEK kernels. How about testing a recent upstream kernel?
I can confirm that adding kernel command line parameters
intel_iommu=on iommu=pt
make the adapter work as well when VT-d is turned ON in the BIOS.
This makes sense since 'pt' disables DMA translation.
Regards.