PowerPath and qlogic HBA problems

Question

Hi guys. I would like to show you the following output coming from two Linux machine RH5.1 both with two qlogic HBA. Machine n.1 where it all works fine: # cat /proc/scsi/qla2xxx/0 QLogic PCI to Fibre Channel Host Adapter for QMH2462: Firmware version 4.00.90 [IP] , Driver version 8.01.07.16 ISP: ISP2432 Request Queue = 0x36d80000, Response Queue = 0x36d10000 Request Queue count = 4096, Response Queue count = 512 Total number of active commands = 0 Total number of interrupts = 2528907 Device queue depth = 0x10 Number of free request entries = 1216 Number of mailbox timeouts = 0 Number of ISP aborts = 0 Number of loop resyncs = 0 Number of retries for empty slots = 0 Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0 Host adapter:loop state = , flags = 0x41a43 Dpc flags = 0x4000000 MBX flags = 0x0 Link down Timeout = 008 Port down retry = 064 Login retry count = 016 Commands retried with dropped frame(s) = 0 Product ID = 0000 0000 0000 0000 SCSI Device Information: scsi-qla0-adapter-node=50014380011c51bd;scsi-qla0-adapter-port=50014380011c51bc;scsi-qla0-target-0=5006016141e00fa9;scsi-qla0-target-1=5006016941e00fa9; FC Port Information: scsi-qla0-port-0=50060160c1e00fa9:5006016141e00fa9:010000:81; scsi-qla0-port-1=50060160c1e00fa9:5006016941e00fa9:010400:82; SCSI LUN Information: (Id:Lun) * - indicates lun is not registered with the OS. ( 0: 0): Total reqs 39351, Pending reqs 0, flags 0x0, 0:0:81 00( 0: 1): Total reqs 39345, Pending reqs 0, flags 0x0, 0:0:81 00( 0: 2): Total reqs 39386, Pending reqs 0, flags 0x0, 0:0:81 00( 1: 0): Total reqs 39395, Pending reqs 0, flags 0x0, 0:0:82 00( 1: 1): Total reqs 39390, Pending reqs 0, flags 0x0, 0:0:82 00( 1: 2): Total reqs 39354, Pending reqs 0, flags 0x0, 0:0:82 00cat /proc/scsi/qla2xxx/1 QLogic PCI to Fibre Channel Host Adapter for QMH2462: Firmware version 4.00.90 [IP] , Driver version 8.01.07.16 ISP: ISP2432 Request Queue = 0x36e80000, Response Queue = 0x36e50000 Request Queue count = 4096, Response Queue count = 512 Total number of active commands = 0 Total number of interrupts = 240145 Device queue depth = 0x10 Number of free request entries = 784 Number of mailbox timeouts = 0 Number of ISP aborts = 0 Number of loop resyncs = 0 Number of retries for empty slots = 0 Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0 Host adapter:loop state = , flags = 0x41a43 Dpc flags = 0x4000000 MBX flags = 0x0 Link down Timeout = 008 Port down retry = 064 Login retry count = 016 Commands retried with dropped frame(s) = 0 Product ID = 0000 0000 0000 0000 SCSI Device Information: scsi-qla1-adapter-node=50014380011c51bf;scsi-qla1-adapter-port=50014380011c51be;scsi-qla1-target-0=5006016041e00fa9;scsi-qla1-target-1=5006016841e00fa9; FC Port Information: scsi-qla1-port-0=50060160c1e00fa9:5006016041e00fa9:010000:81; scsi-qla1-port-1=50060160c1e00fa9:5006016841e00fa9:010400:82; SCSI LUN Information: (Id:Lun) * - indicates lun is not registered with the OS. ( 0: 0): Total reqs 39466, Pending reqs 0, flags 0x0, 1:0:81 00( 0: 1): Total reqs 39461, Pending reqs 0, flags 0x0, 1:0:81 00( 0: 2): Total reqs 39508, Pending reqs 0, flags 0x0, 1:0:81 00( 1: 0): Total reqs 39412, Pending reqs 0, flags 0x0, 1:0:82 00( 1: 1): Total reqs 39411, Pending reqs 0, flags 0x0, 1:0:82 00( 1: 2): Total reqs 39368, Pending reqs 0, flags 0x0, 1:0:82 00 hp_rescan -a Sending rescan signal to /proc/scsi/qla2xxx/0... Sending rescan signal to /proc/scsi/qla2xxx/1... Adding legacy tape devices to /proc/scsi/device_info Scanning /proc/scsi/qla2xxx/0, target 1, LUN 2 Scanning /proc/scsi/qla2xxx/1, target 1, LUN 2 scsi0 00 00 00 DGC RAID 0324 Direct-Access scsi0 00 00 01 DGC RAID 0324 Direct-Access scsi0 00 00 02 DGC RAID 0324 Direct-Access scsi0 00 01 00 DGC RAID 0324 Direct-Access scsi0 00 01 01 DGC RAID 0324 Direct-Access scsi0 00 01 02 DGC RAID 0324 Direct-Access scsi1 00 00 00 DGC RAID 0324 Direct-Access scsi1 00 00 01 DGC RAID 0324 Direct-Access scsi1 00 00 02 DGC RAID 0324 Direct-Access scsi1 00 01 00 DGC RAID 0324 Direct-Access scsi1 00 01 01 DGC RAID 0324 Direct-Access scsi1 00 01 02 DGC RAID 0324 Direct-Access EMC PowerPath powermt display dev=all Pseudo name=emcpowera CLARiiON ID=CK200062401609 [Cluster Oracle DWH] Logical device ID=6006016040301900AACFD76C26F1DC11 [DWH OCFS2] state=alive; policy=BasicFailover; priority=0; queued-IOs=0 Owner: default=SP B, current=SP A Array failover mode: 1 ============================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================== 0 qla2xxx sdb SP A1 unlic alive 0 0 0 qla2xxx sde SP B1 unlic alive 0 0 1 qla2xxx sdh SP A0 active alive 0 0 1 qla2xxx sdk SP B0 active alive 0 0 Pseudo name=emcpowerb CLARiiON ID=CK200062401609 [Cluster Oracle DWH] Logical device ID=6006016040301900E0AB4A7D22F1DC11 [DWH DG_DATA] state=alive; policy=BasicFailover; priority=0; queued-IOs=0 Owner: default=SP B, current=SP A Array failover mode: 1 ============================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================== 0 qla2xxx sda SP A1 unlic alive 0 0 0 qla2xxx sdd SP B1 unlic alive 0 0 1 qla2xxx sdg SP A0 active alive 0 0 1 qla2xxx sdj SP B0 active alive 0 0 Pseudo name=emcpowerd CLARiiON ID=CK200062401609 [Cluster Oracle DWH] Logical device ID=6006016040301900FC4EB80AF4F1DC11 [DWH DG_FRA] state=alive; policy=BasicFailover; priority=0; queued-IOs=0 Owner: default=SP B, current=SP A Array failover mode: 1 ============================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================== 0 qla2xxx sdc SP A1 unlic alive 0 0 0 qla2xxx sdf SP B1 unlic alive 0 0 1 qla2xxx sdi SP A0 active alive 0 0 1 qla2xxx sdl SP B0 active alive 0 0 Machine n.2 where it doesn't works:cat /proc/scsi/qla2xxx/0 QLogic PCI to Fibre Channel Host Adapter for QMH2462: Firmware version 4.00.90 [IP] , Driver version 8.01.07.25-fo BIOS version 1.26 ISP: ISP2432 Request Queue = 0x37480000, Response Queue = 0x37410000 Request Queue count = 4096, Response Queue count = 512 Total number of active commands = 0 Total number of interrupts = 30489 Device queue depth = 0x10 Number of free request entries = 3137 Number of mailbox timeouts = 0 Number of ISP aborts = 0 Number of loop resyncs = 0 Number of retries for empty slots = 0 Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0 Number of reqs in failover_q= 0 Host adapter:loop state = , flags = 0x41a43 Dpc flags = 0x4000000 MBX flags = 0x0 Link down Timeout = 008 Port down retry = 030 Login retry count = 030 Commands retried with dropped frame(s) = 0 Product ID = 0000 0000 0000 0000 SCSI Device Information: scsi-qla0-adapter-node=5001438000beaf21;scsi-qla0-adapter-port=5001438000beaf20;scsi-qla0-target-0=5006016141e00fa9; FC Port Information: scsi-qla0-port-0=50060160c1e00fa9:5006016141e00fa9:010000:81; scsi-qla0-port-1=50060160c1e00fa9:5006016941e00fa9:010400:82; SCSI LUN Information: (Id:Lun) * - indicates lun is not registered with the OS. ( 0: 0): Total reqs 313, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00( 0: 1): Total reqs 299, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00( 0: 2): Total reqs 312, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00 cat /proc/scsi/qla2xxx/1 QLogic PCI to Fibre Channel Host Adapter for QMH2462: Firmware version 4.00.90 [IP] , Driver version 8.01.07.25-fo BIOS version 1.26 ISP: ISP2432 Request Queue = 0x37580000, Response Queue = 0x37510000 Request Queue count = 4096, Response Queue count = 512 Total number of active commands = 0 Total number of interrupts = 3447 Device queue depth = 0x10 Number of free request entries = 4090 Number of mailbox timeouts = 0 Number of ISP aborts = 0 Number of loop resyncs = 0 Number of retries for empty slots = 0 Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0 Number of reqs in failover_q= 0 Host adapter:loop state = , flags = 0x41a43 Dpc flags = 0x4000000 MBX flags = 0x0 Link down Timeout = 008 Port down retry = 030 Login retry count = 030 Commands retried with dropped frame(s) = 0 Product ID = 0000 0000 0000 0000 SCSI Device Information: scsi-qla1-adapter-node=5001438000beaf23;scsi-qla1-adapter-port=5001438000beaf22; FC Port Information: scsi-qla1-port-0=50060160c1e00fa9:5006016041e00fa9:010000:81; scsi-qla1-port-1=50060160c1e00fa9:5006016841e00fa9:010400:82; SCSI LUN Information: (Id:Lun) * - indicates lun is not registered with the OS. hp_rescan -a Sending rescan signal to /proc/scsi/qla2xxx/0... Sending rescan signal to /proc/scsi/qla2xxx/1... Adding legacy tape devices to /proc/scsi/device_info Scanning /proc/scsi/qla2xxx/0, target 0, LUN 2 scsi0 00 00 00 DGC RAID 0324 Direct-Access scsi0 00 00 01 DGC RAID 0324 Direct-Access scsi0 00 00 02 DGC RAID 0324 Direct-Access EMC PowerPath powermt display dev=all Pseudo name=emcpowerb CLARiiON ID=CK200062401609 [Cluster Oracle DWH] Logical device ID=6006016040301900AACFD76C26F1DC11 [DWH OCFS2] state=alive; policy=BasicFailover; priority=0; queued-IOs=0 Owner: default=Unknown, current=SP A Array failover mode: 1 ============================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================== 0 qla2xxx sdb SP A1 active alive 0 0 Pseudo name=emcpowerc CLARiiON ID=CK200062401609 [Cluster Oracle DWH] Logical device ID=6006016040301900E0AB4A7D22F1DC11 [DWH DG_DATA] state=alive; policy=BasicFailover; priority=0; queued-IOs=0 Owner: default=Unknown, current=SP A Array failover mode: 1 ============================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================== 0 qla2xxx sda SP A1 active alive 0 0 Pseudo name=emcpowerd CLARiiON ID=CK200062401609 [Cluster Oracle DWH] Logical device ID=6006016040301900FC4EB80AF4F1DC11 [DWH DG_FRA] state=alive; policy=BasicFailover; priority=0; queued-IOs=0 Owner: default=Unknown, current=SP A Array failover mode: 1 ============================================== ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================== 0 qla2xxx sdc SP A1 active alive 0 0 How can I correct those errors? Thanks, Marco

xe2sdc · Accepted Answer

Hi Marco.Machine n.1 where it all works fine:# cat /proc/scsi/qla2xxx/0...SCSI Device Information:scsi-qla0-adapter-node=50014380011c51bd;scsi-qla0-adapter-port=50014380011c51bc;scsi-qla0-target-0=5006016141e00fa9;scsi-qla0-target-1=5006016941e00fa9;...#cat /proc/scsi/qla2xxx/1SCSI Device Information:scsi-qla1-adapter-node=50014380011c51bf;scsi-qla1-adapter-port=50014380011c51be;scsi-qla1-target-0=5006016041e00fa9;scsi-qla1-target-1=5006016841e00fa9;This host have 2 HBA and every HBA can see two different WWN (two different targets). The wwns belong to two ports of the same Clariion. So an HBA can see SPA0 and SPB0 while the other HBA can see SPA1 and SPB1.Machine n.2 where it doesn't works:cat /proc/scsi/qla2xxx/0...SCSI Device Information:scsi-qla0-adapter-node=5001438000beaf21;scsi-qla0-adapter-port=5001438000beaf20;scsi-qla0-target-0=5006016141e00fa9;...cat /proc/scsi/qla2xxx/1SCSI Device Information:scsi-qla1-adapter-node=5001438000beaf23;scsi-qla1-adapter-port=5001438000beaf22;This host have again 2 HBA but while HBA0 can see only a single target (only a single SPXy) the other HBA can see ANY target.Can you please explain what do you mean by 'it doesn't works' ?? How can I correct those errors?If the 'error' is that your Machine n.2 can't see all the luns, please check zoning for Machine n.2. Maybe you have also to check masking (I think it's called Access Logix in CX world). Also check that your hba logs in correctly on the Storage Processors before going on. Use Navisphere to check connectivity between your hosts and the CX.-s-

RRR · Answer

Also check if in the connectivity status all paths are the same color (black) and if there are no blue-ish icons.

Conor · Answer

Might also be worth checking from Navisphere Manager that all paths to storage are enabled for this host.

Refer to EMC knowledgebase article emc111684 for instructions on how to do this, and if you have any questions about this procedure contact the EMC Customer Support center or your local EMC representative and quote this article ID.

Let us know if any of these suggestions have progressed the issue reported.

Message was edited by:
Mark Foreman (moderator)

Conor · Answer

Sorry, I was using emc111684 to troubleshoot which is "customer-viewable", and publicly displays the p/w... I didn't realise it was secret!
I can't seem to edit my previous post.

Marc/Stefano, you can delete as you see fit... sorry.

RRR · Answer

Please remove the engineering mode password from your post. It's supposed to be secret.

By the way: the checking of the color in connectivity status is leading towards your solving that particular problem.

RRR · Answer

AFAIK mentioning passwords or serial numbers are not best practice here

RRR · Answer

Oh well, just thought it would be better not to mention too much of those details here

dynamox · Answer

this password is mentioned in many solutions on PP ..what's the big deal.

xe2sdc · Answer

I missed the opportunity to trim a thread !!! However I suppose the password you are talking about is the Navisphere 'expert' password. Even if widely known it's still a 'secret' ..

dynamox · Answer

I missed the opportunity to trim a thread !!! i would say something but then what's the point ..enjoy your power trip my friend.

dynamox · Answer

oh ..so you disabled Qlogic native failover. If you typically download drivers from the OEM section on Qlogic/Emulex website and for OEM vendor select EMC, their rpm's are usually modified to set failover to 0.

aco1 · Answer

Hi Stefano,the problem was solved installing qla2xxx-v8.02.08-dist.tgz, adding the following line to /etc/modprob.confoptions qla2xxx ConfigRequired=0 ql2xfailover=0and following the guidelines provided by the README.qla2xxx file.Now I've another problem... I'll post it asap Thanks,Marco

PowerPath

Was this post helpful?