This post is more than 5 years old
40 Posts
0
3640
Unable to get new ESXi 5.0u2 hosts to see all paths to NS480
A little background - Recently added 5 new ESXi hosts (all starting
auscerack) to cluster along with 2 new Cisco MDS 9148 FC switches to FC
network. Existing ESX hosts (all starting auscebld) are using existing
Brocade FC switches.
I have added 4 4GB FC connections from the CX4 to the MDS switches and
also zoned in the new ESXi hosts. However, the ESXi hosts are only
seeing connections to the storage on some of the HBAs / connections.
I suspected the issue is with zoning, but I've been over the setups
multiple times and have yet to find anything amiss.
Background:
All hosts (auscerack and auscebld) are running the same build of vSphere
(914586) and the auscerack servers have been updated with the latest
qlaXXXX driver (qla-2xxxx.934.5.4.0) with no change in situation. All
hosts (auscerack / auscebld) have PowerPath 5.7.0.2 installed and
licensed.
SAN is EMC NS480 (a CX4-480 with a Celerra gateway providing CIFS
storage outside scope of issue). 4 ports on block side of CX4 should be
visible to auscerack hosts:
Slot A3, Port 1 (SP-Port A-5) WWN:
50:06:01:60:C4:60:28:F2:50:06:01:65:44:60:28:F2 - shows 5 registered
initiators, all 5 logged OUT
Slot A3, Port 2 (SP-Port A-6) WWN:
50:06:01:60:C4:60:28:F2:50:06:01:66:44:60:28:F2 - shows 5 registered
initiators, 4 logged IN, 1 logged out
Slot B3, Port 1 (SP-Port B-5) WWN:
50:06:01:60:C4:60:28:F2:50:06:01:6D:44:60:28:F2 - shows 3 registered
initiators, all 3 logged out
Slot B3, Port 2 (SP-Port B-6) WWN:
50:06:01:60:C4:60:28:F2:50:06:01:6E:44:60:28:F2 - shows 6 registered
initiators, 5 logged in, 1 logged out
For auscerack1-1, Unisphere reports Connectivity Status as partially
active with 4 manually registered connections
20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DC SP-Port A-5 not logged
in, registered
20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DC SP-Port B-6 logged in,
registered
20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DD A-6 not logged in,
registered
20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DD B-5 not logged in,
registered
20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DC corresponds to vmhba1 on
auscerack1-1
In vCenter, this HBA sees 1 target, 22 devices, 22 paths
20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DD corresponds to vmhba2 on
auscerack1-1
In vCenter, this HBA sees 0 targets, 0 devices, 0 paths
For auscerack1-2, Unisphere reports connectivity status as inactive with
4 manually registered connections
20:00:00:24:FF:48:D0:7E:21:00:00:24:FF:48:D0:7F B-5 not logged in,
registered
(no others show up)
20:00:00:24:FF:48:D0:7E:21:00:00:24:FF:48:D0:7E corresponds to vmhba1 on
auscerack1-2
In vCenter, this HBA shows 1 target, 1 device, 1 path
20:00:00:24:FF:48:D0:7E:21:00:00:24:FF:48:D0:7F
In vCenter, this HBA shows 1 target, 1 device, 1 path
all auscerack and auscebld ESX hosts are part of an EMC Storage Group
(ESX) so all should be able to see the same LUNs.
Parts of the MDS zone configs (2 switches)
9148-1
!Command: show running-config zone vsan 1
!Time: Tue Feb 12 13:22:31 2013
version 5.0(1a)
!Full Zone Database Section for vsan 1
fcalias name auscerack1-1-vmhba1 vsan 1
member pwwn 21:00:00:24:ff:48:cf:dc
fcalias name auscerack1-2-vmhba1 vsan 1
member pwwn 21:00:00:24:ff:48:d0:7e
fcalias name auscerack1-3-vmhba1 vsan 1
member pwwn 21:00:00:24:ff:48:cf:de
fcalias name auscerack1-4-vmhba1 vsan 1
member pwwn 21:00:00:24:ff:48:e4:16
fcalias name auscerack1-5-vmhba1 vsan 1
member pwwn 21:00:00:24:ff:4f:76:ba
fcalias name NS480-Slot-A3-Port-1 vsan 1
member pwwn 50:06:01:65:44:60:28:f2
fcalias name NS480-Slot-B3-Port-2 vsan 1
member pwwn 50:06:01:6e:44:60:28:f2
zone name ZoneA vsan 1
zone name auscerack1-1-vmhba1 vsan 1
member fcalias auscerack1-1-vmhba1
member fcalias NS480-Slot-A3-Port-1
member fcalias NS480-Slot-B3-Port-2
zone name auscerack1-2-vmhba1 vsan 1
member fcalias auscerack1-2-vmhba1
member fcalias NS480-Slot-A3-Port-1
member fcalias NS480-Slot-B3-Port-2
zone name auscerack1-3-vmhba1 vsan 1
member fcalias auscerack1-3-vmhba1
member fcalias NS480-Slot-A3-Port-1
member fcalias NS480-Slot-B3-Port-2
zone name auscerack1-4-vmhba1 vsan 1
member fcalias auscerack1-4-vmhba1
member fcalias NS480-Slot-A3-Port-1
member fcalias NS480-Slot-B3-Port-2
zone name auscerack1-5-vmhba1 vsan 1
member fcalias auscerack1-5-vmhba1
member fcalias NS480-Slot-A3-Port-1
member fcalias NS480-Slot-B3-Port-2
zoneset name NS480-FABRIC-A vsan 1
member auscerack1-1-vmhba1
member auscerack1-2-vmhba1
member auscerack1-3-vmhba1
member auscerack1-4-vmhba1
member auscerack1-5-vmhba1
zoneset activate name NS480-FABRIC-A vsan 1
----
9148-2
!Command: show running-config zone vsan 1
!Time: Tue Feb 12 13:22:33 2013
version 5.0(1a)
!Full Zone Database Section for vsan 1
fcalias name auscerack1-1-vmhba2 vsan 1
member pwwn 21:00:00:24:ff:48:cf:dd
fcalias name auscerack1-2-vmhba2 vsan 1
member pwwn 21:00:00:24:ff:48:d0:7f
fcalias name auscerack1-3-vmhba2 vsan 1
member pwwn 21:00:00:24:ff:48:cf:df
fcalias name auscerack1-4-vmhba2 vsan 1
member pwwn 21:00:00:24:ff:48:e4:17
fcalias name auscerack1-5-vmhba2 vsan 1
member pwwn 21:00:00:24:ff:4f:76:bb
fcalias name NS480-Slot-A3-Port-2 vsan 1
member pwwn 50:06:01:66:44:60:28:f2
fcalias name NS480-Slot-B3-Port-1 vsan 1
member pwwn 50:06:01:6d:44:60:28:f2
zone name auscerack1-1-vmhba2 vsan 1
member fcalias auscerack1-1-vmhba2
member fcalias NS480-Slot-A3-Port-2
member fcalias NS480-Slot-B3-Port-1
zone name auscerack1-2-vmhba2 vsan 1
member fcalias auscerack1-2-vmhba2
member fcalias NS480-Slot-A3-Port-2
member fcalias NS480-Slot-B3-Port-1
zone name auscerack1-3-vmhba2 vsan 1
member fcalias auscerack1-3-vmhba2
member fcalias NS480-Slot-A3-Port-2
member fcalias NS480-Slot-B3-Port-1
zone name auscerack1-4-vmhba2 vsan 1
member fcalias auscerack1-4-vmhba2
member fcalias NS480-Slot-A3-Port-2
member fcalias NS480-Slot-B3-Port-1
zone name auscerack1-5-vmhba2 vsan 1
member fcalias auscerack1-5-vmhba2
member fcalias NS480-Slot-A3-Port-2
member fcalias NS480-Slot-B3-Port-1
zoneset name NS480-FABRIC-B vsan 1
member auscerack1-1-vmhba2
member auscerack1-2-vmhba2
member auscerack1-3-vmhba2
member auscerack1-4-vmhba2
member auscerack1-5-vmhba2
zoneset activate name NS480-FABRIC-B vsan 1
etaljic81
1K Posts
0
February 14th, 2013 09:00
You need to update your zones to reflect the new CX WWPNs since they still contain 67 and 6f.
etaljic81
1K Posts
0
February 13th, 2013 13:00
Can you post the output of the following command from the MDS switches, both switches not just one:
show zoneset ac | incl auscerack1-3 n 3
jweinshe
40 Posts
1
February 13th, 2013 13:00
auscisco9148FCswitch-1# show zoneset active | i auscerack1-3 n 3
zone name auscerack1-3-vmhba1 vsan 1
* fcid 0xa70300 [pwwn 21:00:00:24:ff:48:cf:de]
pwwn 50:06:01:67:44:60:28:f2
* fcid 0xa70900 [pwwn 50:06:01:6e:44:60:28:f2]
auscisco9148FCswitch-2# show zoneset active | i auscerack1-3 n 3
zone name auscerack1-3-vmhba2 vsan 1
* fcid 0x090200 [pwwn 21:00:00:24:ff:48:cf:df]
* fcid 0x090900 [pwwn 50:06:01:66:44:60:28:f2]
pwwn 50:06:01:6f:44:60:28:f2
jweinshe
40 Posts
0
February 13th, 2013 13:00
I have taken an additional new ESXi host (auscerack1-3) and done a fresh install of ESXi 5.0u1 and have the same issue - one HBA can see the LUNs, but only one path, and the other HBA sees no LUNs.
This host differs from the 2 others I described in that it is
o ESXi 5.0u1 vs 5.0u2
o Using VMware NMP (Native Multi Pathing) vs PowerPath
o Using default qla2XXX driver vs qla2xxx-935.5.4.0-8
Since the problem still exists we know none of those are the culprit. We can therefore say things are looking very likely that this is an issue with either the MDS 9148 FC zoning or with my NS480.
etaljic81
1K Posts
0
February 13th, 2013 14:00
Looks like the HBAs of the host are logged in but the CX4 front end ports aren't. These two WWPNs are not logging in:
50:06:01:67:44:60:28:f2
50:06:01:6f:44:60:28:f2
Look at the port and cable where these ports are connected to. Make sure you have the correct VSAN and see if the speed is hard-coded versus set to auto.
jweinshe
40 Posts
0
February 14th, 2013 05:00
We did at one point have the cables plugged in to Port 3 on SPA and SPB, but changed that when we saw Unisphere labeled those ports for MirrorView.
The zoning should be setup such that the MDS switches are plugged in to Slot A3, Ports 1 and 2 and Slot B3, Ports 1 and 2
(which has 65,66 and 6d,6e)
50:06:01:67:44:60:28:f2 is Slot A3, Port 3 and is labeled A-7 (MirrorView).
50:06:01:6f:44:60:28:f2 is Slot B3, Port 3 and is labeled B-7 (MirrorView).
B-7 is set to Auto and shows 1 registered initiator and 1 logged out
A-7 is set to Auto and shows 1 registered initiator and 1 logged out
If I go in Unisphere to Hosts->Host List->Storage System Connectivity Status->Host Initiators for auscerack1-3, it shows two
20:00:00:24:FF:48:CF:DF:21:00:0:24:FF:48:CF:DF on Slot A3, Port 2 (A-6)
20:00:00:24:FF:48:CF:DE:21:00:0:24:FF:48:CF:DE on Slot B3, Port 2 (B-6)
jweinshe
40 Posts
0
February 18th, 2013 07:00
Ernes, thanks for all your help. The final piece was that we had to do a zone reset after updating the zoning.
Much much appreciated for all your help.
etaljic81
1K Posts
0
February 19th, 2013 07:00
No problem Jay. Glad I can help.