Highlighted
2 Iron

Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

A little background - Recently added 5 new ESXi hosts (all starting

auscerack) to cluster along with 2 new Cisco MDS 9148 FC switches to FC

network. Existing ESX hosts (all starting auscebld) are using existing

Brocade FC switches.

I have added 4 4GB FC connections from the CX4 to the MDS switches and

also zoned in the new ESXi hosts. However, the ESXi hosts are only

seeing connections to the storage on some of the HBAs / connections.

I suspected the issue is with zoning, but I've been over the setups

multiple times and have yet to find anything amiss.

Background:

All hosts (auscerack and auscebld) are running the same build of vSphere

(914586) and the auscerack servers have been updated with the latest

qlaXXXX driver (qla-2xxxx.934.5.4.0) with no change in situation. All

hosts (auscerack / auscebld) have PowerPath 5.7.0.2 installed and

licensed.

SAN is EMC NS480 (a CX4-480 with a Celerra gateway providing CIFS

storage outside scope of issue). 4 ports on block side of CX4 should be

visible to auscerack hosts:

Slot A3, Port 1 (SP-Port A-5) WWN:

50:06:01:60:C4:60:28:F2:50:06:01:65:44:60:28:F2 - shows 5 registered

initiators, all 5 logged OUT

Slot A3, Port 2 (SP-Port A-6) WWN:

50:06:01:60:C4:60:28:F2:50:06:01:66:44:60:28:F2 - shows 5 registered

initiators, 4 logged IN, 1 logged out

Slot B3, Port 1 (SP-Port B-5) WWN:

50:06:01:60:C4:60:28:F2:50:06:01:6D:44:60:28:F2 - shows 3 registered

initiators, all 3 logged out

Slot B3, Port 2 (SP-Port B-6) WWN:

50:06:01:60:C4:60:28:F2:50:06:01:6E:44:60:28:F2 - shows 6 registered

initiators, 5 logged in, 1 logged out

For auscerack1-1, Unisphere reports Connectivity Status as partially

active with 4 manually registered connections

20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DC SP-Port A-5 not logged

in, registered

20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DC SP-Port B-6 logged in,

registered

20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DD A-6 not logged in,

registered

20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DD B-5 not logged in,

registered

20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DC corresponds to vmhba1 on

auscerack1-1

   In vCenter, this HBA sees 1 target, 22 devices, 22 paths

20:00:00:24:FF:48:CF:DC:21:00:00:24:FF:48:CF:DD corresponds to vmhba2 on

auscerack1-1

   In vCenter, this HBA sees 0 targets, 0 devices, 0 paths

For auscerack1-2, Unisphere reports connectivity status as inactive with

4 manually registered connections

20:00:00:24:FF:48:D0:7E:21:00:00:24:FF:48:D0:7F B-5 not logged in,

registered

(no others show up)

20:00:00:24:FF:48:D0:7E:21:00:00:24:FF:48:D0:7E corresponds to vmhba1 on

auscerack1-2

   In vCenter, this HBA shows 1 target, 1 device, 1 path

20:00:00:24:FF:48:D0:7E:21:00:00:24:FF:48:D0:7F

   In vCenter, this HBA shows 1 target, 1 device, 1 path

all auscerack and auscebld ESX hosts are part of an EMC Storage Group

(ESX) so all should be able to see the same LUNs.

Parts of the MDS zone configs (2 switches)

9148-1

!Command: show running-config zone vsan 1

!Time: Tue Feb 12 13:22:31 2013

version 5.0(1a)

!Full Zone Database Section for vsan 1

fcalias name auscerack1-1-vmhba1 vsan 1

    member pwwn 21:00:00:24:ff:48:cf:dc

fcalias name auscerack1-2-vmhba1 vsan 1

    member pwwn 21:00:00:24:ff:48:d0:7e

fcalias name auscerack1-3-vmhba1 vsan 1

    member pwwn 21:00:00:24:ff:48:cf:de

fcalias name auscerack1-4-vmhba1 vsan 1

    member pwwn 21:00:00:24:ff:48:e4:16

fcalias name auscerack1-5-vmhba1 vsan 1

    member pwwn 21:00:00:24:ff:4f:76:ba

fcalias name NS480-Slot-A3-Port-1 vsan 1

    member pwwn 50:06:01:65:44:60:28:f2

fcalias name NS480-Slot-B3-Port-2 vsan 1

    member pwwn 50:06:01:6e:44:60:28:f2

zone name ZoneA vsan 1

zone name auscerack1-1-vmhba1 vsan 1

    member fcalias auscerack1-1-vmhba1

    member fcalias NS480-Slot-A3-Port-1

    member fcalias NS480-Slot-B3-Port-2

zone name auscerack1-2-vmhba1 vsan 1

    member fcalias auscerack1-2-vmhba1

    member fcalias NS480-Slot-A3-Port-1

    member fcalias NS480-Slot-B3-Port-2

zone name auscerack1-3-vmhba1 vsan 1

    member fcalias auscerack1-3-vmhba1

    member fcalias NS480-Slot-A3-Port-1

    member fcalias NS480-Slot-B3-Port-2

zone name auscerack1-4-vmhba1 vsan 1

    member fcalias auscerack1-4-vmhba1

    member fcalias NS480-Slot-A3-Port-1

    member fcalias NS480-Slot-B3-Port-2

zone name auscerack1-5-vmhba1 vsan 1

    member fcalias auscerack1-5-vmhba1

    member fcalias NS480-Slot-A3-Port-1

    member fcalias NS480-Slot-B3-Port-2

zoneset name NS480-FABRIC-A vsan 1

    member auscerack1-1-vmhba1

    member auscerack1-2-vmhba1

    member auscerack1-3-vmhba1

    member auscerack1-4-vmhba1

    member auscerack1-5-vmhba1

zoneset activate name NS480-FABRIC-A vsan 1

----

9148-2

!Command: show running-config zone vsan 1

!Time: Tue Feb 12 13:22:33 2013

version 5.0(1a)

!Full Zone Database Section for vsan 1

fcalias name auscerack1-1-vmhba2 vsan 1

    member pwwn 21:00:00:24:ff:48:cf:dd

fcalias name auscerack1-2-vmhba2 vsan 1

    member pwwn 21:00:00:24:ff:48:d0:7f

fcalias name auscerack1-3-vmhba2 vsan 1

    member pwwn 21:00:00:24:ff:48:cf:df

fcalias name auscerack1-4-vmhba2 vsan 1

    member pwwn 21:00:00:24:ff:48:e4:17

fcalias name auscerack1-5-vmhba2 vsan 1

    member pwwn 21:00:00:24:ff:4f:76:bb

fcalias name NS480-Slot-A3-Port-2 vsan 1

    member pwwn 50:06:01:66:44:60:28:f2

fcalias name NS480-Slot-B3-Port-1 vsan 1

    member pwwn 50:06:01:6d:44:60:28:f2

zone name auscerack1-1-vmhba2 vsan 1

    member fcalias auscerack1-1-vmhba2

    member fcalias NS480-Slot-A3-Port-2

    member fcalias NS480-Slot-B3-Port-1

zone name auscerack1-2-vmhba2 vsan 1

    member fcalias auscerack1-2-vmhba2

    member fcalias NS480-Slot-A3-Port-2

    member fcalias NS480-Slot-B3-Port-1

zone name auscerack1-3-vmhba2 vsan 1

    member fcalias auscerack1-3-vmhba2

    member fcalias NS480-Slot-A3-Port-2

    member fcalias NS480-Slot-B3-Port-1

zone name auscerack1-4-vmhba2 vsan 1

    member fcalias auscerack1-4-vmhba2

    member fcalias NS480-Slot-A3-Port-2

    member fcalias NS480-Slot-B3-Port-1

zone name auscerack1-5-vmhba2 vsan 1

    member fcalias auscerack1-5-vmhba2

    member fcalias NS480-Slot-A3-Port-2

    member fcalias NS480-Slot-B3-Port-1

zoneset name NS480-FABRIC-B vsan 1

    member auscerack1-1-vmhba2

    member auscerack1-2-vmhba2

    member auscerack1-3-vmhba2

    member auscerack1-4-vmhba2

    member auscerack1-5-vmhba2

zoneset activate name NS480-FABRIC-B vsan 1

Labels (1)
0 Kudos
1 Solution

Accepted Solutions
Highlighted
4 Beryllium

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

You need to update your zones to reflect the new CX WWPNs since they still contain 67 and 6f.

View solution in original post

0 Kudos
8 Replies
Highlighted
2 Iron

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

I have taken an additional new ESXi host (auscerack1-3) and done a fresh install of ESXi 5.0u1 and have the same issue - one HBA can see the LUNs, but only one path, and the other HBA sees no LUNs.

This host differs from the 2 others I described in that it is

o ESXi 5.0u1 vs 5.0u2

o Using VMware NMP (Native Multi Pathing) vs PowerPath

o Using default qla2XXX driver vs qla2xxx-935.5.4.0-8

Since the problem still exists we know none of those are the culprit. We can therefore say things are looking very likely that this is an issue with either the MDS 9148 FC zoning or with my NS480.

0 Kudos
Highlighted
4 Beryllium

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

Can you post the output of the following command from the MDS switches, both switches not just one:

show zoneset ac | incl auscerack1-3 n 3

0 Kudos
Highlighted
2 Iron

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

auscisco9148FCswitch-1# show zoneset active | i auscerack1-3 n 3

  zone name auscerack1-3-vmhba1 vsan 1

  * fcid 0xa70300 [pwwn 21:00:00:24:ff:48:cf:de]

    pwwn 50:06:01:67:44:60:28:f2

  * fcid 0xa70900 [pwwn 50:06:01:6e:44:60:28:f2]

auscisco9148FCswitch-2# show zoneset active | i auscerack1-3 n 3

  zone name auscerack1-3-vmhba2 vsan 1

  * fcid 0x090200 [pwwn 21:00:00:24:ff:48:cf:df]

  * fcid 0x090900 [pwwn 50:06:01:66:44:60:28:f2]

    pwwn 50:06:01:6f:44:60:28:f2


Highlighted
4 Beryllium

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

Looks like the HBAs of the host are logged in but the CX4 front end ports aren't. These two WWPNs are not logging in:

50:06:01:67:44:60:28:f2

50:06:01:6f:44:60:28:f2

Look at the port and cable where these ports are connected to. Make sure you have the correct VSAN and see if the speed is hard-coded versus set to auto.

0 Kudos
Highlighted
2 Iron

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

We did at one point have the cables plugged in to Port 3 on SPA and SPB, but changed that when we saw Unisphere labeled those ports for MirrorView.

The zoning should be setup such that the MDS switches are plugged in to Slot A3, Ports 1 and 2 and Slot B3, Ports 1 and 2

(which has 65,66 and 6d,6e) 

50:06:01:67:44:60:28:f2 is Slot A3, Port 3 and is labeled A-7 (MirrorView).

50:06:01:6f:44:60:28:f2 is Slot B3, Port 3 and is labeled B-7 (MirrorView).

B-7 is set to Auto and shows 1 registered initiator and 1 logged out

A-7 is set to Auto and shows 1 registered initiator and 1 logged out

If I go in Unisphere to Hosts->Host List->Storage System Connectivity Status->Host Initiators for auscerack1-3, it shows two

20:00:00:24:FF:48:CF:DF:21:00:0:24:FF:48:CF:DF on Slot A3, Port 2 (A-6)

20:00:00:24:FF:48:CF:DE:21:00:0:24:FF:48:CF:DE on Slot B3, Port 2 (B-6)

0 Kudos
Highlighted
4 Beryllium

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

You need to update your zones to reflect the new CX WWPNs since they still contain 67 and 6f.

View solution in original post

0 Kudos
Highlighted
2 Iron

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

Ernes, thanks for all your help. The final piece was that we had to do a zone reset after updating the zoning.

Much much appreciated for all your help.

0 Kudos
Highlighted
4 Beryllium

Re: Unable to get new ESXi 5.0u2 hosts to see all paths to NS480

Jump to solution

No problem Jay. Glad I can help.

0 Kudos