Start a Conversation

Solved!

Go to Solution

2334

March 30th, 2021 10:00

m1000e no traffic between A2 and blades with esxi

Enivornment: m1000e with m6220 switches in the A1/A2. Blades are M630

our ESXI hosts are teamed between A1 and A2. A1 and A2 are not stacked. The interfaces for vmnic0(a1) and vmnic1(a2) on the m6220 are configured the same.

Right now, all the blades function when only assigned to vmnic0(a1), however traffic stops when we add in vmnic1(a2) as a redundant link. if we just use vmnic1 and remove vmnic0, they also do not send traffic.

Running show interface counters gi1/0/9, i'm seeing minimal traffic, with all traffic being discarded on transmit.

 

Port InTotalPkts InUcastPkts InMcastPkts InBcastPkts
--------- ---------------- ---------------- ---------------- ----------------
Gi1/0/9 2685 434 58 2193

Port OutTotalPkts OutUcastPkts OutMcastPkts OutBcastPkts
--------- ---------------- ---------------- ---------------- ----------------
Gi1/0/9 158902 2380 48510 108012

FCS Errors: ................................... 0
Single Collision Frames: ...................... 0
Late Collisions: .............................. 0
Excessive Collisions: ......................... 0
Multiple Collisions: .......................... 0
Received Oversize Packets: .................... 0
Transmitted Oversize Packets: ................. 0
Internal MAC Rx Errors: ....................... 0
Received Pause Frames: ........................ 0
Transmitted Pause Frames: ..................... 0
Receive Packets Discarded: .................... 0
Transmit Packets Discarded: ................... 559886

I'm having trouble identifying if there is a configuration issue on the ESXI host, or the m1000e, or if there is a hardware failure.

Everything was working fine until some weeks ago. The server admin noted that no changes were made on his end in ESXI or in the dell CMC, and no configuration changes were made on the switches.

The A2 switch shows as connected, and no errors in the Dell CMC for it. CDP is successful over the link between the A2 and the blades.

I'm trying to find out why the transmits are all being discarded. Any help is appreciated

4 Operator

 • 

3.7K Posts

April 1st, 2021 07:00

Hi,

 

I didn't real difference between these logs except the point :

For A2 :  This Switch is the Root.
For A1 : Root Port Po1 / Designated path cost: 2004 (0 for A2)

 

At this step, as Josh mention, this problem seems to be more related to a Vswitch configuration issue than a pure hardware issue. Have you tried to reboot the switch and/or swap the blade?

 

Regards,

14 Posts

April 1st, 2021 08:00

Hey Stephane,

 

For the physical switch, we've rebooted, and also swapped it with a spare.

For the blades, we've tried different blades, some running different instances of esxi, and therefor different vswitches. all the same issue still.

117 Posts

April 1st, 2021 09:00

Is the port group teaming policy set to "Route based on originating virtual port"?  This is probably what you want.  Since the two switches are not in stack, make sure it's not set to MAC hash or IP hash. 

On the affected switch, does "show mac address-table" show anything?

Also, what is the connectivity like between this switch and the other one?  What does this switch uplink to, etc? 

117 Posts

April 1st, 2021 10:00

I would start by verifying the blade NIC can communicate to the switch.  On your test blade, make sure the only active uplink is the one mapped to switch A2.  Take a VLAN that is on both the ESXi host and the Switch, and work with that:  On the switch, if there isn't one already, put an IP address on that VLAN (I think the 6220 is a L3 switch, I can't remember).  At that point try to ping the VLAN IP (SVI) from the blade.  So just a simple layer-2 check here.  You will be able to see the MAC address in the output of "show mac address-table" if this is working.  Once you get that working, you can move on to troubleshoot upstream connectivity.

14 Posts

April 1st, 2021 10:00

The Teaming policy is set to "Route Based on Originating port ID" for both the port group and the vswitch.

 

Here's the mac address-table, surprisingly small. Only shows it's own interface for vlan1.

 

BldChs1A2#show mac address-table

Aging time is 300 Sec

Vlan Mac Address Type Port
-------- --------------------- ----------- ---------------------
1 0025.6413.AB70 Management Vl1

 

 

the A2 uplinks to a Cisco C9500. originally it was port channeled, but we removed it during the trouble shooting process, so it is just a single link running at 10g. config is simple for both sides:

A2:

interface Te1/1/1
duplex full
channel-group 1 mode active
spanning-tree disable
switchport mode trunk
switchport trunk allowed vlan 1,1101
exit

 

Cisco


interface TenGigabitEthernet1/0/30
description Rack 8 DellBladeChassis fabric A2
switchport trunk allowed vlan 1,1101
switchport mode trunk
no cdp enable
channel-protocol lacp
channel-group 30 mode active
end

 

I added in the channel-protocol LACP at one point during troubleshooting, it needs to be removed.

 

 

14 Posts

April 1st, 2021 11:00

I went and tooka slightly different angle for your suggestion first, verifying the connectivity between my c9500 and the m6220. I've just realised i've been using an OOB interface this whole time for my connectivity.

both the 9500 and m6220 are using vlan 909, with an IP on the SVI each. I'm not able to reach the 6220 on that SVI.

 

Here is the full output to their connections:

m6220:


interface Te1/1/1
duplex full
channel-group 1 mode active
spanning-tree disable
switchport mode trunk
switchport trunk allowed vlan 1,1101
exit
!
interface Te1/1/2
duplex full
channel-group 1 mode active
switchport mode trunk
switchport trunk allowed vlan 1,1101
exit
!
interface port-channel 1
spanning-tree disable
switchport mode general
switchport general allowed vlan add 909,1101,2109 tagged
exit

C9500


Current configuration : 222 bytes
!
interface TenGigabitEthernet1/0/30
description Rack 8 DellBladeChassis fabric A2
switchport trunk allowed vlan 1,909,1101
switchport mode trunk
no cdp enable
channel-protocol lacp
channel-group 30 mode active
end

SD01-02CE-AdminDCNew#show run int te2/0/30
Building configuration...

Current configuration : 222 bytes
!
interface TenGigabitEthernet2/0/30
description Rack 8 DellBladeChassis Fabric A2
switchport trunk allowed vlan 1,909,1101
switchport mode trunk
no cdp enable
channel-protocol lacp
channel-group 30 mode active
end

SD01-02CE-AdminDCNew#show run int po30
Building configuration...

Current configuration : 144 bytes
!
interface Port-channel30
description Rack 8 DellBladeChassis fabric A2
switchport trunk allowed vlan 1,909,1101
switchport mode trunk
end

 

14 Posts

April 1st, 2021 11:00

as an addendum to my previous post. It looks like the CMC interface handles the OOB interfaces for the connected switches. I found this by Looking at the ARP entry for the IP i've been using  for it, and tracing the MAC. 

I've noticed when I turn off the links to the A2 on the 9500, I also lose connection to the OOB interface, even though they should be unrelated.

14 Posts

April 5th, 2021 06:00

As it looks like there are several issues with this dell switch, I'm isolating each one and trying to find a root cause.

Right now, I've identified that I'm not able to see layer 2 between my cisco 9500 and the dell m6220. I've simplified the config between them. I'm not able to ping the vlan 909 interface on the dell switch for some reason.

Here is there config:

Cisco c9500


!
interface Vlan909
description NetMGMT
ip address 10.99.1.1 255.255.0.0
end

interface TenGigabitEthernet1/0/30
description Rack 8 DellBladeChassis fabric A2
switchport trunk allowed vlan 1,909,1101
switchport mode trunk
spanning-tree bpdufilter enable
end

 

Dell M6220

show run int vlan 909

interface vlan 909 3
ip address 10.99.1.253 255.255.0.0
exit

show running-config interface te1/1/1

duplex full
spanning-tree disable
switchport mode trunk
switchport trunk allowed vlan 1,909,1101

 

Moderator

 • 

8.7K Posts

April 5th, 2021 11:00

Great to hear, let us know if you need anything else.

No Events found!

Top