Start a Conversation

Unsolved

N

2 Posts

1450

July 20th, 2021 08:00

M1000e / M630 blades and M6220 Swithes

Hey there,

I recently picked up an M1000e chassis with dual M6220 modules in slots A1/A2 and dual MXL modules in slots B1/B2 along with 4x M630 blades - identically configured.

As I understand it, the blades are auto assigned to ports on the M6220's through Fabric A. Thus, I installed ESXi on each of the four blades and ALL 4 blades show connectivity on vmnic0/1 (which confirming via MAC address are the adapters going to Fabric A and the A1/A2 modules.

My problem begins here. The blades in Slots 1 & 2 - call them "server 1" and "server 2" show as having "connnected" network adapters in ESXi, but on the M6220, Ports 1 & 2 are in a link state of DOWN. The blades in slots 3 & 4 ("server 3" and "server 4") also have ESXi showing "connected" network connections and the M6220 reports Ports 3 & 4 as link state "active" - 1Gbps links. 

I have tried moving "server 1" to Slot 5 on the blade chassis - Port 5 on the M6220 remains in a down state. I have moved "server 3" to Slot 1 on the blade chassis and then Port 1 on the M6220 goes into an active state. I also have tried removing "server 4" completely and running with "server 1" in Slot 4 and only running 3 blades - then I only see Port 3 as having an active link state on the M6220 (*note: when I say the M6220, I am referring to BOTH M6220's in slots A1 and A2). 

To me this suggests an issue with the actual blades "server 1" and "server 2" but how do I go about troubleshooting this issue further? All 4 blades have been updated to the latest firmware versions and thus all firmware, BIOS, iDRAC, NIC's, etc. are all running at the same version. 

Does anyone have any insights or thoughts as to what might be going on?? Given that the blade reports an active connection on vmnic0 and vmnic1, to me it suggests there's a problem in the Fabric with the assignment of these blades to the M6220 ports. 

130 Posts

July 20th, 2021 11:00

Are the blades physically configured with the same nics in the same locations? The M630 can take a nic on the system board (daughter card) and 2 Mezzanine cards, which can be on different fabrics A,B or C. 
Docs here: https://dl.dell.com/topicspdf/m630_guide_en-us.pdf
#Iwork4Dell
Rey

July 20th, 2021 15:00

Hi Rey,

The blades are identical configurations. 

I noticed that blades 3 & 4 - despite giving succesful firmware update log entries did not successfully update the NIC firmware. It appears that the X710-k firmware version 19.5.12 breaks the connection to the M6220. I tested this, stupidly by upgrading "server 4" to 19.5.12 and watched it lose the connection to the M6220.

Now I face the issue of not being able to downgrade the firmware on the NICs. Downgrading to 18.3.6 or above fails, downgrading to a version prior to 18.3.6 says its successful but doesn't actually change the firmware from 19.5.12. 

No Events found!

Top