Differences in Mezzanine Bridge Cards for PowerEdge C

Hello,

Part# 4NWN5 and MW5RY seems to be on the right track. Both of them are alternate parts of each other. Though, there is only 1 difference between them is in the description, V2.V2 and V2.V1. You may need to know which version of main board that you are using. 

Though 3CYRK; I'm not seeing it listed in C6320 as compatible part. 

Thanks Joey.  Do you happen to have a list of compatible Mellanox mezzanine boards for that unit?   Mostly looking for dual port options, probably QSFP..

The manual has a list but no part numbers.... based on this list maybe only the VPI models or QSFP may work.  That would be a bummer.   I was hoping to get away with this model because it has the features I need and the base model number is the same so that made me think there was a chance. 

https://www.dell.com/support/manuals/us/en/19/poweredge-c6320/c6320_pub/optional-mezzanine-cards?guid=guid-54e092f5-b388-44a5-905d-77187aded907&lang=en-us

Hi,

PN# Y5WKX would fit your request. 

There is something I stumble upon searching the part for you. I found HH4P1 and 4NWN5 is listed in C6320 component list, and so probably you might want to keep HH4P1.

Thank you for the info.

As a test, I decided to plug HH4P1 into the motherboard (without a mezzanine card attached) and the sled would NOT power up.   I would *think* that the system should still power up like this.   So that makes me think that one of these applies: (1) not the right card for my system, (2) sysem requires mezzanine card to complete the circuitry or something and it is expected to fail without it, or (3) the HH4P1 card could be defective but I think this is unlikely.

I may place an order for board Y5WKX to go along wih the 4NWN5 bridge cards on the way just in case these other MCX384A units still don't work.  Then I wil be fairly confident I'll have a concrete solution next week.... with two mezzanine adapter types and three brdge card types on hand to test.

Here are a couple of card variations and as can be seen there appear to be variations in the PCB and mapping of the pins.   So these boards may be phsically interchangable but probably not compatible with each other.   I'm still trying to figure out if the socket on motherboard is universal across systems or if the pinout on that even changes.

2NYRW below seems to be for C8220x.  That big hole in the middle is curious... wonder if it is used somehow.

I'm under the assumption that we're dealing with standard PCIe over a NON-standard interconnect.  Fairly sure these devices show up as PCIe in the system.   My best guess is that different devices need different bridge cards , probably in part because some devices need more power.  When the designers are adapting PCIe cards for mezzanine use it looks like they may use wider lanes on the PCB for carrying it.

It sure is frustrating that Dell doesn't seem to have minimal public specs available for their products, nor do they list part numbers in the manual. Seems like a concious decision, perhaps to try to drive professional/tech support services and to hasten the retirement of older equipment.   Not great for the earth to push things to obsolescence.  Is it too much to expect SOME type of information when typing a part number like HH4P1 on Dell.com?

@DELL-Joey C  I'm very confused... I have both Y5WKX and 3CYRK now.   Which card is the better one?

You said that Y5WKX is showing as compatible with C6320 and it comes up as NOT PRO model, whereas the 3CYRK is I think the older card sold for the C6220 and it is coming up as PRO model??

3CYRK: MT27500 Family [ConnectX-3] <<< NOT PRO

Y5WKX: MT27520 Family [ConnectX-3 Pro]

(also I can confirm that these work with 4NWN5 bridge card.... the sleds will not even power on wwith HH card installed)

Thanks for your help!

CORRECTION... I reversed the part numbers in my last post!!  These are coming up for me as follows....

Y5WKX: MT27500 Family [ConnectX-3] <<< NOT PRO

3CYRK: MT27520 Family [ConnectX-3 Pro]

Hello,

Well 3CYRK would not work on PowerEdge C. It's for DCS systems. I would wonder if the system is booting up and detecting it? If yes, do let me know.

Between the Pro and non Pro model, it's the feature in the cards. https://dell.to/2B6ZsF0

Actually — maybe the BCAA has VPI?  The following link suggests 2, maybe 3 versions of the Connectx3… and the only "pro" listed DOES have VPI (in full PCIe versions at least but I would think that mezzanine cards are adaptations of regular products)

Connectx-3 VPI
Connectx-3 PRO VPI
Connectx-3 EN   

https://www.mellanox.com/oem/dell/products_adapters

It's a moot point for me for the most part as I don't know if I will ever need the PRO or the VPI features I know about.

Hey,

Truthfully, I'm not very verse with networking, and probably you would know better and more than me. 

Thank you though, for confirming that 3CYRK works. 

@DELL-Joey C  perhaps you might help identify the correct firmware for this card?  I believe that I am looking for the firmware BIN files where the payloads inside are meant for or compatible with the 3CYRK and Y5WKX cards.

I have tried a bunch of updates but none of them work, at least as BIN files.  Mostly I am getting stopped because my system configuration does not validate (no more specific info is given by the installer).... 

Network_Firmware_RN0JN_LN_02.42.50.00.BIN
Network_Firmware_P29N2_LN_02.42.50.00.BIN
Network_Firmware_M8H5D_LN_02.42.50.00.BIN
Network_Firmware_84DJH_LN_02.42.50.00.BIN
Network_Firmware_5RPT5_LN_02.33.50.50.BIN

I always get error "This Update Package is not compatible with your system configuration" except one update I tried for C6220 that complained more specifically that the problem was my system was C6320.  

So for all the other update attempts, including those above/below, the problem may not be my C6320 but another configuration item.... even the wrong card.  (And actually most of the payloads appear to be for standard PCIe cards, not mezzanine cards, which is potentially a very significant difference)   I think 5RPT5 only contained FW for the non-PRO card and I was trying to update PRO so that may have been reason for failure on that one.

But also, looking at the logs for the updates suggests that these packages contain custom firmware for specific Dell product numbers and none have matched 3CYRK.  (See list of firmware packages and firmware payloads below.

My plan is to extract the appropriate firmware for the 3CYRK and Y5WKX when I find those packages or packages that are supposedly compatible.  AFAIK there is no way for customers to search for the firmware by the NIC product number.

5RPT5:  fw-ConnectX3-rel_06256K_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_08KP6W_0M9NW6_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_0W0RM9_0Y3KKR_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_06256K_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_08KP6W_0M9NW6_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_0W0RM9_0Y3KKR_02.33.50.50.bin

84DJH :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

Note: there is another thread from 2018 with someone looking for this but they replied and said the firmware suggested wasn't correct: https://www.dell.com/community/PowerEdge-Hardware-General/DELL-3CYRK-40G-Mezzanine-Card/td-p/6218362

CA_Tailguy,

Would you confirm the specific OS installed on the C6320?

It's running ESXi.   I am able to interrogate the card directly from a CentOS VM with the card in passthrough mode. 

But I also tried to do it by booting Dell OpenManage, which I think is also CentOS?    So just did that to eliminate ESXi and the passing through of the card as the problem.

Can you tell me what systems you show as compatible with C3YRK?  I am guessing the firmware I need is going to be under that system. 

Hi @CA_Tallguy

I only able to find this page for the card firmware based on PN# Y5WKX https://dell.to/2BuiAx3.

Hope this helps, cause the file are only available via Mellanox and only for Linux and Windows. I couldn't find any where else.

Let me know if you have any other questions.