Highlighted
2 Iron

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

Actually — maybe the BCAA has VPI?  The following link suggests 2, maybe 3 versions of the Connectx3… and the only "pro" listed DOES have VPI (in full PCIe versions at least but I would think that mezzanine cards are adaptations of regular products)

Connectx-3 VPI
Connectx-3 PRO VPI
Connectx-3 EN   

https://www.mellanox.com/oem/dell/products_adapters

It's a moot point for me for the most part as I don't know if I will ever need the PRO or the VPI features I know about.

0 Kudos
Highlighted
Moderator
Moderator

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

Hey,

 

Truthfully, I'm not very verse with networking, and probably you would know better and more than me. 

 

Thank you though, for confirming that 3CYRK works. 


Thanks,
Joey Chong
Dell EMC Enterprise Support Services
Get support on Twitter @DellCaresPro

Download the Dell Quick Resource Locator app today to access PowerEdge support content on your mobile device! (iOS, Android, Windows)

0 Kudos
Highlighted
2 Iron

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

@DELL-Joey C  perhaps you might help identify the correct firmware for this card?  I believe that I am looking for the firmware BIN files where the payloads inside are meant for or compatible with the 3CYRK and Y5WKX cards.

I have tried a bunch of updates but none of them work, at least as BIN files.  Mostly I am getting stopped because my system configuration does not validate (no more specific info is given by the installer).... 

Network_Firmware_RN0JN_LN_02.42.50.00.BIN
Network_Firmware_P29N2_LN_02.42.50.00.BIN
Network_Firmware_M8H5D_LN_02.42.50.00.BIN
Network_Firmware_84DJH_LN_02.42.50.00.BIN
Network_Firmware_5RPT5_LN_02.33.50.50.BIN

I always get error "This Update Package is not compatible with your system configuration" except one update I tried for C6220 that complained more specifically that the problem was my system was C6320.  

So for all the other update attempts, including those above/below, the problem may not be my C6320 but another configuration item.... even the wrong card.  (And actually most of the payloads appear to be for standard PCIe cards, not mezzanine cards, which is potentially a very significant difference)   I think 5RPT5 only contained FW for the non-PRO card and I was trying to update PRO so that may have been reason for failure on that one.

But also, looking at the logs for the updates suggests that these packages contain custom firmware for specific Dell product numbers and none have matched 3CYRK.  (See list of firmware packages and firmware payloads below.

My plan is to extract the appropriate firmware for the 3CYRK and Y5WKX when I find those packages or packages that are supposedly compatible.  AFAIK there is no way for customers to search for the firmware by the NIC product number.

5RPT5:  fw-ConnectX3-rel_06256K_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_08KP6W_0M9NW6_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_0W0RM9_0Y3KKR_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_06256K_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_08KP6W_0M9NW6_02.33.50.50.bin

5RPT5:  fw-ConnectX3-rel_0W0RM9_0Y3KKR_02.33.50.50.bin

84DJH :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

84DJH :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

M8H5D :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

P29N2 :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-019RNV_0YHTD6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-02T0WW-CLP-8006.0.0-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-06256K-CLP-8005-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-08KP6W_0M9NW6-UEFI-15.11.45-FlexBoot-3.4.752.bin

RN0JN :  fw-ConnectX3-rel-2_42_5000-0W0RM9_0Y3KKR-UEFI-15.11.45-FlexBoot-3.4.752.bin

Note: there is another thread from 2018 with someone looking for this but they replied and said the firmware suggested wasn't correct: https://www.dell.com/community/PowerEdge-Hardware-General/DELL-3CYRK-40G-Mezzanine-Card/td-p/6218362

0 Kudos
Moderator
Moderator

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

CA_Tailguy,

 

Would you confirm the specific OS installed on the C6320?

 

 

Chris Hawk

Dell | Social Outreach Services - Enterprise
Get Support on Twitter @DellCaresPro 
Download the Dell Quick Resource Locator app today to access PowerEdge support content on your mobile device! (iOS, Android, Windows)

0 Kudos
Highlighted
2 Iron

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

It's running ESXi.   I am able to interrogate the card directly from a CentOS VM with the card in passthrough mode. 

But I also tried to do it by booting Dell OpenManage, which I think is also CentOS?    So just did that to eliminate ESXi and the passing through of the card as the problem.

Can you tell me what systems you show as compatible with C3YRK?  I am guessing the firmware I need is going to be under that system. 

0 Kudos
Highlighted
Moderator
Moderator

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

Hi @CA_Tallguy

 

I only able to find this page for the card firmware based on PN# Y5WKX https://dell.to/2BuiAx3.

 

Hope this helps, cause the file are only available via Mellanox and only for Linux and Windows. I couldn't find any where else.

 

Let me know if you have any other questions.


Thanks,
Joey Chong
Dell EMC Enterprise Support Services
Get support on Twitter @DellCaresPro

Download the Dell Quick Resource Locator app today to access PowerEdge support content on your mobile device! (iOS, Android, Windows)

0 Kudos
Highlighted
2 Iron

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

That page is for switches, not mezzanine PCI cards for servers.

I am looking for firmware like at the following link...
https://www.dell.com/support/home/en-us/drivers/driversdetails?driverid=0dtdc

... and I assume the RedHat option will work even though I am trying to update from CentOS.   If you can tell me what server models you show as compatible systems for 3CYRK then it *MAY* be listed under firmware downloads for that system (but I will need to go through process described below to confirm).

There are dozens of Dell firmware pages that come up like that when searching for "dell connectx3 firmware" on google.  But the pages do not say what dell part number they are for.  So I started blindly trying the different updates, and then I learned that in the logs and by unpacking the BIN I can see the Dell part number in the payload filenames (shown in the list in previous post for what I've dug through so far).

The problem (I'm guessing) is that inside the BIN files, the firmware only appears to apply to very specific NIC cards. That's what I listed above.  So for fimware M8H5D ... the payload files inside the BIN include "fw-ConnectX3Pro-rel-2_42_5000-0C8Y42_0R3F0N-UEFI-15.11.45-FlexBoot-3.4.752.bin"

and then I google the part numbers in the filename and find out that Dell part R3F0N is a regular PCIe card and  equivalent to Mellanox part CX324A etc.   It is still a Connectx3 card but wrong dell and mellanox part numbers for what I need.   My C6320 system is listed as a compatible system but only if that specific card were in my system, I guess.

If I try to find Connectx3 pro firmware under C6320 downloads I seem to be having a hard time seeing anything at all, even though there are DOZENS of the above pages listing my system.   

This can't be the only way to find the firmware for a device, I hope?!  I'm really baffled as to why things are so difficult with Dell hardware.  There is so little information available.   And I am guessing that you guys don't have a system to find everything there is to know about a part by entering the dell number?

0 Kudos
Highlighted
2 Iron

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

A little update/clue -- I did manage to bring up some firmware under C6320.   Versions are very old, however I did find some clues inside one of them.

https://www.dell.com/support/home/en-us/drivers/driversdetails?driverid=fhfx6&oscode=naa&productcode...

https://www.dell.com/support/home/en-us/drivers/driversdetails?driverid=fhfx6&oscode=naa&productcode...

Under both of these is an option for "base drivers for imaging" which I assume are the "payload" files found embedded in the other type of BIN files (the Dell installer BIN).  These "base drives" are intended to be updated using MFT (Mellanox Firmware Tools).

Inside the FHFX6 firmware there is a PDF with release notes saying that the RELEASE applies to many different Dell part numbers, including 3CYRK (and it shows that PN crossing to PSID DEL1110001023).   So at least we're in the right family of firmware.   But the ONLY DELL PN in the firmware filename is XDTDX ..... and that part number isn't even listed with others in the release notes!!

Many if not all of the other PN's in the document are mezzanine cards, so perhaps this same binary applies to all of them. 

So, on a hunch, I checked under C6220-II to see what Mellanox firmware I could find for that system, since the 3CYRK card may have been sold for that model, and I found this:

https://www.dell.com/support/home/en-gu/drivers/driversdetails?driverid=h6vxh&oscode=naa&productcode...

Downloaded Firmware_H6VXH_LN_2.32.5100.BIN file and extracted as below.   Things to note:

  • we can see the 0XDTDX part number again, and even though there are no release notes in this package,  under the C6320 download package the release notes did suggest we are in the right family of card (even though XDTDX was not in release notes itself... ugh)
  • DEVICE ID MATCHES MY CARD!
  • SUBDEVICE ID DOES NOT match my card!

 

penguin:~$ chmod +x Firmware_H6VXH_LN_2.32.5100.BIN
penguin:~$ ./Firmware_H6VXH_LN_2.32.5100.BIN --extract H6VXH
penguin:~$ ls H6VXH/payload/
configfile.xml  fw-ConnectX3Pro-rel-2_32_5100-0XDTDX-FlexBoot-3.4.306_ETH-UEFI-10.5.16.bin  UpdRollBack.lst
penguin:~$ cat H6VXH/payload/configfile.xml 
<?xml version="1.0" encoding="utf-8"?>
<package versionname="02.33.5100" name="2339170">
  <pciid vendorid="15b3" deviceid="1007" devicename="ConnectX3Pro">
    <supportedsystems>
      <subvendor id="15b3">
        <subdevice id="0018"></subdevice>
      </subvendor>
    </supportedsystems>
    <FMPinfo vendorcode="FORCE_UPDATE" vendorcodetype="CHAR8" />
    <FmpSkipimage type="">
      <FmpSkipimagetypeid>00000000-0000-0000-0000000000000000</FmpSkipimagetypeid>
      <FmpSkipversion>0</FmpSkipversion>
      <FmpSkipversionname />
      <FmpSkipfilename />
    </FmpSkipimage>
    <image type="firmware">
      <imagetypeid>3792094f-4eb9-11e2-9d5af9377442e396</imagetypeid>
      <version>2339170</version>
      <versionname>02.33.5100</versionname>
      <filename>fw-ConnectX3Pro-rel-2_32_5100-0XDTDX-FlexBoot-3.4.306_ETH-UEFI-10.5.16.bin</filename>
    </image>
  </pciid>
</package>

 

 

0 Kudos
Highlighted
Moderator
Moderator

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

Hi @CA_Tallguy,

 

The URL https://dell.to/3iszJYs i gave did go to the switch firmware but it's the 1st tab it loaded in, you can click on the 2nd tab which brings you to adapters? Under Dell EMC ConnectX-3 Firmware Download Center, there's firmware 2.42.5 with different PN#. 

 

Hope this helps? Let me know.


Thanks,
Joey Chong
Dell EMC Enterprise Support Services
Get support on Twitter @DellCaresPro

Download the Dell Quick Resource Locator app today to access PowerEdge support content on your mobile device! (iOS, Android, Windows)

Highlighted
2 Iron

Re: Differences in Mezzanine Bridge Cards for PowerEdge C

Ahh yes I did miss that tab.  Thanks.

This link will go straight to it (posting for anyone else coming along who might miss that too): https://www.mellanox.com/support/firmware/dell?mtag=oem_firmware_download&linkId=92599977&linkId=927...

I feel like we're getting warmer and zeroing in on the right firmware.  I sent an email to Mellanox support to see if they can point to the specific firmware to use.

Thanks for your help.

0 Kudos