Unsolved
1 Rookie
•
43 Posts
0
71
Dell 0R17HV Mellanox ConnectX-3 CX314A Firmware
I've tried searching for the firmware for a Dell 0R17HV specifically with no luck but found a few different versions of updates for the CX314A cards which are supposed to be the same thing.
I've come across these but all say incompatible when trying to execute and update:
Network_Firmware_M8H5D_LN_02.42.50.00.BIN
Network_Firmware_H9RJP_LN_02.42.50.58.BIN
Network_Firmware_RN0JN_LN_02.42.50.00.BIN
I find that one interesting showing .50.58 because the NVidia site only shows .50.00
DSU (Dell System Update) shows nothing available to update either.
I know I have the model of the cards right. He's the lspci on one. See the sections in bold. Sadly, no firmware version shown.
lspci -vvvvv -s 04:00.0
04:00.0 Ethernet controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro]
Subsystem: Mellanox Technologies Device 0040
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 65
NUMA node: 0
IOMMU group: 20
Region 0: Memory at daf00000 (64-bit, non-prefetchable) [size=1M]
Region 2: Memory at d5000000 (64-bit, prefetchable) [size=8M]
Expansion ROM at da000000 [disabled] [size=1M]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [48] Vital Product Data
Product Name: DELL CX3P 40G DP LAN
Read-only fields:
[PN] Part number: 0R17HV
[EC] Engineering changes: A02
[MN] Manufacture ID: 1028
[SN] Serial number: CN0R17HV7873377HK087
[VA] Vendor specific: DSV1028VPDR.VER1.0
[VB] Vendor specific: FFV00.00.00.00
[VC] Vendor specific: NPY2
[VD] Vendor specific: PMT78
[VE] Vendor specific: NMVMellanox Technologies, Inc.
[VF] Vendor specific: DTINIC
[VG] Vendor specific: DCM10010000C520010000C5
[RV] Reserved: checksum good, 0 byte(s) reserved
Read/write fields:
[YA] Asset tag: N/A
[RW] Read-write area: 48 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 253 byte(s) free
[RW] Read-write area: 252 byte(s) free
End
Capabilities: [9c] MSI-X: Enable+ Count=128 Masked-
Vector table: BAR=0 offset=0007c000
PBA: BAR=0 offset=0007d000
Capabilities: [60] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 unlimited
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 116.000W
DevCtl: CorrErr- NonFatalErr+ FatalErr+ UnsupReq+
RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
LnkCap: Port #8, Speed 8GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 8GT/s (ok), Width x8 (ok)
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR-
10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
FRS- TPHComp- ExtTPHComp-
AtomicOpsCap: 32bit- 64bit- 128bitCAS-
DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- LTR- OBFF Disabled,
AtomicOpsCtl: ReqEn-
LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+
EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest-
Retimer- 2Retimers- CrosslinkRes: unsupported
Capabilities: [c0] Vendor Specific Information: Len=18 <?>
Capabilities: [100 v1] Alternative Routing-ID Interpretation (ARI)
ARICap: MFVC- ACS-, Next Function: 0
ARICtl: MFVC- ACS-, Function Group: 0
Capabilities: [148 v1] Device Serial Number ec-0d-9a-03-00-12-b1-40
Capabilities: [108 v1] Single Root I/O Virtualization (SR-IOV)
IOVCap: Migration-, Interrupt Message Number: 000
IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+
IOVSta: Migration-
Initial VFs: 8, Total VFs: 8, Number of VFs: 0, Function Dependency Link: 00
VF offset: 1, stride: 1, Device ID: 1004
Supported Page Size: 000007ff, System Page Size: 00000001
Region 2: Memory at 0000000000000000 (64-bit, prefetchable)
VF Migration: offset: 00000000, BIR: 0
Capabilities: [154 v2] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
HeaderLog: 00000000 00000000 00000000 00000000
Capabilities: [18c v1] Secondary PCI Express
LnkCtl3: LnkEquIntrruptEn- PerformEqu-
LaneErrStat: 0
Kernel driver in use: mlx4_core
Kernel modules: mlx4_core
# mlxfwmanager
Querying Mellanox devices firmware ...
mlxfwmanager
Querying Mellanox devices firmware ...
Device #1:
----------
Device Type: ConnectX3Pro
Part Number: 0R17HV_Ax
Description: ConnectX-3 Pro EN network interface card; 40/56GbE; dual-port QSFP; PCIe3.0 x8 8GT/s; RoHS R6
PSID: DEL1090111023
PCI Device Name: 0000:42:00.0
Port1 MAC: ec0d9abbdbc0
Port2 MAC: ec0d9abbdbc1
Versions: Current Available
FW 2.43.7028 N/A
PXE 3.4.0662 N/A
UEFI 14.9.0090 N/A
Status: No matching image found
Device #2:
----------
Device Type: ConnectX3Pro
Part Number: 0R17HV_Ax
Description: ConnectX-3 Pro EN network interface card; 40/56GbE; dual-port QSFP; PCIe3.0 x8 8GT/s; RoHS R6
PSID: DEL1090111023
PCI Device Name: 0000:41:00.0
Port1 MAC: ec0d9abbd600
Port2 MAC: ec0d9abbd601
Versions: Current Available
FW 2.43.7028 N/A
PXE 3.4.0662 N/A
UEFI 14.9.0090 N/A
Status: No matching image found
Device #3:
----------
Device Type: ConnectX3Pro
Part Number: 0R17HV_Ax
Description: ConnectX-3 Pro EN network interface card; 40/56GbE; dual-port QSFP; PCIe3.0 x8 8GT/s; RoHS R6
PSID: DEL1090111023
PCI Device Name: 0000:04:00.0
Port1 MAC: ec0d9a12b140
Port2 MAC: ec0d9a12b141
Versions: Current Available
FW 2.43.7028 N/A
PXE 3.4.0662 N/A
UEFI 14.9.0090 N/A
Status: No matching image found
Suggestions on how to check and/or update the firmware on these?
DELL-Young E
Moderator
Moderator
•
3.2K Posts
0
September 20th, 2023 03:28
Hello thanks for choosing Dell. What is the OS you are using?
Respectfully,
SteffanCline
1 Rookie
1 Rookie
•
43 Posts
0
September 20th, 2023 16:07
@DELL-Young E Oracle Linux (RHEL) 9.2
SteffanCline
1 Rookie
1 Rookie
•
43 Posts
0
September 21st, 2023 08:09
@DELL-Chris H Currently I have put them into an R620 to do all the updates which is running Oracle Linux 9.2. When I deploy, they'll go into R630s running Oracle Linux 9.2
SteffanCline
1 Rookie
1 Rookie
•
43 Posts
0
September 21st, 2023 15:00
@DELL-Marco B It should work considering Oracle Linux 9 is actually Red Hat 9. All other Dell updates have worked under it too as they did under CentOS. There would have to be something specifically written into the installer that looks at the OS and rejects all RHEL clones. That would be a first for Dell. I can install RHEL 9 on it easy enough and try it again but as stated originally, I already tried that installer it and it says it's not compatible. What is the URL you found? I'll try the installer you said again.
SteffanCline
1 Rookie
1 Rookie
•
43 Posts
0
September 21st, 2023 17:21
@DELL-Chris H Which models is it supported under? I can't find anything specific to the R17HV. The documentation is a bit gray in this area. Since there's a driver listed for these cards under R620/R630, it's a bit misleading.
mandlaafolabi68
2 Posts
0
September 28th, 2023 22:00
The Dell 0R17HV Mellanox ConnectX-3 CX314A network interface card firmware is a critical component that ensures optimal performance and functionality of the network adapter. Upgrading the firmware to the latest version is essential to access new features, enhance security, and resolve any potential bugs or issues. It is recommended to regularly check for firmware updates and apply them to keep the network adapter operating at its best and compatible with the evolving network environment.
(edited)
SteffanCline
1 Rookie
1 Rookie
•
43 Posts
0
October 1st, 2023 19:42
@Dell -Charles R I ordered a bunch of the 8KP6W models since you said they're compatible. For the record, the 0R17HV models do come up in the BIOS although I didn't get to test them. The 8KP6W does work with the Network_Firmware_H9RJP_LN_02.42.50.58.BIN update in Oracle Linux 9.2 (RHEL) just fine however oddly, DSU does not provide any updates or detect them as far as I can tell. I am concerned however because I have been installing three 8KP6W at a time to do all the updates but some cards play well together and others cause a System Halt in the BIOS requiring me to either do them in different slots or one at a time. Any idea what causes that? Old firmware perhaps? They've all been behind a few years so far.
Once all these updates are done, my intent is to put three of them in an R720xd and directly connect each R630 for providing volumes over NFSv4 for backups. So knowing why some play well together and others don't would come in handy. Perhaps a BIOS setting on the cards themselves? The only option I can change that may be of consequence is the Virtualization Mode. It's either SR-IOV or Off. Ideas?
(edited)