This post is more than 5 years old
44 Posts
0
13960
Which NICs support RDMA (for R730)?
I am thinking about building a Storage Spaces Direct solution and understand that this works best with 10G RDMA capable NICs, but I am having a difficult time figuring out which NICs support it.
Going with S2D is probably a bit overkill in the first place, so I am looking for the least costly options.
DELL-Josh Cr
Moderator
Moderator
•
8.7K Posts
0
April 24th, 2017 14:00
Hi,
The 10Gb NDC that are validated with the R730 are Broadcom 57800 SFP+, Broadcom 57800 Base-T, Intel X540 Base-T, which all support RDMA. The mellanox ConnectX-3 pcie NIC also supports it.
edit: the Broadcom NICs do not support RDMA
tisraelsen
44 Posts
0
April 24th, 2017 14:00
Thank you.
What do you mean "validated"?
DELL-Josh Cr
Moderator
Moderator
•
8.7K Posts
0
April 24th, 2017 15:00
Validated means that we have tested it and it is a supported card.
byroni13
3 Posts
0
April 6th, 2020 18:00
The following page states that RDMA is not supported on the X540-T2 nic...
https://ark.intel.com/content/www/us/en/ark/products/58954/intel-ethernet-converged-network-adapter-x540-t2.html
DELL-Joey C
Moderator
Moderator
•
3.4K Posts
0
April 6th, 2020 20:00
Thanks for the heads up. I'll get that check out with the previous reply, get back to you soonest.
DELL-Joey C
Moderator
Moderator
•
3.4K Posts
0
April 8th, 2020 03:00
Hi,
Dell's X540 network card would be able to support RDMA, https://dell.to/3c2lqWy
Though, I'm unfamiliar with Precision T3500 if there is any network cards available. X540 would not be compatible with T3500.
For T3500, I'll will have to move your post to the Precision support for them to further support your enquiry.
byroni13
3 Posts
0
April 8th, 2020 12:00
The link I previously supplied indicates that the X540 does not support RDMA.
Based on your site(https://www.intel.com/content/www/us/en/support/articles/000031905/network-and-i-o/ethernet-products.html), only the following nics support RDMA:
DELL-Joey C
Moderator
Moderator
•
3.4K Posts
0
April 8th, 2020 19:00
Hi,
Based on the link I provided, https://dell.to/3c2lqWy it's Dell's proprietary firmware on X540.
As mentioned, you were looking for a network card for your T3500?
DELL-Marco B
Moderator
Moderator
•
3.5K Posts
0
August 24th, 2020 08:00
Hello,
did you read this link about RDMA?
https://dell.to/2Qjspl4
Maybe it can be useful
Marco
maxusa
63 Posts
0
August 24th, 2020 08:00
What RDMA implementation? Please indicate iWARP or RoCEv2 per validated NDC. Thanks in advance for answering!
maxusa
63 Posts
0
August 24th, 2020 10:00
Yes, I did read the Intel Ethernet Adapters and Devices User Guide in the hyperlink. It is a great document, loved it. However, RDMA mentioned only once way back in the document, p.204. iWARP or RoCE is not mentioned at all. Hence my questions.
To recap, for modern HCI storage builds iWARP or RoCEv2 (Infiniband) is needed. My question goes to which 10GbE NDC support which RDMA of these implementations. The difference is stateful TCP for iWARP and UDP for RoCEv2, both routable.
Thanks for answering!
maxusa
63 Posts
0
August 24th, 2020 10:00
The other document you hyperlinked "Dell Networking RoCE Deployment Configuration Guide" is great. It does state that Mellanox ConnectX-3 Pro and Emulex OCe14000 support RoCE; Intel cards support iWARP; Chelsio supports both. However, it is unclear which Intel cards exactly. Also, a refresh would be good since 2015.
I can feel my research is getting closer. Thanks for answering!
bjefferys873
2 Posts
0
March 5th, 2021 07:00
Duplicate post.
bjefferys873
2 Posts
0
March 5th, 2021 07:00
What firmware is needed for the Broadcom 57800 Base-T to enable RDMA? Windows reports that it isn't an RDMA compatible adapter.
Dell-DylanJ
4 Operator
4 Operator
•
2.9K Posts
0
March 5th, 2021 10:00
Hello,
I'm not seeing that this controller supports RDMA. I saw a few product sheets that made no mention of it. I also downloaded the User's Guide linked below, but it made no mention of RDMA support, either.
https://dell.to/3t5Remf