UNSOLVED
HBA Performance
Hello, i've set up a 3 node ceph cluster with Dell R740XD and each node have 3 SAS Drive. Tried to run the benchmark with 2 different configuration on the disk
1. each of the disk in RAID 0 mode (1x RAID0, 1x RAID0, 1x RAID0)
using built-in ceph rados bench with the command: rados -p test bench 30 write on 4M block size i got
Bandwidth (MB/sec): 774.03
Average IOPS: 193and for 4K bs
Bandwidth (MB/sec): 23.27
Average IOPS: 5957
2. switched the controller mode to HBA
using built-in ceph rados bench with the command: rados -p test bench 30 write on 4M block size i gotBandwidth (MB/sec): 261.282Average IOPS: 65and for 4K bsBandwidth (MB/sec): 2.24053Average IOPS: 573the performance seems dropping to much without using any RAID configuration
my question is, is this really the best speed that i can get using HBA mode on a RAID Card ? or do i need to get a dedicated HBA Card to get the best performance e.g sas external 12gbps hba card or HBA330 ?
DELL-Young E
Moderator
•
5421 Posts
•
37 Points
0
0
Posted December 18th, 2023 04:18
Hello for a recommendation or two, it would be best we know the controller you are using and see if it supports HAB mode.
Respectfully,
Social Media and Communities Professional
Dell Technologies | Enterprise Support Services
#IWork4Dell
Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!@DELL-Young E I'm currently using H730P RAID controller and it does support HBA mode but as i showed above the performance is a bit slow at HBA, gonna buy a dedicated HBA Card for R740XD
(edited)
@DELL-Young E Currently I'm using H730P Raid Controller and it does support HBA mode but as I showed above the performance is kinda bad on HBA
DELL-Young E
Moderator
•
5421 Posts
•
37 Points
0
0
Posted December 19th, 2023 05:52
Hello if the angle is performance enhancement, I say your RAID should be RAID 0 as the HBA mode does not use read, write cache.
Respectfully,Social Media and Communities Professional
Dell Technologies | Enterprise Support Services
#IWork4Dell
Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!@DELL-Young E Hi, i don't think that tuning the controller when in HBA mode will make the performance better cause i've tried all the options. According to @Martin that there is a significant performance improve and benefits when using a dedicated HBA Controller Card, any suggestion for the dedicated card so I can quickly give it try on my ceph cluster ? HBA330 maybe ??
(edited)
DELL-Joey C
Moderator
•
4170 Posts
•
20965 Points
0
0
Posted December 19th, 2023 09:45
Hi,
Based on the article https://dell.to/47dRPpC, it's probably best to use HBA330 and the BOSS controller. But if Martin has other idea, it would be best to wait for his reply.
DELL-Joey C
Social Media and Communities Professional
Dell Technologies | Enterprise Support Services
#IWork4Dell
Did I answer your query? Please click on ‘Mark as Accepted Answer’ if I did.
Dell-Martin S
Moderator
•
3790 Posts
•
25531 Points
0
0
Posted December 13th, 2023 12:22
Hi,
yes, the performance is dropping significantly by not using any RAID configuration with the SAS Drives. The reason for this is that the RAID card provides a level of data redundancy and error correction that is not available when using HBA mode. This additional overhead can significantly impact the performance of the disks.
To get the best possible performance, you should use a dedicated HBA card that is specifically designed for high-performance applications. These cards often have higher throughput and lower latency than RAID cards, and they can also provide additional features such as advanced data protection capabilities.
Here are some of the benefits of using a dedicated HBA card:
If you need the best possible performance for your Ceph cluster, then I recommend that you use a dedicated HBA card.
with kind regards Martin/ Liebe Grüße Martin
Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!
DELL-Martin S
Social Media and Communities Professional
Dell Technologies | Enterprise Support Services
#IWork4Dell