Unsolved
This post is more than 5 years old
13 Posts
0
2452
May 3rd, 2012 11:00
Flex i/o module and iSCSI multipathing
We are looking to increase the bandwidth from our ESXi hosts to our VNXe3300. I'd like to get some clarification that what I think will work, will actually do what I want it to do. Our environment is currently set up like this:
3 vmware esxi 4.1 hosts, each with a single 1GB connection into each of two switches dedicated to iSCSI traffic. Our VNXe has a connection from each SP to each switch. VMware is configured for round-robin multipathing. Connections from the VNXe look like this:
SPA:
ETH2 --- Switch 1
ETH3 --- Switch 2
SPB:
ETH2 --- Switch1
ETH3 --- Switch2
ETH4/ETH5 are currently unused. This environment has been set up and running successfully, non-stop since it was built and functions well for our needs both in usage and failover capability. What I want to do is create LACP trunks but still maintain our round-robin multipathed environment. It is my understanding that I can only create one LACP trunk on the built in 4-ports in each SP (I can bind ETH2/ETH3/ETH4/ETH5 in any combination but only with ETH2 as the root connection). So in order to create two separate LACP trunks per SP, I am wanting to add another 4-port GB Flex I/O module to each SP. This would allow me to create a second LACP trunk on the I/O. I could then connect each LACP trunk to each switch to support more bandwidth and maintain the round-robin setup.
Can anyone confirm or deny that this new setup will do what I am thinking it will do? Thanks.


Phukon
337 Posts
0
May 4th, 2012 06:00
Hi,
As per your setup, It will hardly show any difference in performance, Also note that in between SPA and SPB there is no redundancy among the Switches. As a workaround you may try to install another Switch 3 and share your ESXi hosts between Switch 1, Switch 2 and Switch 3.
Cheers,
Bashanta Phukon
jkirkbride1
13 Posts
0
May 4th, 2012 06:00
I'm not sure why you say we would not see an increase in available iSCSI bandwidth. Can you elaborate?If I currently have a 1GB uplink from each SP to the switch and I want to bind and utilize all four ETH ports for that purpose, why would I not see a performance gain from such a change?
PatrickHauer
8 Posts
0
May 10th, 2012 00:00
Hi jkirkbride
I was wondering if you can use LACP with iSCSI. Following EMC VNXe High Availability White Paper they used LACP only for NFS Setup and not iSCSI.
br
Patrick
devijb
15 Posts
0
May 10th, 2012 03:00
Hello Patrick,
You can use LACP for iSCSI if you want, but iSCSI multipathing is better than LACP… (finer packets loadbalancing than LACP)
Regards, Benoît
jkirkbride1
13 Posts
0
May 10th, 2012 07:00
Thanks for the reply. I guess what I am trying to figure out is if I can use LACP and iSCSI multipathing and see a performance increase. Right now, with multipathing, I get 2GB of bandwidth using two paths with a 1GB link each. If I use LACP along with a flex module to create two bound 4GB trunks, wouldn't that effectively increase to a total of 8GB of bandwidth with multipathing? That's what I am thinking. I'm looking for someone to tell me it will or won't work and why. Perhaps I'll need to go to EMC with this.
PatrickHauer
8 Posts
0
May 10th, 2012 07:00
How many Discards do you have?
For me Discards occur when the Packet are recieved to late and therefore *discarded* because it cannot be used for the reconstruction of the whole data. So it is related to latency and not bandwith.
Have you tried to enable jumbo frames for the iSCSI Path to reduce the number of Packets which have to be sent?
PatrickHauer
8 Posts
0
May 10th, 2012 07:00
Jkirkbride, i was wondering if your existing iSCSI Links are fully saturated. On the other side you are not increasing the connections from the server to the switch. In addition the VMware RoundRobin LoadBalancing switches the links it uses for traffic on a fixed time intervall. EMC recommends using PowerPath to have a Multipathing Software in place which provides more intelligent levels of LoadBalancings
As far as i understand LACP it gives you 8x1GB for Load Balancing and Rendundancy but not one big 8GB Pipe, what if i understand correctly,is what you want to have.
To increase the bandwith for one single link you need to upgrade to 10Gig Ethernet Infrastructure
jkirkbride1
13 Posts
0
May 10th, 2012 07:00
Patrick,
Thanks for the additional info. One of the main indicators that I have seen in the environment we have now is Transmit Discards on the switch ports leading to the interfaces on SPA and SPB. My thinking is that the SAN ports are being saturated which is why I am looking to increase bandwidth across multiple ports. I have also considered using more ports in the ESXi hosts but it didn't seem to be where the bottleneck was. I have thought about going to 10GB ethernet and we even priced it out but I need to make a really good case for it in order to justify the added expense. I wouldn't mind going this route and I could probably sell it if I have something conclusive that says that LACP and iSCSI multipathing won't do what I need.
jkirkbride1
13 Posts
0
May 10th, 2012 08:00
Discards run in the 5,000-10,000 range per day, per interface. We are already using jumbo frames. From a latency perspective, disk latency from the hosts to the storage tends to be very low: averages are around 5ms for some datastores with most under 1ms.
PatrickHauer
8 Posts
0
May 11th, 2012 02:00
Which Switch do you use?
jkirkbride1
13 Posts
0
May 11th, 2012 06:00
Switches are HP 3500YL.
And btw, thanks for taking the time to respond.