Unsolved

This post is more than 5 years old

2 Intern

 • 

196 Posts

19926

July 23rd, 2011 13:00

VNX 5300 SAS Cabling

Our VNX came from the factory racked stacked ready to go. We have a DPE, 2 control stations and a blade enclosure data mover fc.

We decided to get 2 more enclosures for converting the rest of our physical servers to virtual. The engineer wanted me to cable the 2 additional enclosures

before we start the install.

But as I look at the sas lcc's backend cabling it look different from the manual.

The manual shows spa sas 0 going to dae2 lcc a, but ours is going from spa sas0 to dae1 lcc a then it stops.

Then spa sas 1 goes to dae2,dae3, then dae4. I thought you should leep frog the enclosures like 0 going to dae2,dae4,dae6 and 1 going to dae1,dae3,dae5.

Should I recable both sas0 and sas1 as per the manual? The manual only shows up to dae2 instead of fully populated.

Does anyone have better cabling documentation? I am not able to register and get the additional entitlements for powerlink.

vnx5300.jpg

1K Posts

July 24th, 2011 06:00

What type of drives do you have in each enclosure (i.e. dae1=15x300GB SAS, dae2=15x2tb, etc.)?

2 Intern

 • 

196 Posts

July 24th, 2011 10:00

After reading kelleg's post I asked the engineer about spreading the EFD's across both busses, because the 5 drives were in one enclosure.

He said that we were going to rearrange the drives.

In the first po we received 5 100 EFD, 30 600GB 15K Drives, 30 2TB NL SAS

In the second po 5 200 EFD's, 15 600GB 15k, 10 2 TB 7200k

We also wanted a tier0 not just fast cache.

We don’t have the second layout yet, but we do know the 200 EFD's are for fast cache and 100 EFD's for tier0.

This is the first layout.

FirstPoolLayout.png

2 Intern

 • 

196 Posts

July 24th, 2011 10:00

I changed cabling from the VNX5300 System Installation Guide Page 26 VNX5300 SAS cabling.

What is the best way to change enclosure's id with out starting the install.

Power up just enclosures and not the dpe or does it matter?

Not sure why it came cabled that way.

2 Intern

 • 

196 Posts

July 24th, 2011 10:00

Do you know where that is documented? So I can bring it up with the engineer.

Now is the time to do it the best way, before we migrate from the CX4.

9 Legend

 • 

20.4K Posts

July 24th, 2011 10:00

you feel comfortable putting 2TB NL-SAS in RAID-5 pool config ?  We got a little extra SAS so that we put NL-SAS in its own RAID-6 pool for NAS only. I am hoping that one day we will be able to put different raid types in one pool. I can't afford to put SAS/FLASH in RAID-6 pool.

9 Legend

 • 

20.4K Posts

July 24th, 2011 11:00

it should be somewhere in here

https://community.emc.com/servlet/JiveServlet/download/554070-28204/h8268-vnx-block-best-practices.pdf

right now you can't mix different raid types in one pool.  I personally don't feel comfortable putting 2TB drives in a 4+1 pool, these fat drives will hold so much data, they are so slow ..i am afraid of double drive failure and considering in a pool scenario so much data is spread all over the place. Bring up this concern, maybe i am too over-cautious.

2 Intern

 • 

196 Posts

July 24th, 2011 13:00

I thought the data that hasn't been accessed in a period of time would be demoted to lowest tier and compressed.

And the highest access would be promoted to the top tier.

So go with a 2 tired pool of efd and 15k drives, then a pool of the slow nl sas at raid6.

A single pool would slow down the pool's performance because of slow nl sas.

1K Posts

July 24th, 2011 13:00

Right now, with your current setup, you have 2 DAEs on BE (back end) 0 and 3 DAEs on BE 1. That's pretty good distribution. One thing to think about is putting the NL SAS drives on it's own BUS and the other drives on the other BUS.

NL SAS -> those drives are mostly used for large block IO. SAS drives -> small block IO. This might be overkill especially on the 5300 since you only have two buses but something that you might want to consider.

If you want to change the BUS number on a DAE that is not configured then all you have to do is power that DAE off, recable it and power it back on. But like I said at the beginning, your distribution is OK. When you add another DAE make sure you connect it to BE 0.

9 Legend

 • 

20.4K Posts

July 24th, 2011 15:00

that's the idea behind FAST, putting the right data on the right tier at the right time (i've seen too many FAST webex presentations ). Having NL-SAS would not slow down your performance because data that gets placed there is "cold" I thing it's great but the fact that you have to have the same raid configuration in your pool deters me from putting NL-SAS in there. While i have my "cold" data on the slow NL-SAS, that does not make that data less important. I am in the same boat as you are, i got around 200 15k SAS, 20 something 200G EFDs and a few dozen NL-SAS.  I am going to go with one R5 pool with EFDs, SAS and then another R6 pool for NAS only and a couple drives for FAST Cache.

2 Intern

 • 

196 Posts

July 24th, 2011 16:00

Thanks for the information, and I will bring it up to the engineer.

The install starts tuesday and I want to be ready.

No Events found!

Top