UNSOLVED

arik010

updated

14 years ago

A

arik010

33 Posts

0

123473

January 31st, 2013 07:00

ESX HYPERVISOR ON SD CARD

Hello, 

i got dell r720xd server with raid aray and one SD card slot

is it better  choice to install the esx on the sd card or to place it on the sas raid array?

what are the pros and cons?

  • Dev Mgr

    6 Operator

    •

    9308 Posts

    •

    3 Points

    5536

    0

    Posted January 31st, 2013 10:00

    Are you referring to the single SD card on the back of the server (part of the life cycle controller), or do you have a single internal SD card (requires opening up the cover to see if)?

    The SD card from the life cycle controller is for a manual one-time boot and cannot be selected as a permanent boot device, so you'd have to use the harddrives anyway.

    However, if you have the internal SD card, my personal preference is to use the harddrives assuming you aren't planning to remove them (use them elsewhere).

    The harddrives can be hot swapped and are probably set up in a redundant raid type, unlike a single SD card.

  • Daniel My

    12 Elder

    •

    6205 Posts

    5536

    0

    Posted January 31st, 2013 10:00

    Hello arik010

    The main reason VMware is installed on USB/SD drives is because you are not supposed to install it on the same physical disks that the data stores are on. Because of the extremely small installation space that VMware requires it is a huge waste of space to install it on a HDD/SSD. Aside from space saving there is not much benefit. Here is a quote from the 5.1 install guide:

     Due to the I/O sensitivity of USB and SD devices, the installer does not create a scratch partition on these devices. As such, there is no tangible benefit to using large USB/SD devices as ESXi uses only the first 1GB. When installing on USB or SD devices, the installer attempts to allocate a scratch region on an available local disk or datastore. If no local disk or datastore is found, /scratch is placed on the ramdisk. You should reconfigure /scratch to use a persistent datastore following the installation. 

    Thanks

  • Daniel My

    12 Elder

    •

    6205 Posts

    5557

    0

    Posted January 31st, 2013 14:00

    is there any specific reason that i am not supposed to installed the esx on the same aray with data?

    Performance. All virtualization configurations I am aware of recommend that the VMs be on separate drives than the host operating system.

    http://pubs.vmware.com/vsphere-51/index.jsp?topic=%2Fcom.vmware.vsphere.install.doc%2FGUID-FF4F7C0F-FDED-4256-8331-037EC5A91A22.html

    Disk location

    Place all data that your virtual machines use on physical disks allocated specifically to virtual machines. Performance is better when you do not place your virtual machines on the disk containing the ESXi boot image. Use physical disks that are large enough to hold disk images that all the virtual machines use.

  • arik010

    33 Posts

    5557

    0

    Posted January 31st, 2013 14:00

    is there any specific reason that i am not supposed to installed the esx on the same aray with data?

  • arik010

    33 Posts

    5557

    0

    Posted January 31st, 2013 15:00

    thanks for the reference!

    since i don't have any redundant sd card device my only option is to use the two small 2.5 bays for the esxi boot partition.

    i still don't sure how that will give me any performance gain since the esx partition don't require any i/o (the fact it can be placed on slow sd cards) is it worth the extra 600$ to go for the esxi dedicated raid 1 2X15k sas disks ?

  • Daniel My

    12 Elder

    •

    6205 Posts

    5557

    0

    Posted January 31st, 2013 16:00

    i still don't sure how that will give me any performance gain since the esx partition don't require any i/o (the fact it can be placed on slow sd cards) is it worth the extra 600$ to go for the esxi dedicated raid 1 2X15k sas disks ?

    The host OS does have a lot of I/O, but it mostly loads into memory so you don't get a lot of read/writes to the disk it is on. I wasn't able to find a document that discusses the I/O on the host OS in detail. The scratch will have a fair amount of I/O, so if you are going to have the host and scratch on the disks then it may be worth it to put them on 15k. You may not see much performance difference between 15k and 7200 RPM drives with the host and scratch. The big thing is not having the requests queued up on the same drives that the data is on.

    If performance is a premium then I would go with the 15k drives. If a millisecond or two of delay is okay then I would go with slower drives. I was not able to find any definite information, but I don't think you will be able to tell any difference in spindle speed unless you are close to maxing out the server.

    Thanks

  • arik010

    33 Posts

    5557

    0

    Posted February 1st, 2013 01:00

    if the host install disk have lot of i/o  why are vmware and dell letting install it on slow sd card in many scenarios?

  • Daniel My

    12 Elder

    •

    6205 Posts

    5557

    0

    Posted February 1st, 2013 09:00

    if the host install disk have lot of i/o  why are vmware and dell letting install it on slow sd card in many scenarios?

    The host OS does have a lot of I/O, but it mostly loads into memory so you don't get a lot of read/writes to the disk it is on.

    You are not impacted by the I/O because it is in memory. The I/O requests to the disk are redirected to memory.

  • arik010

    33 Posts

    5557

    0

    Posted February 2nd, 2013 00:00

    Thanks now  i understand you.

    i mentioned the host os but i meant the host OS + system scratch/swap space

    i still cannot find any documentation on how much i/o if any the scracth partition is using.

    i know it will only use it for logs and so...didn't find if there any serious i/o demands that can justify the purchase of dedicated raid1 disk.

  • arik010

    33 Posts

    960

    0

    Posted February 2nd, 2013 04:00

    finally found that:

    blogs.vmware.com/.../scratch

    5.  What are there performance considerations needed when choosing a location for the scratch partition?

    "Performance of the scratch partition is not critical.  Scratch is used for log files, core dumps, support log bundles, and as a temporary working space.  It’s not imperative that the scratch partition be on a high performing device.  The concern is to have scratch on a reliable, persistent location."

    seems like there is almost no disk activity with the scratch and os partition.

    if there any other consideration or documentation on that i will be happy to hear about.