1. Write test on Linux VM located on NFS storage: 475MB/sec (via: dd if=/dev/zero of=/dev/sda bs=1M) on the first pass and 675MB/sec on subsequent passes (see notes below).
2. Read test on Linux VM located on NFS storage: 995MB/sec (via: dd if=/dev/sda of=/dev/null bs=1M)
3. Write test on Linux VM located on ScaleIO storage: 40MB/sec on the first pass and 585MB/sec on subsequent passes
4. Read test on Linux VM located on ScaleIO storage: 192MB/sec with 512B read-ahead.
* Note: The difference between the initial write and subsequent writes using the ScaleIO volume is due to thin provisioning of the VM. The initial pass must create the large VMDK while subsequent passes don't have this overhead. If I create the VM using the "Thick Provision Eager Zeroed" option, all write tests have the same performance.
During my testing, I also noticed a VM created on the VMFS3 volume using 8MB block size is 2.5x times faster at cloning and migrating the same VM on a VMFS5 volume. When I clone a VM on VMFS5, the ScaleIO dashboard tool shows 90MB/secs max during the clone/migrate option. Cloning the same VM to the VMFS3 volume hits 225MB/sec...
What strikes me as odd is the fact this is the VMFS5 clone performance number (90MB/sec) is the exact same number I see when running the DD test on a thinly provisioned volume. This tells me either VMWare or ScaleIO thinks the source VM is thin provisioned and must incur the double-write penalty like it does on a thinly provisioned volume.
Somewhere, some sort of throttle is getting applied to the cloning or storage migration process. I just have not found it yet...
alexkh
60 Posts
0
June 18th, 2015 22:00
Please run the following tests with single writer and 1MB IO size:
1. Write test on VM located on NFS storage
2. Read test on VM located on NFS storage
4. Same tests on ScaleIO.
additional tip: ScaleIO was designed to handle high workloads, which are generated by multiple threads and VMs, while VMotion is using one thread.
You can run several VMotion at the same time, and increase the workload on ScaleIO.
keller51
9 Posts
0
June 19th, 2015 08:00
To answer your questions:
1. Write test on Linux VM located on NFS storage: 475MB/sec (via: dd if=/dev/zero of=/dev/sda bs=1M) on the first pass and 675MB/sec on subsequent passes (see notes below).
2. Read test on Linux VM located on NFS storage: 995MB/sec (via: dd if=/dev/sda of=/dev/null bs=1M)
3. Write test on Linux VM located on ScaleIO storage: 40MB/sec on the first pass and 585MB/sec on subsequent passes
4. Read test on Linux VM located on ScaleIO storage: 192MB/sec with 512B read-ahead.
* Note: The difference between the initial write and subsequent writes using the ScaleIO volume is due to thin provisioning of the VM. The initial pass must create the large VMDK while subsequent passes don't have this overhead. If I create the VM using the "Thick Provision Eager Zeroed" option, all write tests have the same performance.
During my testing, I also noticed a VM created on the VMFS3 volume using 8MB block size is 2.5x times faster at cloning and migrating the same VM on a VMFS5 volume. When I clone a VM on VMFS5, the ScaleIO dashboard tool shows 90MB/secs max during the clone/migrate option. Cloning the same VM to the VMFS3 volume hits 225MB/sec...
What strikes me as odd is the fact this is the VMFS5 clone performance number (90MB/sec) is the exact same number I see when running the DD test on a thinly provisioned volume. This tells me either VMWare or ScaleIO thinks the source VM is thin provisioned and must incur the double-write penalty like it does on a thinly provisioned volume.
Somewhere, some sort of throttle is getting applied to the cloning or storage migration process. I just have not found it yet...
SanjeevMalhotra
138 Posts
0
June 19th, 2015 13:00
Can you run VMotion of multiple VMs on both NFS and then on ScaleIO datastores at the same time and post your test results?