As of March 14th, this thread remains open, but the IX2 giveaway is closed (30 given away). Thanks, and please continue to provide data!!!
This is a discussion thread where customer who have used the following freely provided, as-is, powershell scripts to gather their vSCSIstats and ESXtop (and optionally their EMC back-end storage) performance data can share their results.
While these will be there for the overall community to use (as this forum is completely public), within EMC this data will be used to further improve our storage platforms, and ensure we are testing against "customer like" scenarioes.
Any customer who posts their ESXtop and vSCSIstats (from their "heavy hitting VMs") performance data (if you are an EMC customer, the EMC array stats are bonus), I will provide an iomega IX2 to as a "thank you"
Please post your environment info and the output from the scripts (can be large, but is VERY compressible, please zip) on this thread.
As you post your results by continuing the discussion thread, please note some details about your environment:
how many ESX/ESXi hosts?
how many VMs?
what vSphere version?
VMFS, NFS, Both?
What type of array backs the datastores?
The scripts to simplify gathering your data are below:
Powershell scripts for collecting, processing, and federating esxtop data
Powershell scripts for collecting and processing vscsistats (use this against your "heavy hitting from a storage standpoint" VMs & please comment/describe them in your post)
how many ESX/ESXi hosts? ---> 2 x Dell R710 ESXi hosts
how many VMs? ---> Small environment. Only 13 VMs right now, but growing
what vSphere version? ---> 4.1.0, 320137
VMFS, NFS, Both? ---> All VMs are on NFS. Exchange dbs are in RDM using software iSCSI
What type of array backs the datastores? ---> storage array is NetApp FAS-2020
I was able to get the esxtop info (I hope I did it right). I'm still working on the vscsiStats. I keep getting a message "not running anymore so quit". I just got it running. I'm not sure why but when I run it on my laptop, it works. Both are Win 7 x64... hmmm
Anyway, here are the vscsiStats too. I hope this can help, and if I did anything wrong and you need new data, just say so. Thanks.
We have 22 ESX Hosts, running on the Cisco UCS platform - specifically B200's and B250's.
how many VMs?
Just over 200VM's. These consist of a 700 user Citrix environment, SAS Analytics, Cognos systems, Oracle DB's and various other applications.
what vSphere version?
4.1 across the board.
VMFS, NFS, Both?
VMFS (and a couple RDM's for Oracle)
What type of array backs the datastores?
We have both an EMC NS480 and an EMC NS960.
I will attach the files as they become available. I am selecting a sample of the entire environment, and will include our heaviest I/O application (SAS) for the scsistats.
how many ESX/ESXi hosts? (2 clusters in different offices with 2 Dell R710's connected to common NAS. 8 cores each, running either 48 or 64 GB of RAM)
how many VMs? (~10 on business host (100041) and ~20-30 running on dev host (101045), > 100 actually registered at any given time)
what vSphere version? ESXi 4.1 (not update 1 yes)
VMFS, NFS, Both? NFS Only
What type of array backs the datastores? Aberdeen with (12) 1 TB 7200 RPM DATA in Raid 6 - Feeling kinda wimpy with everyone slinging around their EMC and NetApp arrays. Guess this is real world small business stuff though.
See my attached doc entitiled Environment for more details on setup and timing of data collection.
Couldn't get the ESXTop script to run so I just ran it in batch mode for 4 hours, 30 second intervals.
Nine (IBM: 5xHS21, 32GB, E5450 - 4xHS22, 48GB, X5570)
how many VMs?
137 (mostly windows 2003)
what vSphere version?
4.0
VMFS, NFS, Both?
VMFS (2 Gb FC)
What type of array backs the datastores?
NetApp V3170 (mostly native FC disk, some SATA, some CX700 FC LUNs)
The vscsistats script doesn't seem to work with ESX 4.0, I made some edits so the script would at least run and collect some data. The target was an Autonomy IDOL indexer that appears to be working on a reindex today.
how many ESX/ESXi hosts? 10 Production and 3 Test View servers | HP BL460c G1 AMD Opteron 221x (Dual Core, Dual Socket 2.2-2.6Ghz), 32GB ram, 4 Nics, Qlogic 4Gb/s HBA
how many VMs? 192 Production + 23 Test View
what vSphere version? ESXi 4.1.0 260247
VMFS, NFS, Both? VMFS
What type of array backs the datastores? EMC CX3 and CX4 Production and CX3 Test View
Windows 2000, 2003 and 2008 og some linux servers. Theres Exchange 2003, sql2000, 2005 and 2008 servers. Emailxtender indexserver, vcenter servers, windows AD/DNS, and a lot of web and application servers
Remove the first run and added a weeks data from collect_esxtop
Attatched unifited_perf CX3-40 Primary Production SAN being migrated to CX4-120, CX3-40f is just a replica of CX3-40, using RPA for replication.
58 VMs - Mix of Windows 2003, 2008, and Ubuntu vCenter is also running as a Guest VM
3. what vSphere version?
ESXi 4.1.0, 260247
4. VMFS, NFS, Both?
VMFS for all production VMs. NFS storage for testing and iso/image storage.
5. What type of array backs the datastores?
Celerra NS20 - Fiber Channel and SATA Shelves. Most data storage on SATA Drives with most (not all) OS partitions installed on FC
The NFS Server is built on HP DL380G5 running Ubuntu
The esxtop stats were collected over a 24 hour period.
The vscsistats were collected for all VMs over about an 8 hour period, I started out collecting every 60 seconds but had issues and switched to 300 seconds. The results are cumulative over that 8 hour period. Not sure if I collected these correctly, just let me know if other information is needed.
i found a stuppid user = me error when i tried running the cust_get_esxtop_adapters.ps1 alone and found and error i fixed put the timer in and restartet the script, it still only added the first host so far. ill give it some time to run
millardjk
4 Posts
1190
0
Posted February 26th, 2011 10:00
The data is zipped using 7-Zip 9.2 using one of the new algorithms that can use more than 2 concurrent cores for compression.
1 Attachment
collect_esxtop.7z
collect_esxtop.7z