Unsolved
This post is more than 5 years old
28 Posts
0
12509
vSphere Performance - Customer Workload Data
As of March 14th, this thread remains open, but the IX2 giveaway is closed (30 given away). Thanks, and please continue to provide data!!!
This is a discussion thread where customer who have used the following freely provided, as-is, powershell scripts to gather their vSCSIstats and ESXtop (and optionally their EMC back-end storage) performance data can share their results.
While these will be there for the overall community to use (as this forum is completely public), within EMC this data will be used to further improve our storage platforms, and ensure we are testing against "customer like" scenarioes.
Any customer who posts their ESXtop and vSCSIstats (from their "heavy hitting VMs") performance data (if you are an EMC customer, the EMC array stats are bonus), I will provide an iomega IX2 to as a "thank you"
Please post your environment info and the output from the scripts (can be large, but is VERY compressible, please zip) on this thread.
As you post your results by continuing the discussion thread, please note some details about your environment:
- how many ESX/ESXi hosts?
- how many VMs?
- what vSphere version?
- VMFS, NFS, Both?
- What type of array backs the datastores?
The scripts to simplify gathering your data are below:
- Powershell scripts for collecting, processing, and federating esxtop data
- Powershell scripts for collecting and processing vscsistats (use this against your "heavy hitting from a storage standpoint" VMs & please comment/describe them in your post)
- Powershell scripts for EMC performance statistics block/NAS
As always thank you for being VMware and EMC customers!
millardjk
4 Posts
0
February 26th, 2011 10:00
The data is zipped using 7-Zip 9.2 using one of the new algorithms that can use more than 2 concurrent cores for compression.
1 Attachment
collect_esxtop.7z
fox_inti1
12 Posts
0
February 28th, 2011 08:00
Attached the output of the esxtop and vscsistats script and get_unified_nas_perf with a interval of 300.
I hop this is of any value.
best regards
Andi
Added the output of get_unified_nas_perf in csv format.
Maybe its also worth to mention that all datastoreses are created with the VSI Unified Storage Management vCenter plug-in
3 Attachments
vscsiStats.zip
esxtop Scripts output.zip
nas_perf.zip
chrisaug
1 Message
0
February 28th, 2011 08:00
I was able to get the esxtop info (I hope I did it right). I'm still working on the vscsiStats. I keep getting a message "not running anymore so quit". I just got it running. I'm not sure why but when I run it on my laptop, it works. Both are Win 7 x64... hmmm
Anyway, here are the vscsiStats too. I hope this can help, and if I did anything wrong and you need new data, just say so. Thanks.
2 Attachments
ps_collect_esxtop_022011.7z
vscsi.7z
mhurst201
6 Posts
0
February 28th, 2011 12:00
I will attach the files as they become available. I am selecting a sample of the entire environment, and will include our heaviest I/O application (SAS) for the scsistats.
-Mike
1 Attachment
ESXTop.zip
arobinson76
1 Message
0
February 28th, 2011 12:00
See my attached doc entitiled Environment for more details on setup and timing of data collection.
Couldn't get the ESXTop script to run so I just ran it in batch mode for 4 hours, 30 second intervals.
Data attached in CSV files.
4 Attachments
101045.zip
Esxtop_Disk_10041.zip
101041.zip
Environment.zip
lartb
5 Posts
0
February 28th, 2011 19:00
The vscsistats script doesn't seem to work with ESX 4.0, I made some edits so the script would at least run and collect some data. The target was an Autonomy IDOL indexer that appears to be working on a reindex today.
1 Attachment
perfcollect.7z
DefinIT
2 Posts
0
March 1st, 2011 08:00
vSCSStats is still running, I will upload shortly. IO workload is SQL 2008 R2 production servers.
1 Attachment
ESXTOP.zip
mryom
4 Posts
0
March 1st, 2011 09:00
Windows 2000, 2003 and 2008 og some linux servers. Theres Exchange 2003, sql2000, 2005 and 2008 servers. Emailxtender indexserver, vcenter servers, windows AD/DNS, and a lot of web and application servers
Remove the first run and added a weeks data from collect_esxtop
Attatched unifited_perf CX3-40 Primary Production SAN being migrated to CX4-120, CX3-40f is just a replica of CX3-40, using RPA for replication.
Attachted vscsistats.
5 Attachments
ps_get_unified_perf_022811.rar
Collect_esxtop_week.part03.rar
Collect_esxtop_week.part01.rar
Collect_esxtop_week.part02.rar
vscsistats.rar
herseyc
1 Message
0
March 1st, 2011 11:00
1. how many ESX/ESXi hosts?
4 ESXi Hosts
3 (esx1-3) - HP DL380 G5, Dual Quad Core 2.66 GHz Intel Xeon x5355, 32 GB RAM
1 (esx4) - HP DL360 G7, Deual Quad Core 2.66 GHz Intel Xeon x5640, 64GB RAM
2. how many VMs?
58 VMs - Mix of Windows 2003, 2008, and Ubuntu
vCenter is also running as a Guest VM
3. what vSphere version?
ESXi 4.1.0, 260247
4. VMFS, NFS, Both?
VMFS for all production VMs. NFS storage for testing and iso/image storage.
5. What type of array backs the datastores?
Celerra NS20 - Fiber Channel and SATA Shelves.
Most data storage on SATA Drives with most (not all) OS partitions installed on FC
The NFS Server is built on HP DL380G5 running Ubuntu
The esxtop stats were collected over a 24 hour period.
The vscsistats were collected for all VMs over about an 8 hour period, I started out collecting every 60 seconds but had issues and switched to 300 seconds. The results are cumulative over that 8 hour period. Not sure if I collected these correctly, just let me know if other information is needed.
Thanks
Hersey
2 Attachments
vscsistats.zip
esxtop.zip
Otto-D
4 Posts
0
March 2nd, 2011 06:00
Thanks alot
i found a stuppid user = me error when i tried running the cust_get_esxtop_adapters.ps1 alone and found and error i fixed put the timer in and restartet the script, it still only added the first host so far. ill give it some time to run
Best Regards Otto D
Otto-D
4 Posts
0
March 2nd, 2011 06:00
Hey All
How long did it take you people to run the script collect_esxtop_adapters.ps1?
mine is gathering from 4 hosts, so far its still gathering from the first host an has been running for 3½ hours
all the hosts are heavely loaded.
Best Regards Otto D
DefinIT
2 Posts
0
March 2nd, 2011 06:00
If you follow the instructions in the PDF file, it will run for 24h (this part: $i=0;do {sleep 60;$i++} until($i -eq 1440);get-job|stop-job). If not it will run until you issue the get-job|stop-job command, or close the PowerCLI window.
Sam
awciske
1 Message
0
March 2nd, 2011 07:00
1 Attachment
esxtop.zip
vgeek.me
6 Posts
0
March 2nd, 2011 13:00
2 Attachments
ESXTOP.7z
vscsistats.7z
jasonboche-2015
44 Posts
0
March 2nd, 2011 21:00
Here's my placeholder for results.
Some details about the lab environment being tested:
Thank you,
Jas
Message was edited by: jasonboche
2 Attachments
test 1 esxtop data.zip
test 2 vscsistats.zip