Thanks for the advice. I will be checking out the oplocks.
FYI – I have had very good performance from the Windows 2008R2 version of Robocopy. 225,000+ files about 1.6 TB in size got a throughput of about 400 GB per hour.
User copy has modified permissions on both the windows and isilon files system. I believe the share also gives them modify permissions, but need to verify it. Access, Fox Pro, Word and Excel work just fine, as they can be opened and save with no issue.
1. Robocopy performance in general is terrible. Use emcopy 4.17 instead, and you'll especially with large file counts see much better performance, especially on incrementals. 3 million 8KB files for instance in 6 directories, with emcopy an incremental took 1 hour and 2 minutes. With Robocopy the same dataset took 54 hours, and that was the server 2012 R2 version with the /mt switch.
2. Make sure the user account performing the copy is a member of local administrators and backup operators on the source, and on Isilon that it is given run-as-root to the target share. (But only this account), run-as-root can be dangerous if used incorrectly.
As to Quark Express, I would venture to guess that it's likely an oplocks issue. Turn off oplocks on the share in question and see if that helps at all.
hillch
3 Posts
0
May 24th, 2016 13:00
Thanks for the advice. I will be checking out the oplocks.
FYI – I have had very good performance from the Windows 2008R2 version of Robocopy. 225,000+ files about 1.6 TB in size got a throughput of about 400 GB per hour.
User copy has modified permissions on both the windows and isilon files system. I believe the share also gives them modify permissions, but need to verify it. Access, Fox Pro, Word and Excel work just fine, as they can be opened and save with no issue.
I truly appreciate your help.
Charlie
crklosterman
450 Posts
0
May 24th, 2016 13:00
A few things.
1. Robocopy performance in general is terrible. Use emcopy 4.17 instead, and you'll especially with large file counts see much better performance, especially on incrementals. 3 million 8KB files for instance in 6 directories, with emcopy an incremental took 1 hour and 2 minutes. With Robocopy the same dataset took 54 hours, and that was the server 2012 R2 version with the /mt switch.
2. Make sure the user account performing the copy is a member of local administrators and backup operators on the source, and on Isilon that it is given run-as-root to the target share. (But only this account), run-as-root can be dangerous if used incorrectly.
As to Quark Express, I would venture to guess that it's likely an oplocks issue. Turn off oplocks on the share in question and see if that helps at all.
~Chris
mef7
3 Posts
0
December 20th, 2016 14:00
Anyone know how to get emcopy? I found a zip download for 4.19 from EMC but it is password protected.
mef7
3 Posts
0
January 4th, 2017 10:00
yes, it's "emcopy"