FEG1
1 Copper

Advice needed EMCOPY or ROBOCOPY???

Jump to solution

Hello,

I need to migrate lot of file servers with lot of Tbytes to a new ISILON.  I had 3 questions:

1))  What tool is better for this task ?  Emcopy or Robocopy.

I never use Emcopy, I used in the past Robocopy.  Emcopy, can copy ACL, NTFS permissions, etc ??

2)) I'm novice but I wondered if is possible to launch an instance of emcopy from the isilon without any computer using ssh or something similar to avoid bottlenecks using bridge machine to launch the copy. ?? ( if this is not possible, I understand that the best solution is to launch emcopy from command line in windows 2003/8 server to the Isilon)

3)) What tool or way you recommend after migration is finished ,  to compare/ensure total size between old server and new server is OK ?

Thanks in Advance,

Best Regards

1 Solution

Accepted Solutions
ACHOUKEKAR
1 Nickel

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

1) In our testing, EMCopy has shown good performance (+20-25% improvement) for copying CIFS data as compared to Robocopy with the same number of threads. We recommend using EMCopy as it has other features added as well like migrating local user data to a AD users using the sidmapfile function.

2) EMCopy is a .exe or Windows application. You need to use a Windows host. If you plan migrating data from NetApp filers or Celerra Filers you can use isi_vol_copy or isi_vol_copy_vnx respectively which can be run directly on the Isilon OneFS CLI to eliminate any intermediary copy hosts.

3) There are several methods to compare data sizes between source and destination. I would recommend maintaining a log of each EMCopy session as that log indicates how much data was copied and if there were any errors. Personally, I have seen customers using Beyondcompare and some have used powershell scripts to compare folder sizes (PS I dont have those scripts as they were written by our customers).

Hope this answers your questions.

31 Replies
chughh
2 Iron

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

emcopy is a fancy version of robocopy ( if you are familiar with it). It allows you to copy data while preserving all NTFS ACLs, it's also multi-threaded so it's very fast. Sharedup allows you to migrate your shares/share permissions from your windows host to Celerra/Isilon so you don't have to recreate those manually. Great tools.

Here is a sample syntax, i am copying data from x: drive to z: drive

emcopy x:\ z:\ /o /s /d /q /secfix /purge /stream /c /r:1 /w:1 /log:c:\emcopylog.txt

if you open command prompt and type emcopy ..you will see all the parameters.

FEG1
1 Copper

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

Thanks @chughh for your fast response, but I would like to hear opinions and responses to my first post.

Best Regards

ACHOUKEKAR
1 Nickel

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

1) In our testing, EMCopy has shown good performance (+20-25% improvement) for copying CIFS data as compared to Robocopy with the same number of threads. We recommend using EMCopy as it has other features added as well like migrating local user data to a AD users using the sidmapfile function.

2) EMCopy is a .exe or Windows application. You need to use a Windows host. If you plan migrating data from NetApp filers or Celerra Filers you can use isi_vol_copy or isi_vol_copy_vnx respectively which can be run directly on the Isilon OneFS CLI to eliminate any intermediary copy hosts.

3) There are several methods to compare data sizes between source and destination. I would recommend maintaining a log of each EMCopy session as that log indicates how much data was copied and if there were any errors. Personally, I have seen customers using Beyondcompare and some have used powershell scripts to compare folder sizes (PS I dont have those scripts as they were written by our customers).

Hope this answers your questions.

Highlighted
gshah1
1 Nickel

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

EMCOPY is supported by EMC and Robocopy is not. EMCOPY preserves NTFS ACLs and also it is multithreaded so faster. Honestly I cannot tell which one is better, I guess you will have to decide for yourself. I prefer EMCOPY just because it is faster.

EMCOPY is Windows based tool, meaning it will run only on system which has windows on it. Isilon is based on FreeBSD Linux, so you cannot run EMCOPY on Isilon. Also, it is not advisable to run any kind of scripts or tools on Isilon that are not Isilon related or otherwise suggested by EMC, it will void EMC support policy.

Hope this helps!

FEG1
1 Copper

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

Thank you very much @Amolc  and @Gav for your fast and rich responses !!

dynamox
6 Gallium

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

if you feel more conformable with robocopy it's just as fast and multi-threaded if you run it on Windows 2008R2 or higher.

clayman88
2 Iron

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

PEG, I have recently migrated about 30TB of file data to an Isilon cluster. I can tell you that EMCopy is significantly faster and works really well. If you're familiar with Robocopy, you won't have any issue learning EMCopy syntax. The format is the same, just different syntax. I would also recommend a product called Beyond Compare. It will do file comparison of the source and destination and if there are any differences, it gives you the ability to move the delta's over. It is also extremely affordable and offers a 30+ day trial.

FEG1
1 Copper

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

Thank you for your opinions!!. They are all very useful.

In the past, I used robocopy a lot.  But now we have to copy hundreds of W2k servers and some filers (EVA, Netapp) to a new Isilon.

Last doubts,

1) What would be the best way to migrate another NAS filer such as (Netapp with CIFS) to a One File Isilon (CIFS too) ?? I think the only way is using a windows host (intermediary copy hosts) this is correct? I have some alternative?



2) If I need to use the intermediary Windows there are difference between using w2008r64 or w2003r32  in a portable computer?? Or better I use Windows 7-64 ? (Thinking in speed performance, etc.) or better use some old server with Windows 2003 instead?¿



3) What is the best practice?? Start to copy with emcopy in old filer LAN to the ISILON by WAN or start the copy process in the DESTINATION LAN and copy files from the old filers?   (the ISILON is a cloud service connected to old filers by WAN)

Best Regards.

0 Kudos
dynamox
6 Gallium

Re: Advice needed EMCOPY or ROBOCOPY???

Jump to solution

1) i have never used it myself but there is isi_vol_copy, take a look at this paper for more details/ideas

https://support.emc.com/docu49401_White-Paper:-SMB-File-Migration-to-EMC-Isilon.pdf?language=en_US

2) does not matter, as long as it has good network connection and plenty of memory.

3) do you have this data on tape (not in NDMP format), that could be restored onto Isilon and only then run emcopy/robocopy to sync up new/changed files ...so not to copy everything over WAN.

0 Kudos