If you want to do the data migration yourself, it will depend on the type of data you want migrated. Isilon will generally recommend the following:
From a Windows server: robocopy or EMCopy
From a NetApp filer: isi_vol_copy
From a UNIX server: rsync
If you have another NAS device, the tool may be a combination of the above and depends on the type of data access you have enabled. If you have mixed mode (UNIX permission bits and Windows ACLs) we sometimes use rsync to get the bulk data over and then robocopy/EMCopy to transfer over the ACLs.
isi_vol_copy and rsync can be run directly on the Isilon cluster itself increasing speed.
i was told by another customer who was migrating from NetApp that isi_vol_copy was not longer advised to use and they were told to use emcopy/robocopy, is that true ?
I believe sharedup does work as long as you have the correct permissions on the Isilon system. Usually root, but with 7.0, you need to have permissions to modify SMB.
lgdup I am not sure about, but most likely not since it has to modify users and groups and I don't believe the Isilon has that capability exposed via the API that MMC uses.
For NetApp migrations we are still using isi_vol_copy. It is still actively being developed and there are some known issues with it even in the latest revisions (OneFS 6.5.5.15 and OneFS 7.0.1.2), one of the worst in my opinion is that it cannot handle UTF-8 filenames. This really is a problem for east asian countries.
dynamox wrote:
i was told by another customer who was migrating from NetApp that isi_vol_copy was not longer advised to use and they were told to use emcopy/robocopy, is that true ?
Unfortunately I've found isi_vol_copy_vnx to be very unreliable. We're in the middle of a migration from VNX to Isilon and it has core dumped on several of our file systems, as well as dropped ACLs on random files. We have an open case on the issues, but its been very slow going getting any progress and we really need to get moving on the migration, so it's back to robocopy for now.
Take a look at StorageX. it is a heterogeneous NAS migration product. We have API integration into ISILON and VNX to help migrate and create your target (volumes, shares, exports, etc).
Thanks for confirming that you are at least on the latest GA release. Now, while you wait on support (maybe you have an update?), do any of those file systems on the VNX have any the following features:
1) dedupe enabled on the source (VNX) file systems?
If so you must enable the following on the filesystem(s):
fs_dedupe -modify -backup_data_threshold 0
2) files with offline attributes (DHSM)?
a) Currently unsupported with isi_vol_copy_vnx
b) Consider emcopy with the /ignoredhsm flag (introduced in emcopy v4.16) and minimum of VNX OE for File v7.1.71-1
3) ADS (Alternate Data Streams)?
Search the isi_vol_copy_vnx logs for any reference to "ADS"
4) nmfs (nested mount file systems)?
Are you pointing to the root? or the individual nested file systems?
Got an update this morning, they're digging into the core and trying to reproduce it.
1) Yep I've got that set, the command errors out almost instantly and tells you to set that to 0. The problem happens on both dedupe and non-dedupe file systems, too.
2) No offline files
3) No ADS
4) No nmfs, pointing at the root of each file system separately.
I'm running sharedup from Celerra to Isilon and coming across "access is denied" error when trying to create shares on the target Isilon. In the past, working with 6.5 code I had no issues. So I'm thinking that the issue here might be what you are mentioning about SMB modify permissions with 7.0 code.
How do you grant a user the SMB modify permissions? Is that through CLI or GUI?
AndrewChung
132 Posts
0
January 30th, 2013 18:00
If you want to do the data migration yourself, it will depend on the type of data you want migrated. Isilon will generally recommend the following:
From a Windows server: robocopy or EMCopy
From a NetApp filer: isi_vol_copy
From a UNIX server: rsync
If you have another NAS device, the tool may be a combination of the above and depends on the type of data access you have enabled. If you have mixed mode (UNIX permission bits and Windows ACLs) we sometimes use rsync to get the bulk data over and then robocopy/EMCopy to transfer over the ACLs.
isi_vol_copy and rsync can be run directly on the Isilon cluster itself increasing speed.
dynamox
9 Legend
•
20.4K Posts
0
January 30th, 2013 14:00
you will need to rely on host based tools that you already mentioned
christopher_ime
4 Operator
•
2K Posts
0
January 30th, 2013 19:00
Great list Andrew! Thanks for jumping in; you've been busy.
Just curious, (I'm being lazy and should probably just try) does LGDUP and SHAREDUP work on the Isilon?
dynamox
9 Legend
•
20.4K Posts
0
January 30th, 2013 20:00
i was told by another customer who was migrating from NetApp that isi_vol_copy was not longer advised to use and they were told to use emcopy/robocopy, is that true ?
AndrewChung
132 Posts
0
January 31st, 2013 11:00
I believe sharedup does work as long as you have the correct permissions on the Isilon system. Usually root, but with 7.0, you need to have permissions to modify SMB.
lgdup I am not sure about, but most likely not since it has to modify users and groups and I don't believe the Isilon has that capability exposed via the API that MMC uses.
AndrewChung
132 Posts
1
January 31st, 2013 11:00
For NetApp migrations we are still using isi_vol_copy. It is still actively being developed and there are some known issues with it even in the latest revisions (OneFS 6.5.5.15 and OneFS 7.0.1.2), one of the worst in my opinion is that it cannot handle UTF-8 filenames. This really is a problem for east asian countries.
bigbug1
2 Intern
•
196 Posts
0
August 9th, 2013 00:00
When netapp volume encoding is s-jis, can i use isi_vol_copy to migrate date from netapp to isilon?
BPickering1
8 Posts
0
October 31st, 2013 17:00
Unfortunately I've found isi_vol_copy_vnx to be very unreliable. We're in the middle of a migration from VNX to Isilon and it has core dumped on several of our file systems, as well as dropped ACLs on random files. We have an open case on the issues, but its been very slow going getting any progress and we really need to get moving on the migration, so it's back to robocopy for now.
christopher_ime
4 Operator
•
2K Posts
0
October 31st, 2013 19:00
Just curious what version of OneFS are you running? Is it by chance v7.0.2.4
sakmeemana
2 Posts
0
November 1st, 2013 07:00
Take a look at StorageX. it is a heterogeneous NAS migration product. We have API integration into ISILON and VNX to help migrate and create your target (volumes, shares, exports, etc).
BPickering1
8 Posts
0
November 1st, 2013 15:00
Yes, 7.0.2.4.
christopher_ime
4 Operator
•
2K Posts
0
November 1st, 2013 23:00
Thanks for confirming that you are at least on the latest GA release. Now, while you wait on support (maybe you have an update?), do any of those file systems on the VNX have any the following features:
1) dedupe enabled on the source (VNX) file systems?
If so you must enable the following on the filesystem(s):
fs_dedupe -modify -backup_data_threshold 0
2) files with offline attributes (DHSM)?
a) Currently unsupported with isi_vol_copy_vnx
b) Consider emcopy with the /ignoredhsm flag (introduced in emcopy v4.16) and minimum of VNX OE for File v7.1.71-1
3) ADS (Alternate Data Streams)?
Search the isi_vol_copy_vnx logs for any reference to "ADS"
4) nmfs (nested mount file systems)?
Are you pointing to the root? or the individual nested file systems?
BPickering1
8 Posts
0
November 4th, 2013 11:00
Got an update this morning, they're digging into the core and trying to reproduce it.
1) Yep I've got that set, the command errors out almost instantly and tells you to set that to 0. The problem happens on both dedupe and non-dedupe file systems, too.
2) No offline files
3) No ADS
4) No nmfs, pointing at the root of each file system separately.
prashant_shah
1 Rookie
•
37 Posts
0
October 7th, 2014 09:00
Andrew,
I'm running sharedup from Celerra to Isilon and coming across "access is denied" error when trying to create shares on the target Isilon. In the past, working with 6.5 code I had no issues. So I'm thinking that the issue here might be what you are mentioning about SMB modify permissions with 7.0 code.
How do you grant a user the SMB modify permissions? Is that through CLI or GUI?
Thanks.