This post is more than 5 years old
5 Practitioner
•
274.2K Posts
0
2238
tool for comparison migrated data
Hi All,
I wonder, if someone have has gone through any tool which allow to compare migrated data with the original data in terms of file attributes and permissions on source and target. We are doing data migration of Netapp & Isilon to Isilon using different tools like rsync, isi_vol and synciq.
Regards
crklosterman
450 Posts
1
January 28th, 2016 07:00
All,
BeyondCompare is a great and cheap tool (no association with EMC) for comparing data source to target if you choose to use a migration tool that cannot do this natively and give you reports on it. For comparing permissions, the best method i've found outside of commercial migration software is to:
1. Use emcacl to dump the permissions on the source saving the output to a .txt file
2. Use emcacl to dump the permissions on the target saving the output to a .txt file
3. Use beyond compare or another diff utility to compare the 2 text files. There will likely be some discrepancies even if it's just from local users and groups, so understanding the output and what can safely be ignored is key.
This is by no means elegant or fast but it gets the desired level of assurance that everything made it across as it should.
Otherwise Dobiminer from Datadobi can do md5 hashing on every single source/target file during it's copy runs. So can emcopy but with one key distinction. MD5 hashing file content during a migration has a huge performance penalty. With emcopy in the full and then every single incremental it has to hash every single file on source and target, which takes forever. Because dobiminer keeps track of this information for later reporting, it still hashes all the files during the first full copy, but in the incrementals it only hashes newly copied or changed files, which decreased the performance impact a ton. They call this feature "read-back verification" and it is enabled by default in the 3.5 and later releases to ensure data integrity. There are other 3rd party utilities that can do this as well, I'm just commenting on the one I'm the most familiar with.
Chris Klosterman
Advisory Solution Architect
EMC Enablement Team
chughh
122 Posts
0
May 5th, 2014 03:00
I would say use use synciq its fast an reliable.
rsync also works great but no incremental jobs
isi_vol_copy has issues with some versions
Peter_Sero
1.2K Posts
0
May 5th, 2014 03:00
> rsync also works great but no incremental jobs
incremental is the *essence* of rsync -- what exactly are you missing from it?
???
-- Peter
Anonymous
5 Practitioner
5 Practitioner
•
274.2K Posts
0
May 5th, 2014 03:00
Just to clarify, my issue is not with migration tools, i am looking for a tool if available which can allow me to compare migrated with original data on source interms of file attributes and permissions on source. We have done the migration of data already. I wonder if there is any tool help me verify the migrated data.
tsap1
19 Posts
0
January 28th, 2016 07:00
Hi, I too am looking for a tool to compare source and target directories, files and permissions. Did you locate anything worth using?
Gabe Heinisch
tsap1
19 Posts
0
January 28th, 2016 07:00
Chris
Great information, this will help a great deal for my current project.
Many thanks
Gabe Heinisch
919-280-7112
Sent via the Samsung Galaxy S® 5 ACTIVE™, an AT&T 4G LTE smartphone