Emcopy or sharedup

Question

I am currently planning on copying 2Tb from my existing Windows files server to my new NX4. It seems that emcopy is the way to go with this, esp since the security is not a big deal, as I wanted to change certain folders anyway. I have not used this before, so I wanted to get some advice on things I should be looking at before the migration happens. I downloaded emcopy 4.08 from Powerlink. I'm not sure exactly what switches I would use, but can look that up for myself. Also, is there software support from EMC for emcopy?

Sorry for the loaded questions, but I'm also not sure what the difference would be between emcopy or sharedup. Thank you in advance for any help.

dynamox · Answer

emcopy is a fancy version of robocopy ( if you are familiar with it). It allows you to copy data while preserving all NTFS ACLs, it's also multi-threaded so it's very fast. Sharedup allows you to migrate your shares/share permissions from your windows host to Celerra so you don't have to recreate those manually. Great tools.

Here is a sample syntax, i am copying data from x: drive to z: drive

emcopy x:\ z:\ /o /s /d /q /secfix /purge /stream /c /r:1 /w:1 /log:c:\emcopylog.txt

if you open command prompt and type emcopy ..you will see all the parameters.

staboogie · Answer

Thank you,

I looked at the emcopy command and this appears to be just what I need. I'll try a migration tonight and test out a few of the switches. Thank you very much for your support. I love thee forums.

Rainer_EMC · Answer

Sure there is support since emcopy is an official EMC tool

staboogie · Answer

Thank you for your response. I have run emcopy on the drive to copy data. In the log I do see a good amount of error 1307 and error 1337 stating 'Unable to set SD'. The files that I see the error are still being copied over, and I plan on redoing the permissions on the folders when the entire migration is over. Should I stop this now and address the SD problem? Also, is there a tool that can take a look before I run emcopy to see if these errors will show up again? I must say that emcopy has been running very fast and I'm pleased with the folder permissions that were brought over. Makes a migration seem easier using this. Thanks again for all the help, it is very much appreciated.

dynamox · Answer

can you look at those files on the source and see if there is a SID number in Security Tab ..instead of an AD account ?

staboogie · Answer

The problem would be that the files were 'everybody' and there might be a couple that were deleted. I can get rid of the Sid numbers if that would be it. I planned to run this incrementally for the rest of the week, do you think the incremental copied would take care of this if I clean it up tomorrow?

dynamox · Answer

take a look at this solution: emc46968

staboogie · Answer

Thanks for the quick response. You're a rock star. I'm going to use this right away. This should set me right. Thanks again.

dynamox · Answer

EMC Knowledgebase'EMCopy utility fails with error 'Security Descriptor Error: Unable to set SD' while migrating data from source to target server.'ID:emc46968Usage:142Date Created:04/02/2002Last Modified:10/22/2009STATUS:ApprovedAudience:Customer Knowledgebase Solution Environment:Product: Celerra File Server (CFS)Environment:Application SW: Microsoft RobocopyEnvironment:Protocol: Common Internet File System (CIFS)Environment:EMC SW: NAS Code 2.2.39.1 and laterEnvironment:EMC SW: EMCopy 2.08 and laterEnvironment:EMC SW: EMCopy 2.04Environment:EMC SW: EMCopy 2.00Environment:OS: Microsoft Windows NTEnvironment:OS: Microsoft Windows 2000Problem:EMCopy utility fails with 'Security Descriptor Error: Unable to set SD' error while migrating data from source to target server.Problem:When conducting EMCopy migration from target NT Server share to Celerra CIFS Server share, the EMCopy operation fails with error: 'Security Descriptor error: Unable to set SD: Error 1337: The security ID structure is invalid'.Problem:Error: This security ID may not be assigned as the primary group of an objectProblem:Security Descriptor error: Unable to set SD Error 1337: The security ID structure is invalid.Problem:Error 1337: The security ID structure is invalid.Problem:Security Descriptor error: Unable to create file and set SD Error 64: The specified network name is no longer available.Problem:Error 64: The specified network name is no longer available.Problem:Files are not being copied to the target, only to the top directories.Problem:NT file and folder ownership and permissions are not migrating over correctly.Problem:LGDUP was run, but outputted following errors: Error: you do not have the 'Generate security audits' privilege on this server. Please set the required privilege(s). You must logon again to get the new privilege(s).Problem:Robocopy error: This security ID may not be assigned as the primary group of an object.Problem:When attempting to Migrate Data from Windows to Celerra using Robocopy, this error is returned ERROR 1308 (0x0000051C) Copying NTFS Security to Destination Directory This security ID may not be assigned as the primary group of an objectRoot Cause:The NT User account used for the 'migration' does not have the correct Administrative Group membership and User Rights assigned, or both. Each NT client or Celerra CIFS Server involved with the EMCopy migration must have the appropriate Administrative membership and User Rights granted. This is done by configuring the User account for the appropriate Membership and User Rights on each local machine User Manager interface. There should also be parameters added to the Data Mover to allow the migration of files with unknown SIDs.Fix:A successful and complete EMCopy migration of all NT folders and files must have the Ownership and Permission attributes set accordingly:Proper Group Membership and User Rights for the Windows account used for the migration. The migration User account should have Domain Admin membership and must be logged onto the system that is conducting the actual migration of data and attributes. In addition to the above attributes, the following parameters can be set on the Data Mover, but requires a system reboot. Additionally, using the following parameters can degrade User access performance since the Data Mover will attempt to resolve unknown SIDs whenever files are accessed that contain invalid or unresolved SIDs. If the data being migrated is known to contain orphaned SIDs (i.e., deleted User or Group accounts), it is suggested that the Source data be cleansed of these SIDs prior to the migration. Basic parameters to allow for migration of data containing unknown SIDsparam cifs acl.mappingErrorAction=3param cifs acl.retryAuthSid=600 param cifs acl.FailOnSDRestoreError=0 Changing Parameters from command line: # server_param server_2 -facility cifs -modify acl.mappingErrorAction -value 3 Note: This parameter defines rules for unknown mappings between SID, UID, GID on ACL setting, either because DC does not know SID or the username is not yet mapped to UID/GID. Bit 0 = store unknown SID Bit 1 = store SID without UNIX GID/UID mapping Bit 2 = enable debug traces Bit 3 = turning on bits 0 and 1 # server_param server_2 -facility cifs -modify acl.retryAuthSid -value 600 Note: This parameter sets the timeout value of 600 seconds between authentication retries for unknown SIDs. # server_param server_2 -facility cifs -modify acl.FailOnSDRestoreError -value 0 Note: This parameter suppresses any errors resulting from unresolved ACLs during migration of files to Celerra, migrating all resolvable SIDs properly and placing unresolved SIDs in the delayed SID state. Without this setting, errors will be returned when copying files with unresolvable SIDs, resulting in copying of files with default Everyone Full Control applied.

staboogie · Answer

dynamox wrote:take a look at this solution: emc46968 Thank you again. Is it possible to provide a link to this as I can't find the solution?

Rainer_EMC · Answer

did it work now? Rainer

christopher_ime · Answer

Just curious, do you enforce local user and groups permissions (in addition to domain users and groups) on the filesystems/shares being migrated on the source?  I noticed that this was never brought up so maybe unnecessary, but if so, then you will want to replicate the local user and group database from the Windows server using the tool LGDUP. For more information on this utility, you can search this forum for 'LGDUP' or for the administrative guide, see the following document: 'Using EMC Utilities for the CIFS Environment' It can be downloaded from PowerLink via the following breadcrumb trail: Home > Support > Technical Documentation and Advisories > Hardware/Platforms Documentation > Celerra Network Server > Maintenance/Administration

staboogie · Answer

Thank you very much for checking up on this. Worked perfect. Fantastic tool. Copied 3TB in a little over 6 hours.

Rdamal · Answer

Hi

I am running emcopy to migrate data from MS file server to an Isilon cluster oneFS 7.0, and below are the errors and warning that i see when i run the migration scripts. Is there a way to get it fixed.

Warnings:

Unable to retrieve the PDC of the domain GA nearby \\MCGNAS, error : 1717

The default primary group is set to "domain users"

Errors:

Unable to open object for SD setting

SD not set, Retrying in 0 seconds...

This is how the script looks like

emcopy.exe "source" "destination" /secfix /s /o /d /purge /c /r:2 /w:0 /log:

Rainer_EMC · Answer

I would suggest to move this thread to the Isilon forum for better visibility – this is the Celerra/VNX forum

ID:	emc46968
Usage:	142
Date Created:	04/02/2002
Last Modified:	10/22/2009
STATUS:	Approved
Audience:	Customer

Celerra

Emcopy or sharedup

Was this post helpful?