VNX: Operation timed out waiting for mirrors and Clone groups to complete initial copy (User Correctable)
Summary: Failed to setup VDM MetroSync on VNX2
Symptoms
Failed to setup VDM MetroSync for VDM2, This can fail at either Enabling VDM metrosync service with the nas_cel -syncrep -enable or when creating the VDM metrosync session with nas_syncrep -create command.
It can fail with multiple errors depending on where in the process it fails.
Operation timed out waiting for mirrors and Clone groups to complete initial copy
Failed to create MirrorView consistency group.
From SP logs you will also see this error.
Failure (Could not add member to consistency group.
Cause
This failure occurs due to the system being unable to copy a lun to the DR side. Some of the luns worked fine but others did not. In the SR that this issue was identified on, the Mirrorview connection from the Source box SPB to DR box SPB was not enabled.
For this to work you first have to enable Mirrorview. (this is taken from the VDM Merosync Document)
You can establish the MirrorView connection using either Fibre Channel or iSCSI over IP. This port must be connected to the corresponding MV ports on the peer system. Note that SPA must be connected to SPA on the peer system while SPB must be connected to SPB on the peer system. Once these connections are in place, check Unisphere s Hosts Initiators page to ensure that the MV ports display as Registered and Logged In.
When Viewing the mirror -sync -info command on both systems you can see the following
:\Users\dellemc>naviseccli -h 127.1.1.1 -user sysadmin -password sysadmin -scope 0 mirror -sync -info
Can a mirror be created on this system: YES
Logical Units that are mirrored in Primary Images: 63997
Logical Units that are mirrored in Secondary Images: 19
Logical Units that can be mirrored: 1009 116 18 104 1000 112 5003 1008 63999 120 2 8 63996 100 5004 2010 1102 2001 102 2011 1003 110 11 5010 118 122 4001 4007 3001 106 1002 114 2006 2014 5005 17 103 20 111 5002 1007 5006 10 119 1 4000 7 4006 14 2005 2013 63998 13 4003 124 2009 1006 3003 1101 125 63995 101 5008 2000 3004 2008 109 5009 117 3000 105 1001 9 113 121 15 3 5000 16 4 1100 63994 5001 5 0 6 4005 1104 2004 4004 1103 2002 2012 12 2003 123 4002 1005 3002 107 5007 115 2007 108 1004
Is Write Intent Log Used: YES
Remote systems that can be enabled for mirroring:
Remote systems that are enabled for mirroring:
Array UID: 50:06:01:60:88:60:56:77
Status: Enabled on both SPs <------------------------- This is correct, connections to both SPs on the other side
Enabled Connection Type(s): Fibre
Disabled Connection Type(s):
Maximum number of possible Mirrors: 128
C:\Users\dellemc>naviseccli -h 127.1.1.3 -user sysadmin -password sysadmin -scope 0 mirror -sync -info
Can a mirror be created on this system: YES
Logical Units that are mirrored in Primary Images: 63997
Logical Units that are mirrored in Secondary Images: 1
Logical Units that can be mirrored: 124 113 119 102 118 4001 110 1101 5002 4006 4 4007 63998 5008 108 63995 122 104 1002 112 1103 1104 117 4000 1100 100 5001 63994 4005 0 5010 4003 2 106 5007 125 114 120 107 1000 121 103 1001 111 1102 5003 63999 116 5004 5000 63996 4004 5005 5009 5006 101 4002 109 115 123 105
Is Write Intent Log Used: YES
Remote systems that can be enabled for mirroring:
Remote systems that are enabled for mirroring:
Array UID: 50:06:01:60:88:60:58:8F
Status: Enabled on SP A only <-------------------SPB connection missing
Enabled Connection Type(s): Fibre
Disabled Connection Type(s):
Maximum number of possible Mirrors: 128
Also looking at the SP collects
HBA UID: 50:06:01:60:88:60:58:8F:50:06:01:68:08:60:58:8F
Server Name: 50:06:01:60:88:60:58:8F
Server IP Address: UNKNOWN
Host ID: Clariion-50:06:01:60:88:60:58:8F
HBA Model Description:
HBA Vendor Description:
HBA Device Driver Name:
Information about each port of this HBA:
Server Name: 50:06:01:60:88:60:58:8F
Server IP Address: UNKNOWN
SP Name: SP B
SP Port ID: 0
HBA Devicename:
Trusted: NO
Logged In: YES
Source ID: 10555392
Defined: YES
Initiator Type: 24 ----------------------- 24 is a disabled link.
StorageGroup Name: None
Resolution
You can resolve this either with command line or Unisphere
From Unisphere go into manage mirror connections on the Array missing the connection and disable the connection and then enable.
From CLI if this is a fibre connection
/nas/sbin/navicli -h spb mirror -disablepath "SPB IP of other side" -connectiontype fibre
/nas/sbin/navicli -h spb mirror -enablepath "SPB IP of other side" -connectiontype fibre
Example:
/nas/sbin/navicli -h spb mirror -enablepath 10.10.10.1 -connectiontype fibre
/nas/sbin/navicli -h spb mirror -disablepath 10.10.10.1 -connectiontype fibre