Recoverpoint: Recoverpoint unable to add RSET or journal
Summary: Customer unable to add RSET or add Journal to existing CG
Symptoms
or
Add Journal to existing CG
Customer cannot add new RSets or Journal Volume
Fapi Log showed timeout
[http-bio-443-exec-1] (JniApiWrapper.java:1862) WARN - Got unsuccessfull RV: MgmtRV [problems=MgmtProblems [mgmtRSSet=[MgmtRS [mgmtRC=MRC_SC_TIMEOUT, additionalInfo=Site: ABC123]], isGood=false], returnValue=null] [http-bio-443-exec-1] (BaseFAPICommand.java:88) ERROR - COMMAND ERROR - SetReplicationSetsSettingsCommand: params=[group=ConsistencyGroupUID [id=162553xxxxx], settingsParam=ConsistencyGroupSettingsChangesParam(groupUID=ConsistencyGroupUID [id=162553xxxx],com.emc.fapi.version5_1.commons.FunctionalAPIActionFailedException: Timeout: Operation aborted. ( Site: ABC123) or [http-bio-443-exec-11] (JniApiWrapper.java:1862) WARN - Got unsuccessfull RV: MgmtRV [problems=MgmtProblems [mgmtRSSet=[MgmtRS [mgmtRC=MRC_SC_TIMEOUT, additionalInfo=Site: ABC123]], isGood=false], returnValue=null] [http-bio-443-exec-11] (BaseFAPICommand.java:88) ERROR - COMMAND ERROR - SetConsistencyGroupCopiesSettingsCommand: params=[group=ConsistencyGroupUID [id=111706xxx], settingsParam=ConsistencyGroupSettingsChangesParam(groupUID=ConsistencyGroupUID [id=111706xxx], replicationSetsChanges=null, vmReplicationSetsChanges=null, removedReplicationSets=null, copiesChanges=[ConsistencyGroupCopySettingsChangesParam(copyUID=ConsistencyGroupCopyUID(groupUID=ConsistencyGroupUID [id=111706xxxx], globalCopyUID=GlobalCopyUID [clusterUID=ClusterUID(id=149836622627860xxxx), copyUID=0]), newJournalVolumes=[DeviceUID [id=739317786321361xxxx]], removedJournalVolumes=[], volumeCreationParams=null, activationParams=null, uvolMaskingGroups=null)], activationParams=null)]
com.emc.fapi.version5_1.commons.FunctionalAPIActionFailedException: Timeout: Operation aborted. ( Site: ABC123 )
Time: Tue Mar 6 16:10:43 20XX Topic: MANAGEMENT Scope: NORMAL Level: INFO Event ID: 1007 Cluster: ABC123 Global links: None RPA: RPA 1 User: adm_abc Summary: Settings change failed Details: Group settings changed in group ABCPROD with UID: 111706589
Cause
In case of RPSE, addition of RSET requires automatic masking changes on the VNX, which apparently takes a lot of time.
Default timeout setting for Control Action called a cross the site was 1 minute. This generally should be sufficient, however sometimes it require a lot more time to complete.
Resolution
Workaround :
Change the tweak value t_sendSettingsActionsTimeout to 180000000 (3 minutes) or higher in both RPA1 and RPA2 via boxmgmt.
Reboot the RPAs sequentially after changing this tweak for it to take affect.