Skip to main content
Sign Out
Welcome to Dell
My Account
  • Place orders quickly and easily
  • View orders and track your shipping status
  • Enjoy members-only rewards and discounts
  • Create and access a list of your products
  • Manage your Dell EMC sites, products, and product-level contacts using Company Administration.
Sign In Create an Account Dell Financial Services Premier Sign In Partner Program Sign In
Contact Us
Your Dell.com Carts

Article Number: 000168920

IDPA: IDPA deployment fails at 44% on Data Domain with error "FAILED: Configuring Protection Storage. Error: Failed to add interface"

Summary: This KB walks you through the IDPA Deployment failure on Protection Storage with error "FAILED: Configuring Protection Storage. Error: Failed to add interface". This error was observed on a 2.4 system however, it may arise on other versions as well. The root cause at the moment appears to be a timing issue during deployment. ...

Article Content

Symptoms


On the ACM UI, the following error is seen:  
 
kA23a000000GFvMCAW_3_0

In the server.log on ACM, the following errors is seen:  
(/usr/local/dataprotection/var/configmgr/server_data/logs/server.log)
 
2019-11-13 18:11:55,413 INFO  [pool-6-thread-7]-util.SSHUtil: Remote command using SSH execution status:        Host     : [10.x.x.x]      User     : [sysadmin]   Password : [********]   Command  : [ifgroup add dataProtectionGrp interface 10.x.x.x client *]     STATUS   : [37]
2019-11-13 18:11:55,413 INFO  [pool-6-thread-7]-util.SSHUtil:   STDOUT   : [Added interface "10.x.x.x" to ifgroup "dataProtectionGrp".]
2019-11-13 18:11:55,413 INFO  [pool-6-thread-7]-util.SSHUtil:   STDERR   : [
                    ****  Failed add client "*" to ifgroup "dataProtectionGrp": **** Error communicating with management service.]
2019-11-13 18:11:55,413 ERROR [pool-6-thread-7]-util.SSHUtil: Failed to executed remote command using SSH.
2019-11-13 18:11:55,413 INFO  [pool-6-thread-7]-ddadapter.ConfigDataDomainTask: Failed to execute: ifgroup add dataProtectionGrp interface 10.x.x.x client *
2019-11-13 18:11:55,413 ERROR [pool-6-thread-7]-ddadapter.ConfigDataDomainTask: ApplianceException occurred while executing Datadomain config task.
com.emc.vcedpa.common.exception.ApplianceException: Failed to add interface.
        at com.emc.vcedpa.ddadapter.ConfigDataDomainTask.addInterface(ConfigDataDomainTask.java:1010)
        at com.emc.vcedpa.ddadapter.ConfigDataDomainTask.configureDD(ConfigDataDomainTask.java:399)
        at com.emc.vcedpa.ddadapter.ConfigDataDomainTask.run(ConfigDataDomainTask.java:1590)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: com.emc.vcedpa.common.exception.ApplianceException: Failed to add interface.
        at com.emc.vcedpa.ddadapter.ConfigDataDomainTask.addInterface(ConfigDataDomainTask.java:1007)
        ... 5 more
2019-11-13 18:11:55,413 INFO  [pool-6-thread-7]-abstracts.ProductPlugin: Received notifyStatus from task : DATA_DOMAIN:CONFIG:DATA_DOMAIN_SERVER:0:FAILED:11:45%:1:0
Cause
The management services on the data domain (Protection Storage) were not fully up and functional when the workflow issued a command to add Data Domain data interfaces to "dataProtectionGrp" which caused the failure. This command should be manually attempted on Data Domain to confirm if it works to find the root cause for the failure. 

If the command works on Data Domain, this appears to be a timing issue.
Resolution
  1. Log in to the Data Domain system as 'sysadmin' user. 
Note: The password on Data Domain system at this time should be "changeme". 
Accept the configuration messages and say no to prompts to finish the config. If the Data Domain prompts to change password on the first log in, then it can be changed, however do not FORGET to revert it back to "changeme" before hitting "RETRY" to avoid issues with cleanup on Data Domain. 
  1. Run the following command to check the network configuration on Data Domain:  
net show settings
route show gateway
  1. Verify All Data Domain Interfaces can ping the Default gateway configured:   
net ping <default_gateway_ip_address> interface EthV0
net ping <default_gateway_ip_address> interface EthV1
net ping <default_gateway_ip_address> interface EthV2
  1. Verify the DDBoost ifgroup configuration by issuing the following command:   
ddboost ifgroup show config all
  1. Issue the ifgroup command ACM workflow issued which caused the Deployment to fail. This will test whether this was a timing issue due to management services not being up:   
ifgroup add dataProtectionGrp interface x.x.x.x client *
 
If the above command works this time, it confirms this is a timing issue as the management services would have been down at the time when ACM issued this command. Hence, it is safe to rollback/retry and Retry the configuration. 
Example:   
sysadmin@abc.com# ifgroup add dataProtectionGrp interface x.x.x.x client *
Added interface "x.x.x.x" to ifgroup "dataProtectionGrp".
Added client "*" to ifgroup "dataProtectionGrp"
  1. Log in to Data Domain bash mode and revert the password back to "changeme". On bash mode, run the following command:  
passwd sysadmin
  1. Hit 'Retry' button on ACM UI. Retry the configuration and monitor the progress.
NOTE: If any of the above steps show failures, those failures must be investigated accordingly before proceeding with the deployment again.

Article Properties

Affected Product

Integrated Data Protection Appliance Family

Product

PowerProtect DP4400, PowerProtect Data Protection Software, Integrated Data Protection Appliance Family, PowerProtect Data Protection Hardware, Integrated Data Protection Appliance Software

Last Published Date

20 Nov 2020

Version

2

Article Type

Solution

Back to Top