Article Number: 541089

printer Print mail Email

Avamar - Failed to update or connect to Data Domain system due to locked DDBoost user

Summary: DDboost user is locked due to the several attempts of logging in with wrong password.

Primary Product: Avamar

Product: Avamar

Last Published: 20 Apr 2020

Article Type: Break Fix

Published Status: Online

Version: 5

Avamar - Failed to update or connect to Data Domain system due to locked DDBoost user

Article Content

Issue


All backups from Avamar to Data Domain failed with " DDR result code: 5075, desc: the user has insufficient access rights"
2020-02-09 10:05:39 avtar Error <10542>: Data Domain server "datadomain.local" open failed DDR result code: 5075, desc: the user has insufficient access rights (Log #1)
2020-02-09 10:05:39 avtar Error <10509>: Problem logging into the DDR server:'', only GSAN communication was enabled. (Log #1)
2020-02-09 10:05:39 avtar FATAL <17964>: Backup is incomplete because file "/ddr_files.xml" is missing (Log #1)
2020-02-09 10:05:39 avtar FATAL <8941>: Fatal server connection problem, aborting initialization. Verify correct server address and login credentials. (Log #1)

All Maintenance jobs failed with MSG_ERR_DDR_ERROR

The cplist command reports invalid checkpoints and the error: <4750>Datadomain get checkpoint list operation failed
admin@avamar :~/>: cplist --full
cplist: ERROR: ddrmaint: <4750>Datadomain get checkpoint list operation failed.

2020/02/09-12:08:56.31504 [cplist]  ERROR: <0001> ddrmaint: <4750>Datadomain get checkpoint list operation failed.
cp.20200122200414 Thu Jan 23 00:04:14 2020 invalid --- ---  nodes   1/1 stripes   1875
cp.20200122201338 Thu Jan 23 00:13:38 2020 invalid --- ---  nodes   1/1 stripes   1875
cp.20200123043629 Thu Jan 23 08:36:29 2020 invalid --- ---  nodes   1/1 stripes   1876
ddrmaint cplist also reports the same error 
admin@avamar:~/>: ddrmaint cplist
<4750>Datadomain get checkpoint list operation failed.
DDR Authentication flag is disabled in mcserver.xml 
root@avamar:~/#: grep -i "use_ddr_auth_token" /usr/local/avamar/var/mc/server_data/prefs/mcserver.xml
              <entry key="use_ddr_auth_token" value="false" />


 
Cause
Due to the several and frequent attempts from the Avamar side with wrong DDBoost password it get locked closing all the connections to the Avamar.

SSH connection using the ddboost user to the Data Domain shows that the account is locked due to X failed logins 
admin@avamar:~/>: ssh ddboost@datadomain
EMC Data Domain Virtual Edition
Account locked due to X failed logins
Password:
On the Data Domain: 

 users show ddboost user as enabled as its locked due to the several failed logins 
sysadmin@ddve# user show list
User list from node "localhost".
Name       Uid   Role    Last Login From   Last Login Time           Status   Disable Date
--------   ---   -----   ---------------   ------------------------  -------- -----------
sysadmin   100   admin   xx.xxx.xx.x       Mon Feb 10 11:57:06 2020  enabled     never
ddboost    500   admin    xx.xxx.xx.x      Mon Feb 10 12:07:07 2020  enabled     never
--------   ---   -----   ---------------   ------------------------   -------------------
2 users found.
the registry protocol settings are adjusted as in KB 502996
ddboost@Dddve# reg show protocol.ost
reg set protocol.ost.stu_user.avamar-<dpnid>= 500:50
reg set protocol.ost.user.ddboost = 500:50 
reg set protocol.ost.uid500:50 = ddboost
reg removekey protocol.ost.uid500:100

DDFS.INFO showing authentication failure from the Avamar IP (Bash Mode)
02/09 16:35:28.041 (tid 0x7fc81fc067c0): WARNING: Failed to verify the password for user ddboost.  Error is 7:Authentication failure
02/09 16:35:28.041 (tid 0x7fc81fc067c0): DDBOOST verify user ddboost failed: Invalid Password
02/09 16:35:28.041 (tid 0x7fc81fc067c0): nfsproc3_ost_mnt_3_svc: connection failed permission from plugin 192.xxx.xx.xx version 3.3
02/09 16:35:28.042 (tid 0x84dfa10): nfs_rpc_svc_idx0 destroyed tcp 1900000290



 
Resolution
Work with Avamar and Data Domain Support to apply the resolution provided in the internal notes part of this article

This resolution will need to be followed on each Avamar using the same DDBoost user  
ddboost@ddve# ddboost storage-unit show
Name                Pre-Comp (GiB)   Status   User      Report Physical
                                                           Size (MiB)
-----------------   --------------   ------   -------   ---------------
avamar-xxx          515401.8            RW       ddboost                 -
-----------------   --------------   ------   -------   ---------------
 D    : Deleted
 Q    : Quota Defined
 RO   : Read Only
 RW   : Read Write
 RD   : Replication Destination

 
Notes

This may also be caused by an expired DDBoost password instead of an incorrect one. Good case would be if it use to work and is suddenly failing. Follow this KB to resolve:

https://support.emc.com/kb/482322

 

Issue


All backups from Avamar to Data Domain failed with " DDR result code: 5075, desc: the user has insufficient access rights"
2020-02-09 10:05:39 avtar Error <10542>: Data Domain server "datadomain.local" open failed DDR result code: 5075, desc: the user has insufficient access rights (Log #1)
2020-02-09 10:05:39 avtar Error <10509>: Problem logging into the DDR server:'', only GSAN communication was enabled. (Log #1)
2020-02-09 10:05:39 avtar FATAL <17964>: Backup is incomplete because file "/ddr_files.xml" is missing (Log #1)
2020-02-09 10:05:39 avtar FATAL <8941>: Fatal server connection problem, aborting initialization. Verify correct server address and login credentials. (Log #1)

All Maintenance jobs failed with MSG_ERR_DDR_ERROR

The cplist command reports invalid checkpoints and the error: <4750>Datadomain get checkpoint list operation failed
admin@avamar :~/>: cplist --full
cplist: ERROR: ddrmaint: <4750>Datadomain get checkpoint list operation failed.

2020/02/09-12:08:56.31504 [cplist]  ERROR: <0001> ddrmaint: <4750>Datadomain get checkpoint list operation failed.
cp.20200122200414 Thu Jan 23 00:04:14 2020 invalid --- ---  nodes   1/1 stripes   1875
cp.20200122201338 Thu Jan 23 00:13:38 2020 invalid --- ---  nodes   1/1 stripes   1875
cp.20200123043629 Thu Jan 23 08:36:29 2020 invalid --- ---  nodes   1/1 stripes   1876
ddrmaint cplist also reports the same error 
admin@avamar:~/>: ddrmaint cplist
<4750>Datadomain get checkpoint list operation failed.
DDR Authentication flag is disabled in mcserver.xml 
root@avamar:~/#: grep -i "use_ddr_auth_token" /usr/local/avamar/var/mc/server_data/prefs/mcserver.xml
              <entry key="use_ddr_auth_token" value="false" />


 
Cause
Due to the several and frequent attempts from the Avamar side with wrong DDBoost password it get locked closing all the connections to the Avamar.

SSH connection using the ddboost user to the Data Domain shows that the account is locked due to X failed logins 
admin@avamar:~/>: ssh ddboost@datadomain
EMC Data Domain Virtual Edition
Account locked due to X failed logins
Password:
On the Data Domain: 

 users show ddboost user as enabled as its locked due to the several failed logins 
sysadmin@ddve# user show list
User list from node "localhost".
Name       Uid   Role    Last Login From   Last Login Time           Status   Disable Date
--------   ---   -----   ---------------   ------------------------  -------- -----------
sysadmin   100   admin   xx.xxx.xx.x       Mon Feb 10 11:57:06 2020  enabled     never
ddboost    500   admin    xx.xxx.xx.x      Mon Feb 10 12:07:07 2020  enabled     never
--------   ---   -----   ---------------   ------------------------   -------------------
2 users found.
the registry protocol settings are adjusted as in KB 502996
ddboost@Dddve# reg show protocol.ost
reg set protocol.ost.stu_user.avamar-<dpnid>= 500:50
reg set protocol.ost.user.ddboost = 500:50 
reg set protocol.ost.uid500:50 = ddboost
reg removekey protocol.ost.uid500:100

DDFS.INFO showing authentication failure from the Avamar IP (Bash Mode)
02/09 16:35:28.041 (tid 0x7fc81fc067c0): WARNING: Failed to verify the password for user ddboost.  Error is 7:Authentication failure
02/09 16:35:28.041 (tid 0x7fc81fc067c0): DDBOOST verify user ddboost failed: Invalid Password
02/09 16:35:28.041 (tid 0x7fc81fc067c0): nfsproc3_ost_mnt_3_svc: connection failed permission from plugin 192.xxx.xx.xx version 3.3
02/09 16:35:28.042 (tid 0x84dfa10): nfs_rpc_svc_idx0 destroyed tcp 1900000290



 
Resolution

Work with Avamar and Data Domain Support to apply the resolution provided in the internal notes part of this article

This resolution will need to be followed on each Avamar using the same DDBoost user  
ddboost@ddve# ddboost storage-unit show
Name                Pre-Comp (GiB)   Status   User      Report Physical
                                                           Size (MiB)
-----------------   --------------   ------   -------   ---------------
avamar-xxx          515401.8            RW       ddboost                 -
-----------------   --------------   ------   -------   ---------------
 D    : Deleted
 Q    : Quota Defined
 RO   : Read Only
 RW   : Read Write
 RD   : Replication Destination

 

Notes

This may also be caused by an expired DDBoost password instead of an incorrect one. Good case would be if it use to work and is suddenly failing. Follow this KB to resolve:

https://support.emc.com/kb/482322

 

Article Attachments

Attachments

Attachments

Article Properties

First Published

Mon Feb 10 2020 15:10:47 GMT

First Published

Mon Feb 10 2020 15:10:47 GMT

Rate this article

Accurate
Useful
Easy to understand
Was this article helpful?
0/3000 characters