Avamar: AV/DD Backup Failure with invalid token due to invalid Key Magic

Summary: Avamar: AV/DD Backup Failure with invalid token due to invalid Key Magic

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms



Avamar with Data Domain integrated backups fail. When the avtar logs are consulted the error appears to be an invalid token:

<snip>
2017-02-21 11:35:50 avtar Info <40058>: - Client connecting to the Avamar Server using authentication, client connecting to the Data Domain system using two-way authentication
2017-02-21 11:35:51 avtar Info <10540>: - Resolved Data Domain Server name "testdd.emc.com" to the IP address "10.241.170.73"
2017-02-21 11:35:51 avtar Info <41236>: - Connecting to Data Domain Server name "testdd.emc.com" with token:5ba93c9db0cff93f52b521d7420e43f6eda2784f
2017-02-21 11:35:51 avtar Error <41439>: Using invalid token:5ba93c9db0cff93f52b521d7420e43f6eda2784f
2017-02-21 11:35:51 avtar Error <10542>: Data Domain server "testdd.emc.com" open failed DDR result code: 4904, desc: Invalid API argument.
2017-02-21 11:35:51 avtar Error <10509>: Problem logging into the DDR server:'', only GSAN communication was enabled.
2017-02-21 11:35:51 avtar FATAL <17964>: Backup is incomplete because file "/ddr_files.xml" is missing
<snip> 

Consultation of /usr/local/avamar/var/ddrmaintlogs/ddrmaint.log shows that the token request failed:


<snip> 
Feb 21 11:35:23 av-un-ge06-adm0 ddrmaint.bin[47285]: Info: request-token:open_ddr:service handle:1 index:1 server:testdd.emc.com user:ddboost duration=1800 expires=2017-02-21 13:05:23
Feb 21 11:35:23 av-un-ge06-adm0 ddrmaint.bin[47285]: Error: request-token::body - Failed to get token. Use token=1:00. Error:5008 Reason:invalid argument
Feb 21 11:35:23 av-un-ge06-adm0 ddrmaint.bin[47285]: Error: <xxxx>Datadomain request token operation failed.  
<snip>
Reviewing the /ddr/var/log/debug/ddfs.info log on Data Domain reveals that token encryption failed due to invalid key magic:
1. Log in to the Data Domain.
2. Review the ddfs.info log by using the following command:

log view debug/ddfs.info

Alternatively if it is preferred KB 323235 can be used to escape to bash mode to navigate directly to ddfs.info. 

<snip>
02/21 11:35:23.543 (tid 0x7f53bd82d990): ddboost-<testavamar.emc.com-59512>: testavamar.emc.com Local Time: Tue Feb 21 12:35:23 2017
02/21 11:35:23.553 (tid 0x7f53bd8078e0): nfsproc3_ost_get_token_3_svc: ost_build_token
02/21 11:35:23.553 (tid 0x7f53bd8078e0): ost_build_token()
02/21 11:35:23.553 (tid 0x7f53bd8078e0): ost_encrypt_string_with_key() This key has an invalid key magic 9df5c181
02/21 11:35:23.553 (tid 0x7f53bd8078e0): ost_build_token: Token encryption failed with error 5008  
02/21 11:35:23.553 (tid 0x7f53bd8078e0): nfsproc3_ost_get_token_3_svc: ost_build_token failed [DDErrno = 5008 (ost_encrypt_string_with_key() Invalid User Key, Cannot be used to decrypt string)]  
<snip>
 
 
If the invalid key magic messages are not present within the ddfs.info log, discontinue these instructions.  

Cause

.

Resolution

1. Revoke token access from the ddboost user:

ddboost user revoke token-access <ddboost username>


2. Open the Data Doman server in the Avamar Administrator:-

  • In Avamar MCGUI, go to Server > Server Management.
  • Select the DD server
  • Click "Edit Data Domain System icon".
  • Click OK in the pop-up window.
  a. In Avamar Administrator, click the Server launcher button.
     The Server window appears.

  b. Click the Server Management tab.

  c. Select the Data Domain system to edit.

  d. Select Actions > Edit Data Domain System.
    The Edit Data Domain System dialog box appears.

  e. Click OK.
    There is no need to change the Data Domain configuration.


3. Restart DD Boost on the Data Domain system:

  a. Log in to the Data Domain System.

  b. Enter the following commands in the Data Domain CLI: 
ddboost disable
ddboost enable


4. Test another backup to ensure this resolved the invalid token issue. 
 

Affected Products

Avamar

Products

Avamar, Data Domain
Article Properties
Article Number: 000064950
Article Type: Solution
Last Modified: 11 Dec 2025
Version:  6
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.