Avamar：由于 Ddrmaint 服务关闭，备份失败并显示令牌无效错误

观察到的备份失败迹象。

当备份过程由于 Data Domain Replicator （DDR） 令牌问题而失败时，将记录以下症状。

• Avamar 日志报告使用无效令牌和多个错误代码。
• 备份失败，缺少 ddr_files.xml 文件中定义。
• 严重的服务器连接问题会阻止初始化。
• 命令执行以退出代码 10008 结束，表示无法与服务器建立连接。

  019-05-27 20:09:30 avtar Error <41439>: Using invalid token:5ba93c9db0cff93f52b521d7420e43f6eda2784f
  2019-05-27 20:09:30 avtar Error <10542>: Data Domain server "datadomain_123.com" open failed DDR result code: 4904, desc: Invalid API argument.
  2019-05-27 20:09:30 avtar Error <10509>: Problem logging into the DDR server:'', only GSAN communication was enabled.
  2019-05-27 20:09:30 avtar FATAL <17964>: Backup is incomplete because file "/ddr_files.xml" is missing
  2019-05-27 20:09:30 avtar Info <10642>: DDR errors caused the backup to not be posted, errors=0, fatals=0
  2019-05-27 20:09:30 avtar Info <12530>: Backup was not committed to the DDR.
  2019-05-27 20:09:30 avtar FATAL <8941>: Fatal server connection problem, aborting initialization. Verify correct server address and login credentials.
  2019-05-27 20:09:30 avtar Info <6149>: Error summary: 5 errors: 41439, 10542, 8941, 10509, 17964
  2019-05-27 20:09:30 avtar Info <8468>: Sending wrapup message to parent
  2019-05-27 20:09:31 avtar Info <5314>: Command failed (5 errors, exit code 10008: cannot establish connection with server (possible network or DNS failure))

• 搜索 DDR_GET_AUTH_TOKEN 在 ddrmaint.log 不返回输出。

  grep -i  DDR_GET_AUTH_TOKEN  /usr/local/avamar/var/ddrmaintlogs/ddrmaint.log*

• dpnctl 状态显示 ddrmaint-service 已关闭。 

  dpnctl status output showing ddrmaint-service down
  admin@avamar123:~/>: dpnctl status
  Identity added: /home/admin/.ssh/admin_key (/home/admin/.ssh/admin_key)
  dpnctl: INFO: Avamar server status: up
  dpnctl: INFO: MCS status: up.
  dpnctl: INFO: emt status: up.
  dpnctl: INFO: Backup scheduler status: up.
  dpnctl: INFO: Maintenance windows scheduler status: enabled.
  dpnctl: INFO: Unattended startup status: disabled.
  dpnctl: INFO: avinstaller status: up.
  dpnctl: INFO: ConnectEMC status: up.
  dpnctl: INFO: ddrmaint-service status: down.
  dpnctl: INFO: [see log file "/usr/local/avamar/var/log/dpnctl.log"]

备份作失败，因为 ddrmaint-service 在 Avamar Server 上未运行。关闭此服务时，Avamar Client 无法获取有效的 DDR 身份验证令牌，从而导致一连串错误，导致备份失败。

主要影响因素

• 而 dpnctl 输出指示 ddrmaint-service 已关闭。
• 对 Data Domain 服务器的身份验证失败，并生成“无效令牌”错误。
• 所需文件 /ddr_files.xml 不生成，导致备份不完整。
• 后续的 DDR 错误会阻止发布或提交备份。

相关日志证据

2019-05-27 20:09:30 avtar Error <41439>: Using invalid token:5ba93c9db0cff93f52b521d7420e43f6eda2784f
2019-05-27 20:09:30 avtar Error <10542>: Data Domain server "datadomain_123.com" open failed DDR result code: 4904, desc: Invalid API argument.
2019-05-27 20:09:30 avtar Error <10509>: Problem logging into the DDR server:'', only GSAN communication was enabled.
2019-05-27 20:09:30 avtar FATAL <17964>: Backup is incomplete because file "/ddr_files.xml" is missing
2019-05-27 20:09:30 avtar FATAL <8941>: Fatal server connection problem, aborting initialization. Verify correct server address and login credentials.

服务状态确认

admin@avamar123:~/> dpnctl status
dpnctl: INFO: Avamar server status: up
dpnctl: INFO: MCS status: up.
dpnctl: INFO: emt status: up.
dpnctl: INFO: Backup scheduler status: up.
dpnctl: INFO: Maintenance windows scheduler status: enabled.
dpnctl: INFO: Unattended startup status: disabled.
dpnctl: INFO: avinstaller status: up.
dpnctl: INFO: ConnectEMC status: up.
dpnctl: INFO: ddrmaint-service status: down.
dpnctl: INFO: [see log file "/usr/local/avamar/var/log/dpnctl.log"]

 重新启动 DDR 维护服务。

分步过程

1. 使用具有管理权限的帐户登录到 Avamar Server。
2. 检查 ddrmaint-service 以确认其已关闭。

   # Verify service status
   $ dpnctl status | grep ddrmaint-service
   ddrmaint-service status: down

3. 启动服务。

   # Start the DDR maintenance service
   $ dpnctl start ddrmaint-service

4. 验证服务是否正在运行。

   # Re‑check status to ensure it is up
   $ dpnctl status | grep ddrmaint-service
   ddrmaint-service status: up

5. 确认备份正在完成，而不显示”invalid token“错误。
   1. 运行测试备份或等待下一个计划备份完成。
   2. 检查 Avamar 日志是否不存在错误，例如 41439 开始， 10542 开始， 10509 开始， 17964 或 8941 。

      # Example of a successful backup log snippet
      2024-01-30 02:15:12 avtar Info <10642>: Backup completed successfully.
      2024-01-30 02:15:12 avtar Info <12530>: Backup was committed to the DDR.

   3. 确认文件 /ddr_files.xml 在备份完成后存在。