由于负载均衡器出现问题,DPE vApp 备份失败,并显示错误“vmwappimage Error <19591>: httpPost: http_code: 500 sending to url 'https://localhost:8080/vcp-ba-vappplugin-ws/vapp'”

Summary: 由于负载均衡器出现问题,DPE vApp 备份失败,并显示错误“vmwappimage Error<19591>: httpPost: http_code: 500 sending to url 'https://localhost:8080/vcp-ba-vappplugin-ws/vapp'”。众所周知,CloudFlare 负载均衡器等负载均衡器问题会引起 HTTP 524 Origin 超时错误,从而导致备份失败。 ...

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.

Symptoms

备份日志可能会显示以下错误消息:

2021-02-08 10:02:50 vmwappimage Info <19594>: httpPost: url https://localhost:8080/vcp-ba-vappplugin-ws/vapp 2021-02-08 10:03:22 vmwappimage Error <19591>: httpPost: http_code: 500 sending to url 'https://localhost:8080/vcp-ba-vappplugin-ws/vapp' 2021-02-08 10:03:22 vmwappimage Info <9772>: Starting graceful (staged) termination, Prep-for-backup message to ADS failed (wrap-up stage) 2021-02-08 10:03:22 vmwappimage Error <0000>: Prep-for-backup message to ADS failed 2021-02-08 10:03:22 vmwappimage Info <19594>: httpPost: url https://localhost:8080/vcp-ba-vappplugin-ws/vapp 2021-02-08 10:03:45 vmwappimage Error <19591>: httpPost: http_code: 500 sending to url 'https://localhost:8080/vcp-ba-vappplugin-ws/vapp' 2021-02-08 10:03:45 vmwappimage Error <17707>: Post backup-complete message to ADS failed. 2021-02-08 10:03:45 vmwappimage Info <16038>: Final summary, cancelled/aborted 0, snapview 0, exitcode 157: miscellaneous error The vcdsdk.log on the VPA at "/var/log/vcp/srv/vcdsdk.log" shows the following error:
> 2021-02-12 11:58:37,368 [AMQP listener 9] INFO (RestUtil.java:329) - Response - <html> > <head><title>524 Origin Time-out</title></head> > <body bgcolor="white"> > <center><h1>524 Origin Time-out</h1></center> > <hr><center>cloudflare-nginx</center> > </body> > </html> 提醒:可能需要添加 VCDSDK Cloud API 调试才能确认上述错误:

启用 Cloud API 调试的步骤:

1.登录 VCP 主节点 2.编辑文件 /etc/vcp/srv/vcpsrv-log4j2.xml 3.原始内容:     <Logger name="com.vmware" level="info" additivity="true" /> 更改此行以读取:     <Logger name="com.vmware" level="debug" additivity="true" /> 4. 请重新启动 bg 和 srv 服务,vcp-cli bg update -p <MASTER-PASSWORD> <BG-INSTANCE-NAME> vcp-cli srv update -p  <MASTER-PASSWORD> <SRV-CELL-INSTANCE-NAME>

在 VPA 中的 vCloud Director FQDN 上执行 nslookup 会显示多个 IP 地址。
客户确认已配置负载均衡器。 

Cause

尝试连接到 vCloud Director 的备份网关正在访问 CloudFlare 负载均衡器。CloudFlare 负载均衡器上的 API 请求失败导致出现问题。

CloudFlare 负载均衡器提供的返回代码如下:
2021-02-12 11:58:37,368 [AMQP listener 9] INFO (RestUtil.java:329) - Response - <html> > <head><title>524 Origin Time-out</title></head> > <body bgcolor="white"> > <center><h1>524 Origin Time-out</h1></center> > <hr><center>cloudflare-nginx</center> > </body> > </html>

Resolution

1.与客户确认他们是否在备份网关等 VPA 组件与 vCloud Director 之间配置了负载均衡器。

2.为所有 Docker 容器虚拟机添加本地主机文件条目,以手动强制 DPE 组件使用专用 IP 地址绕过负载均衡器以连接到 vCloud Director。

3.在低于 19.4 的 DPE 版本中,可以在单个 DPE 虚拟机(如 SRV-Cell 虚拟机、备份网关虚拟机等)上创建主机文件条目。

4.在 DPE 版本 19.4 及更高版本上,需要对每个 Docker 容器进行更改。
  • 打开 SSH 至 VPA 虚拟机
  • 运行以下命令以获取 Docker 容器列表:docker ps
  • 运行以下命令以进入 Docker 容器:docker exec -it <first 2 digits of containerid> /bin/bash
  • 运行以下命令以更新本地主机文件记录:echo "IP_ADDRESS FQDN SHORTNAME" >> /etc/hosts

重要说明:重新启动 VPA 服务 (Cell-SRV/BG) 服务会破坏 Docker,然后将重新创建 Docker。因此,主机文件更改必须再次更新。

Affected Products

Avamar, vCloud Director Data Protection Extension

Products

PowerProtect Data Protection Appliance
Article Properties
Article Number: 000183920
Article Type: Solution
Last Modified: 01 Aug 2021
Version:  3
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.