Avamar: Hyper-V federated backup fails as "Unable to connect to the remote client ', error code: 2. Ensure that the remote backup agent is running"
Summary: Knowledge Base (KB) article that provides a solution to Hyper-V backup failure due to remote connection failure.
Symptoms
Hyper-V cluster backups failing with errors similar to the following below:
avhypervvss Error <0000>: Unable to connect to the remote client '192.168.1.1', result code: 2. Please ensure that the remote backup agent is running. avhypervvss Error <19328>: [AVA1] is unable to forward CTL sub-workorder to remote client [AVA1].
Cause
The primary cluster node is unable to send workorder to the secondary nodes using the Backup Agent inter-communication service using port 28002 or 30002. Several possible root causes include the following below:
-
The Backup Agent (Avagent) service on the secondary nodes is not started.
-
Port 28002 or 30002 on the secondary node is blocked.
-
The primary node is attempting to send a sub workorder to the incorrect IP address on the secondary node. That IP address is either non-routable or cannot access the Avamar grid.
Resolution
Depending on the cause, the resolutions are listed below:
-
Start the Backup Agent service on the secondary nodes of the Hyper-V cluster using services.msc console.
-
Open port 28002 or 30002 on the secondary nodes by adding Inbound rules in Windows Defender Firewall software on each cluster node. In some customer environments, engage your system administrator to open the necessary ports in the firewall or router application.
-
Edit the
avhypervvss.cmdfile and add the "--cluster node" flag with the IP address for each cluster node.-
For federated Hyper-V cluster backups, the
avhypervvss.cmdfile is located in the 'ClusterStorage' directory (Example:C:\ClusterStorage\Volume1\Avamar\var) by default--clusternode=<<NODENAME>>(IP Address) --clusternode=<<NODENAME>>(IP Address)
-
For proxy backups, the
avhypervvss.cmdfile is located in the 'C:\Program Files\avs\var' directory of the primary node by default.--clusternode=<<NODENAME>>(IP Address) --clusternode=<<NODENAME>>(IP Address)
Example:
--clusternode=HYPERVNODE1(192.168.1.10)
--clusternode=HYPERVNODE2(192.168.1.11)
--clusternode=HYPERVNODE3(192.168.1.12)
-
Additional Information
The Backup Agent service uses port 30002 if session security is enabled on the Avamar server.