NVP vProxy: VM backups on VMC vCenter fail after upgrade to 4.4.0-4 "Enable Storage vMotion failed. Error 3014"

Summary: VMware Cloud (VMC) vCenter image backups failing after NetWorker version upgrade to 19.11.0.2 Build: 55 and proxy upgrade to 4.4.0-4

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms

Image Backups were failing with Error after vProxy upgrade to 4.4.0-4 on VMware Cloud (VMC) vCenter.
The VM backup session log includes:

YYYY-MM-DDTHH:MM:SSZ NOTICE: VDDK INFO VixDiskLib: VixDiskLib_EndAccess: Enabled Storage VMotion failed. Error 3014 (Insufficient permissions in the host operating system) (No permission to perform this action.) at 6102.
...
YYYY-MM-DDTHH:MM:SSZ ERROR:  [@(#) Build number: 55] c0a8f9d0-2604-4747-b4b8-588a4bbfe205-vcenter.sddc-54-247-108-146.VCENTER_NAME:VM_MOREF: Failed to open source VMDK '[DATASTORE_NAME] 3c8e5a63-4e85-2046-0477-026956739693/VM_NAME.vmdk': VDDK Error: 13: You do not have access rights to this file.
YYYY-MM-DDTHH:MM:SSZ ERROR:  [@(#) Build number: 55] c0a8f9d0-2604-4747-b4b8-588a4bbfe205-vcenter.sddc-54-247-108-146.VCENTER_NAME:VM_MOREF: Failed to initialize Block Reader.
YYYY-MM-DDTHH:MM:SSZ ERROR:  [@(#) Build number: 55] c0a8f9d0-2604-4747-b4b8-588a4bbfe205-vcenter.sddc-54-247-108-146.VCENTER_NAME:VM_MOREF: Failed to backup virtual disk "Hard disk 1".
YYYY-MM-DDTHH:MM:SSZ ERROR:  [@(#) Build number: 55] c0a8f9d0-2604-4747-b4b8-588a4bbfe205-vcenter.sddc-54-247-108-146.VCENTER_NAME:VM_MOREF: Backup has FAILED.

The vProxy's /opt/emc/vproxy/runtime/logs/vbackupd/vbackupd-vddk.log includes:

YYYY-MM-DDTHH:MM:SSZ NOTICE: VDDK INFO VixDiskLib: VixDiskLib_OpenEx: Open a disk.
YYYY-MM-DDTHH:MM:SSZ NOTICE: VDDK INFO warning -[19943] [Originator@6876 sub=Libs] [NFC ERROR]NfcNewAuthdConnectionEx: Failed to connect: Failed to connect to server <ESXi hostname/IP>:902
..
YYYY-MM-DDTHH:MM:SSZ NOTICE: VDDK INFO VixDiskLib: There is no avaiable transport mode when attempting to open disk. Mounting 42197eae-c679-dd06-8bbb-418e49607575 using transport hotadd failed : Could not connect to ESX host <ESXi hostname/IP>: Failed to connect to server <ESXi hostname/IP>:902. at 6502.
YYYY-MM-DDTHH:MM:SSZ NOTICE: VDDK INFO VixDiskLib: VixDiskLib_OpenEx: Cannot open disk [Datastore-name] <VM-name>/<VMDK_name>.vmdk. Error 13 (You do not have access rights to this file) (Mounting 42197eae-c679-dd06-8bbb-418e49607575 using transport hotadd failed : Could not connect to ESX host <ESXi hostname/IP>: Failed to connect to server <ESXi hostname/IP>:902.) at 7072.

    Cause

    The following vProxy configuration file (/opt/emc/vproxy/conf/VixDiskLib.config) contained duplicate entries.

    VPROXY_HOSTNAME:/opt/emc/vproxy/runtime/logs/vbackupd # cat /opt/emc/vproxy/conf/VixDiskLib.config
vixDiskLib.transport.LogLevel = "3"
vixDiskLib.transport.san.DisableVmCheck=0
vixDiskLib.transport.hotadd.NoNfcSession = 1
vixDiskLib.phoneHome.EnablePhoneHome = 1
vixDiskLib.phoneHome.ProductName = "Dell EMC vProxy"
vixDiskLib.phoneHome.ProductVersion = "4.4.0-4_1-1"
vixDiskLib.phoneHome.EnablePhoneHome = 1
vixDiskLib.phoneHome.ProductName = "Dell EMC vProxy"
vixDiskLib.phoneHome.ProductVersion = "4.4.0-4_1-1"
vixDiskLib.phoneHome.EnablePhoneHome = 1
vixDiskLib.phoneHome.ProductName = "Dell EMC vProxy"
vixDiskLib.phoneHome.ProductVersion = "4.4.0-4_1-1"
vixDiskLib.phoneHome.EnablePhoneHome = 1
vixDiskLib.phoneHome.ProductName = "Dell EMC vProxy"
vixDiskLib.phoneHome.ProductVersion = "4.4.0-4_1-1"
VPROXY_HOSTNAME:/opt/emc/vproxy/runtime/logs/vbackupd #

    Resolution

    1. Connect to the vProxy appliance over SSH, log in as admin.
    2. Switch to root:

    sudo su -

    3. Edit the VixDiskLib.config file so that it does not have duplicate vixDiskLib.phoneHome lines:

    vi /opt/emc/vproxy/conf/VixDiskLib.config
    Example: 
    vixDiskLib.transport.LogLevel = "3"
vixDiskLib.transport.san.DisableVmCheck=0
vixDiskLib.transport.hotadd.NoNfcSession = 1
vixDiskLib.phoneHome.EnablePhoneHome = 1
vixDiskLib.phoneHome.ProductName = "Dell EMC vProxy"
vixDiskLib.phoneHome.ProductVersion = "4.4.0-4_1-1"
    4. Save the file.
    5. Restart the vbackupd service. 
    systemctl daemon-reload
systemctl restart vbackupd.service
    NOTE: Optionally, instead of restarting services, the vProxy VM can be rebooted. Rebooting the vProxy VM reloads the changes in the VixDiskLib.config file during vbackupd service startup.

    Affected Products

    NetWorker

    Products

    NetWorker Family
    Article Properties
    Article Number: 000255608
    Article Type: Solution
    Last Modified: 09 Dec 2024
    Version:  2
    Find answers to your questions from other Dell users
    Support Services
    Check if your device is covered by Support Services.