Avamar: Hyper-V GLR failing with "Failed to Get Security attributes for VHD file"
Summary: This article details potential Hyper-V Granular Level Recovery (GLR) failure and a potential new hotfix.
Symptoms
Granular Level Recovery (GLR) mount of Hyper-V Virtual Machine (VM) fails with messages similar to the following:
From axionfs.log:
axionfs Error <10900>: cbfs_get_file_security: function called with invalid parameter.
From avhyperv_plugin.log:
avhypervglr Info <18750>: Failed to mount VM <DELLEMC> avhypervglr Error <13794>: Hyper -V GLR Service had the following error = STATE_EVENT_IGNORED - Ignoring requested state transition for the 'plugin_mount_vm' event with transition cause of 'CAUSE_MOUNT_NEW_VOLUME' while in the 'STATE_NEEDS_REBOOT' state avhypervglr Error <15458>: Unable to mount VHDs
From avhypervglrsvc.log:
[avhypervglrsvc.exe] Fetching Virtual Disk properties for 'C:\Program Files\avs\var\avfscache\AVFSMOUNT\00000001\d$\VM\Hyper-V\Virtual Hard Disks\DELLEMC_592A3536-12B2-4555-9850-A8D2A1B9D816.avhdx' with volume mappings set to 'false'. avhypervglrsvc.exe Info <42422>: Unable to get Virtual Disk Information. OpenVirtualDisk failed with error (3): The system cannot find the path specified. [avhypervglrsvc.exe] hypervvss_vdisk::set_vdisk_parent -> in_path='C:\Program Files\avs\var\avfscache\AVFSMOUNT\00000001\d$\VM\Hyper-V\Virtual Hard Disks\DELLEMC_592A3536-12B2-4555-9850-A8D2A1B9D816.avhdx', in_parent_path='C:\Program Files\avs\var\avfscache\AVFSMOUNT\00000001\d$\VM\Hyper-V\Virtual Hard Disks\DELLEMC.vhdx'. avhypervglrsvc.exe Error <42422>: Unable to set Virtual Disk Parent Path. OpenVirtualDisk failed with error (3): The system cannot find the path specified. CoInitializeSecurity Failed because it has been already called by this thread avhypervglrsvc.exe Info <13669>: VDS Service Completed. Result = The operation completed successfully. avhypervglrsvc.exe Info <13686>: Mounting VHD file path = C:\Program Files\avs\var\avfscache\AVFSMOUNT\00000001\d$\VM\Hyper-V\Virtual Hard Disks\DELLEMC_592A3536-12B2-4555-9850-A8D2A1B9D816.avhdx avhypervglrsvc.exe Error <13701>: Failed to Get Security attributes for VHD file 'C:\Program Files\avs\var\avfscache\AVFSMOUNT\00000001\d$\VM\Hyper-V\Virtual Hard Disks\DELLEMC_592A3536-12B2-4555-9850-A8D2A1B9D816.avhdx'. Error = A device attached to the system is not functioning. avhypervglrsvc.exe Error <13687>: Unable to get security attributes for file = C:\Program Files\avs\var\avfscache\AVFSMOUNT\00000001\d$\VM\Hyper-V\Virtual Hard Disks\DELLEMC_592A3536-12B2-4555-9850-A8D2A1B9D816.avhdx avhypervglrsvc.exe Error <13693>: AddVDisk returned error The system cannot find the path specified. [] No more virtual disk provider found avhypervglrsvc.exe Error <13680>: Failed to query Provider avhypervglrsvc.exe Error <13678>: Failed to mount vhd disk [avhypervglrsvc.exe] xml = C:\Program Files\avs\var avhypervglrsvc.exe Info <15441>: Failed to find disk at index = 1
In some users' environments, it may also cause the Windows GLR servers or proxies to reboot during the browse attempt.
Cause
The Avamar GLR plugins for Hyper-V, Exchange, SharePoint, and SQL (TLR) have an embedded third-party driver "ELDOS driver."
This component is necessary to mount the Avamar backup path of a database to accomplish the GLR or TLR operations later completed with the Itempoint tool.
That ELDOS driver is at an earlier version that does not have the latest enhancements to support newer Windows operating systems (Windows 2022 and later). This causes the failures mentioned above.
As a consequence, the GLR or TLR recovery is not supported for Windows 2022 and later, also reflected in the Avamar Support Matrix.
Dell Engineering and Product Management Teams are assessing alternatives for the best viable options.
Resolution
Temporary workaround:
To perform GLR of a database, first recover the database to a file, then use the Itempoint tool to mine the data.