NetWorker: Space not being reclaimed from Data Domain due to connectivity issues

Summary: This article describes a specific circumstance where space reclamation may not proceed despite a lack of media database records for the files in question.

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.

Symptoms

  • nsrim and nsrstage failing to free space on the Data Domain - no errors logged without debugging, and none explicitly stating failure
  • Media database records for Expired savesets are removed during nsrim or Server Protection policy run
  • Data Domain mtree list or filesys show space commands confirm no space being freed after running commands
  • Data Domain filesys report generate file-location path volume_path confirm that some saveset structures exist on the Data Domain which no longer remain in the media database
  • Debug logs show that recordless savesets are indeed being identified and added to the prospective delete list:
nsrsnmd-D3 Saveset 4041419807 (81dca01b-00000006-f0e32c1f-69e32c1f-9d355000-e460a556) is being added to devss_lst on volume volume_name.001
  • Followed by a failure to access the /active/ volume subdirectory
nsrsnmd-D4 fsys_opendir(/mtree/volume_path/active): Opening the directory '/mtree/volume_path/active' failed [5004]
ddp_open_dir() failed, su_name=mtree, path_name=volume_path/active, Err: 5004-nfs lookup failed (nfs: No such file or directory)
  • There are disconnection messages around the same time:
ddcl_disconnect(): disconnecting connection to ip_address with num_reconnects = 10
  • Manually relabeling or erasing the media successfully deletes the recordless savesets

Cause

The storage node responsible for the space recovery operation is being disconnected by the Data Domain when space recovery is attempted.

Resolution

The issue may be temporary in nature, reduce connectivity issues by disabling Storage Node features, and corresponding Server feature:

  • snode device connectivity check enabled: No
  • Dynamic nsrmmds: No
  • Device connectivity check enabled: No

It may also be helpful to apply general space recovery optimizations: NetWorker: Optimizing space recovery operations for Data Domain

Affected Products

NetWorker

Products

Data Domain
Article Properties
Article Number: 000479324
Article Type: Solution
Last Modified: 25 محرم 1448
Version:  2
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.