Avamar: A grid reports as full (and read-only) due to the high usage differences on storage node data partitions

An Avamar grid is operating below maximum storage capacity experiences one or more of the following symptoms:

• Becomes ready only

• Enters admin mode

• Reports as full

• The backup scheduler stops

• Client backups fail and their logs report: 

avtar Info <5314>: Command failed (1 error, exit code 10028: Operation failed because target server is full)

• Server logs report that the server has been changed to admin mode by diskbeat:

55141 {0.7} [diskbeat:195]  WARN: <0639> storage threshold passed: server has changed to admin mode

• On the Avamar Utility Node, the status.dpn command shows that all data partitions are well below the diskreadonly limit default of 65% but the space consumption between the data partitions is not evenly balanced.

The Avamar grid parameter "freespaceunbalance" monitors the amount of space free within data partitions. 

If the percentage difference of free space between the most and least consumed data partitions is greater than freespaceunbalance, the grid is placed into read-only or admin mode.

This event should be taken as a trigger to investigate why there are large differences between file system usage on the storage node data partitions.

Create a Service Request with the Dell Technologies Avamar Support team to investigate the issue.