VMAX3, VMAX All Flash, PowerMax: Storage Resource Pool (SRP) threshold alert
Summary: Storage Resource Pool (SRP) threshold alert in VMAX3, VMAX All Flash, and PowerMax
Symptoms
Storage Resource Pool (SRP) threshold alert:
Storage Resource Pool has reached 80% of capacity
Storage Resource Pool has reached 90% of capacity
Storage Resource Pool has reached 95% of capacity
Storage Resource Pool has reached 96% of capacity
Storage Resource Pool has reached 97% of capacity
Storage Resource Pool has reached 98% of capacity
Storage Resource Pool has reached 99% of capacity
symevent mesage 0x0047 "The device pool or SRP is almost full"
Cause
This alert indicates that one of the VMAX3, VMAX All Flash, or PowerMax Storage Resource Pools (SRP) reached or surpassed a threshold value for percent utilization. A single alert is generated and dials home to Dell to inform the SRP in question reached the following threshold: 80%, 90%, 95%, 96%, 97%, 98%, and 99%. Once an alert threshold is reached, the array sets the threshold to the next highest threshold. If the utilization of the SRP is reduced under a previous threshold (that is, 94% capacity draws down to 88%), the threshold is automatically reset to the previous level (in this example, 90%).
In VMAX All Flash Arrays, utilization is the Effective Used Capacity, which is the percent full and the overhead that is required for the compression engine.
For general background information on SRP utilization please refer to Article Number 000190104 / Solutions Enabler, Unisphere for PowerMax, VMAX All-FLash: Understanding "Effective Used Capacity" and SRP Utilization
Resolution
- Review the current utilization of the array's SRPs.
- Verify the current SRP threshold warning and alert notifications.
- Take necessary action once the SRP has been investigated.
Recommended Action Options:
- Reclaim space in the SRP.
- Allocate additional storage using additional EFD or disks to Disk Groups.
- Free existing TDEVs that are being unused.
- Delete TDEVs.
- If using TimeFinder SnapVX for local replication, the versioned data within the snapshots can contribute to the SRP usage. Possible deletion of snapshots may be warranted.
- If using legacy TimeFinder Clone or TimeFinder BCV, the clones take up the same capacity as their source devices.
- If SRDF/A is active and between two VMAX3 arrays, Delta Set Extension (DSE) may be active contributing to space usage in the SRP.
How to View SRP usage
Solutions Enabler
symcfg -sid xxxx list -srp -detail - This command gives a basic view of the SRP along with basic metrics, including capacity, usage, and subscription. If there are multiple SRPs, each is listed in the display.symcfg -sid xxxx list -srp -detail -v - This command provides a deeper view of the SRP with a view of the Disk Groups in the SRP, and utilization by Thin device. The top of the display shows summary details of the usable space, the free space, the subscribed space, and the subscription percentage of the SRP. The bottom of the display provides the percentage of total consumption compare with the SRP. This command also lists the Effective Used Capacity, which is what triggers alerts in the All Flash Array.
Unisphere for VMAX or Unisphere for PowerMax
- Hover over the Storage menu at the top of the display.
- Click Storage Resource Pools when the mini-menu window appears.
Solutions Enabler
symevent monitor to monitor for real-time events.
Use
symevent list to list past events.
When the alert occurs, the following message appears: The device pool or SRP is almost full.
symevent.
Unisphere for VMAX or Unisphere for PowerMax
Default alert 'Storage Resource Pool Free Space' is listed with three alert stats, starting at 60% (Warning), 80% (Critical), and finally 100% (Fatal). By default, notifications for this alert are not set. You can set an alert notification by right-clicking the entry, and clicking Notify. (Note: Alert Notifications types and manipulation are handled in Administration > Alert Settings > Notifications)
The default notification thresholds cannot be changed, but a new alert policy can replace it. Click the Create button and follow the wizard prompts to create your thresholds.
Additional Information
The sender of the email is Symmetrix.047xErrorReport@emc.com.