PowerMax: Enable Maintenance Mode for NDM Cutover, Commit and Cancel in Cluster Failover
Summary: Non‑Disruptive Migrations (NDM) remove disk paths from the server during Cutover, Commit or Cancel commands. In Microsoft Cluster Failover (MCF) host or node environments, the periodic disk health check can target a path being removed, causing MCF to trigger a cluster failover. ...
Symptoms
Observed behavior during NDM operations
The following issues may occur when performing Non‑Disruptive Migration (NDM) commands in a Microsoft Cluster Failover environment:
- Microsoft Cluster fails over during the NDM Cutover command (NDM Passthrough mode).
- Microsoft Cluster fails over during the NDM Cancel command.
- Microsoft Cluster fails over during the NDM Commit command (NDM Metro IA mode).
Cause
Root Cause of Cluster Failover During NDM Operations
The Microsoft Failover Cluster periodically executes a disk health check. During Non‑Disruptive Migration (NDM) Cutover, Cancel, or Commit commands, the storage system removes disk paths from the host. If the health‑check process attempts I/O to a path that is in the middle of being removed, the check fails, triggering an automatic cluster failover.
- Cluster health‑check runs every few seconds and expects all configured paths to be available.
- NDM Cutover, Cancel, and Commit commands delete disk paths on the server as part of the migration.
- Concurrent I/O from the health‑check to a path being removed results in a failed health‑check.
- The failed health‑check is interpreted by Microsoft Cluster Failover as a disk fault, causing the active node to fail over.
Resolution
Prevent Cluster Failover During NDM Operations
Step‑by‑Step Procedure
1. Identify all cluster resources (volumes) that reside on the node that will run the NDM Cutover, Commit, or Cancel command.
2. Place each identified resource into maintenance mode (suspend the resource) before starting the NDM operation.
# Example PowerShell command to suspend a cluster resource Suspend-ClusterResource -Name "Cluster Disk 1"
3. Verify that the resources are in the Suspended state.
Get-ClusterResource -Name "Cluster Disk 1" | Format-Table Name, State
4. Execute the required NDM command (Cutover, Commit, or Cancel) on the PowerMax/VMAX array.
5. Once the NDM command completes successfully, return each resource to normal operation.
# Example PowerShell command to resume a cluster resource Resume-ClusterResource -Name "Cluster Disk 1"
6. Confirm that the resources have returned to the Online state.
Get-ClusterResource -Name "Cluster Disk 1" | Format-Table Name, State
Verification
- Check the cluster resource status in the Failover Cluster Manager or via PowerShell; all resources should show Online and not Failed .
- Review the Windows Event Log for any Cluster Failover events during the NDM operation; none should be present.
- Confirm that the NDM migration reports success in the Dell EMC management console.