PowerFlex: PFX00102.0000201 - NODE_STATUS_DIAGNOSTIC_FAILURE - The following nodes are not in a ready status or unreachable

Error code/symptom ID: 7042012 (PFX00102.0000201) The following nodes are not in a ready status or unreachable status: {{node_names}}

Symptom - A node event failure occurs when a specific node failed three consecutive times for scheduled runs. After the third failure an event is raised, and an alert is triggered. Each scheduled run occurs every two minutes, so the alert will be triggered after six minutes.  In a manual, run every time the node fails an event is raised and an alert is triggered. When a node is in a failed state, the physical node will restart or fail. Likely cause will be networking issues, disk storage issues, possible misconfiguration, or ETCD database corruption.

Resolution and troubleshooting steps:

Problem Validation 

• Go to the Management Diagnostics nodes page. At least one node will be in a failed state.
• Review the node card raw output on the diagnostics tab.
• There might also be errors in business logic such as unpredicted input or cluster state, or network issues.
• There might be a slow response time.

Problem Resolution

• Go to the Management Diagnostics nodes page.
• Wait 10 to 15 minutes for the node to recover.
• Check the overall PowerFlex management platform cluster status.
• Depending on the error, you can free up the disk space, fix network issues, restart the physical VM or physical node, or examine the raw output for hints.
• If this issue persists, call Dell Technologies Support for assistance.

Resolution Validation

• In the Management Diagnostics page, nodes tab, verify that the node is in a stable, ready state.  

See Dell PowerFlex 4.5.x and PowerFlex Manager 4.8.x Alerts and Events Reference Guide