Dell EMC Unity: Unexplained SP reboot (Reason Code=14), (Dell EMC Correctable).
Summary: Dell EMC Unity SP reboots unexpectedly without dump file created.
Symptoms
SP unexplained reboot. No dumps created.
The array may dial home with error code neo14:60643 or 14:60643 (The DPE has faulted).
IMPORTANT:
The above error code (neo14:60643 or 14:60643) is a generic DPE faulted error and this KB does NOT apply to all instances.
This KB only applies if the specific BMC SEL log error messages are observed: Reason Code=14
Cause
Resolution
Additional Information
From SPx_BMC_SEL_Logs.txt:
11/28/2016 23:12:52 | BMC Shutdown In Progress | Shutdown_In_Prog | Delayed Reboot In Progress | Asserted | Reason Code=14 <<<
11/28/2016 23:13:37 | BMC Adaptive Cooling Event | Adaptive Cooling Event | Thermal Sensor Reading Fault | Asserted | BBU Thermal Sensor Faulted Sensor Index=0
11/28/2016 23:15:13 | BMC Adaptive Cooling Event | Adaptive Cooling Event | Thermal Sensor Reading Fault | Asserted | Drive Thermal Sensor Faulted Sensor Index=0
11/28/2016 23:17:53 | BMC Shutdown In Progress | Shutdown_In_Prog | Delayed Timer Expired | Asserted | Reason Code=14
11/28/2016 23:17:53 | BMC Shutdown In Progress | Shutdown_In_Prog | Delayed Reboot In Progress | Deasserted | Reason Code=14 <<<<
11/28/2016 23:17:55 | BMC Shutdown In Progress | Shutdown_In_Prog | Delayed Reboot In Progress | Asserted | Reason Code=14
SP logs will show the following kind of pattern just before the reboot, however, in the absence of the specific BMC SEL log messages above (Reason Code=14), this KB does NOT apply:
B 11/28/16 23:13:15 Bus0 Enc0 Fan3 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
B 11/28/16 23:13:15 espkg 1670066 [INFO] System: COOLING_MGMT CacheStatus changes from: OK to DEGRADED.
B 11/28/16 23:13:15 Bus0 Enc0 Fan4 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:13:17 Bus0 Enc0 Fan5 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:13:17 espkg 1670066 [INFO] System: COOLING_MGMT CacheStatus changes from: OK to DEGRADED.
A 11/28/16 23:13:17 Bus0 Enc0 Fan6 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:13:17 Bus0 Enc0 Fan7 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:13:17 Bus0 Enc0 Fan8 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:13:17 Bus0 Enc0 Fan9 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
B 11/28/16 23:13:21 SP A 1678009 [ERROR] System: SP Mezzanine 0 is incorrect found Unknown expected .
...
B 11/28/16 23:17:30 SP A 1678009 [ERROR] System: SP Mezzanine 0 is incorrect found Unknown expected .
B 11/28/16 23:17:30 Bus0 Enc0 Fan0 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
B 11/28/16 23:17:30 Bus0 Enc0 Fan1 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
B 11/28/16 23:17:30 Bus0 Enc0 Fan2 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
B 11/28/16 23:17:30 Bus0 Enc0 Fan3 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
B 11/28/16 23:17:30 Bus0 Enc0 Fan4 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
A 11/28/16 23:17:47 Bus0 Enc0 Fan5 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:17:47 Bus0 Enc0 Fan6 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:17:47 Bus0 Enc0 Fan7 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:17:47 Bus0 Enc0 Fan8 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:17:47 Bus0 Enc0 Fan9 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: DATA STALE.
A 11/28/16 23:17:53 Bus0 Enc0 Fan5 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
A 11/28/16 23:17:53 Bus0 Enc0 Fan6 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
A 11/28/16 23:17:53 Bus0 Enc0 Fan7 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
A 11/28/16 23:17:53 Bus0 Enc0 Fan8 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.
A 11/28/16 23:17:53 Bus0 Enc0 Fan9 1678049 [ERROR] System: Fan environmental interface failure detected. Reason: Peer Interface Down.