Dell EMC Unity: ESX host intermittently loses connection to array. (User Correctable)
Summary: ESX hosts intermittent connection issue
This article applies to
This article does not apply to
This article is not tied to any specific product.
Not all product versions are identified in this article.
Symptoms
ESX host lost connection from unity storage platform intermittently.
Alarm Definition:
([Event alarm expression: Lost Storage Connectivity] OR [Event alarm expression: Lost Storage Path Redundancy] OR [Event alarm expression: Degraded Storage Path Redundancy] OR [Event alarm expression: Lost connection to NFS server])
Event details:
Path redundancy to storage device naa.6006016025204100706def5772e9095f degraded. Path vmhba3:C0:T5:L21 is down. Affected datastores: Unity500_LUN21.
Cause
SCSi errors found in the logs:
=============================================================
H:0x1:This status is returned if the connection is lost to the LUN. This can occur if the LUN is no longer visible to the host from the array side or if the physical connection to the array has been removed.
-----------------------------------------------------------------------------------------------------------------
2016-10-10T01:10:49.806Z cpu11:33575)WARNING: NMP: nmpCompleteRetryForPath:352: Retry cmd 0x28 (0x413685483f40) to dev "naa.60060160252041004864f657ca48a0e5" failed on path "vmhba1:C0:T5:L84" H:0x1 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T01:10:49.808Z cpu11:33575)WARNING: NMP: nmpCompleteRetryForPath:352: Retry cmd 0x28 (0x412e803fc6c0) to dev "naa.6006016025204100b74df657aa54a7bd" failed on path "vmhba1:C0:T5:L82" H:0x1 D:0x0 P:0x0 Possible sense data: 0x5 0x25 0x0.
2016-10-10T01:10:50.809Z cpu5:33575)NMP: nmp_ThrottleLogForDevice:2458: Cmd 0x28 (0x413685364040, 32840) to dev "naa.60060160252041002ba1f4577351fc3c" on path "vmhba1:C0:T5:L80" Failed: H:0x1 D:0x0 P:0x0 Possible sense data: 0x5 0x25 0x0. Act:FAILOVER
=============================================================
H:0x2: This status is returned when the HBA driver is unable to issue a command to the device. This status occurs due to dropped FCP frames in the environment.
-----------------------------------------------------------------------------------------------------------------
2016-10-10T10:17:51.136Z cpu15:33575)ScsiDeviceIO: 2331: Cmd(0x412e8315c000) 0x2a, CmdSN 0x800e0036 from world 2262944 to dev "naa.6006016002302f00de17ed6898bde411" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:17:51.136Z cpu15:33575)ScsiDeviceIO: 2331: Cmd(0x412e8ae66100) 0x2a, CmdSN 0x800e0054 from world 2262944 to dev "naa.6006016002302f00de17ed6898bde411" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:17:51.743Z cpu0:33575)ScsiDeviceIO: 2331: Cmd(0x412e88a0b640) 0x8a, CmdSN 0x800e0056 from world 2262944 to dev "naa.6006016002302f00de17ed6898bde411" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
=============================================================
H:0x3: This status is returned when the command in-flight to the array times out.
-----------------------------------------------------------------------------------------------------------------
2016-10-10T08:13:32.998Z cpu21:33002)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:656: Path "vmhba1:C0:T4:L212" (UP) command 0xa3 failed with status Timeout. H:0x3 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T09:03:11.383Z cpu20:33000)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:656: Path "vmhba1:C0:T5:L80" (UP) command 0xa3 failed with status Timeout. H:0x3 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T09:45:52.051Z cpu0:33001)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:656: Path "vmhba1:C0:T5:L20" (UP) command 0xa3 failed with status Timeout. H:0x3 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
=============================================================
H:0x5: This status is returned if the driver aborts commands in-flight to the target. This occurs due to a command timeout or parity error in the frame.
------------------------------------------------------------------------------------------------------------------
2016-10-10T01:10:44.805Z cpu18:32823)ScsiDeviceIO: 2369: Cmd(0x41368544c3c0) 0xfe, CmdSN 0x320b4 from world 32797 to dev "naa.60060160252041004864f657ca48a0e5" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T01:10:44.807Z cpu18:32823)ScsiDeviceIO: 2369: Cmd(0x41368c890900) 0xfe, CmdSN 0x44fe4 from world 32797 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T01:10:44.807Z cpu18:32823)ScsiDeviceIO: 2369: Cmd(0x412e88a0b280) 0xfe, CmdSN 0x484ae from world 32797 to dev "naa.60060160252041003a25ee57beb061a2" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
=============================================================
H:0x7: This status is returned when a device is reset due to a Storage Initiator Error. This typically occurs due to an outdated HBA firmware or possibly (though rarely) as the result of a bad HBA.
------------------------------------------------------------------------------------------------------------------
2016-10-10T10:12:31.471Z cpu22:33575)ScsiDeviceIO: 2369: Cmd(0x412e82926d40) 0x8a, CmdSN 0x80000055 from world 2084335 to dev "naa.6c81f66000cbf667000002865436a015" failed H:0x7 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:17:32.475Z cpu14:33575)NMP: nmp_ThrottleLogForDevice:2458: Cmd 0x8a (0x412e800334c0, 2084335) to dev "naa.6c81f66000cbf667000002865436a015" on path "vmhba1:C0:T0:L3" Failed: H:0x7 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2016-10-10T10:17:32.475Z cpu14:33575)ScsiDeviceIO: 2369: Cmd(0x412e800334c0) 0x8a, CmdSN 0x8000004e from world 2084335 to dev "naa.6c81f66000cbf667000002865436a015" failed H:0x7 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
===============================================================
H:0x8: This status is returned when the HBA driver aborts I/O. It also occurs if the HBA resets the target.
----------------------------------------------------------------------------------------------------------------------
2016-10-10T10:18:02.052Z cpu18:33575)ScsiDeviceIO: 2369: Cmd(0x4136864a87c0) 0xfe, CmdSN 0x4ae1c from world 32797 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x8 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:18:04.126Z cpu14:33575)ScsiDeviceIO: 2313: Cmd(0x413689303d80) 0x28, CmdSN 0x4ae1b from world 34044 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x8 D:0x0 P:0x0
2016-10-10T10:18:04.126Z cpu14:33575)ScsiDeviceIO: 2313: Cmd(0x412e809d33c0) 0x28, CmdSN 0x4ae1d from world 2448210 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x8 D:0x0 P:0x0
===============================================================
State in Doubt error -These messages appear as the Host Bus Adapter (HBA) driver aborts a command because the command took longer than the timeout period of 5 seconds to complete.Refer to the following vmware kb - https://kb.vmware.com/kb/1022026
---------------------------------------------------------------------------------------------------------------------
2016-10-10T10:54:06.947Z cpu0:33569)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.60060160252041001b77f7577dc86804" state in doubt; requested fast path state update...
2016-10-10T10:56:25.641Z cpu23:33569)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6006016025204100d8f1f55717242522" state in doubt; requested fast path state update...
2016-10-10T10:56:30.602Z cpu12:33569)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6006016025204100a85bf657846d3209" state in doubt; requested fast path state update...
=============================================================
H:0x1:This status is returned if the connection is lost to the LUN. This can occur if the LUN is no longer visible to the host from the array side or if the physical connection to the array has been removed.
-----------------------------------------------------------------------------------------------------------------
2016-10-10T01:10:49.806Z cpu11:33575)WARNING: NMP: nmpCompleteRetryForPath:352: Retry cmd 0x28 (0x413685483f40) to dev "naa.60060160252041004864f657ca48a0e5" failed on path "vmhba1:C0:T5:L84" H:0x1 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T01:10:49.808Z cpu11:33575)WARNING: NMP: nmpCompleteRetryForPath:352: Retry cmd 0x28 (0x412e803fc6c0) to dev "naa.6006016025204100b74df657aa54a7bd" failed on path "vmhba1:C0:T5:L82" H:0x1 D:0x0 P:0x0 Possible sense data: 0x5 0x25 0x0.
2016-10-10T01:10:50.809Z cpu5:33575)NMP: nmp_ThrottleLogForDevice:2458: Cmd 0x28 (0x413685364040, 32840) to dev "naa.60060160252041002ba1f4577351fc3c" on path "vmhba1:C0:T5:L80" Failed: H:0x1 D:0x0 P:0x0 Possible sense data: 0x5 0x25 0x0. Act:FAILOVER
=============================================================
H:0x2: This status is returned when the HBA driver is unable to issue a command to the device. This status occurs due to dropped FCP frames in the environment.
-----------------------------------------------------------------------------------------------------------------
2016-10-10T10:17:51.136Z cpu15:33575)ScsiDeviceIO: 2331: Cmd(0x412e8315c000) 0x2a, CmdSN 0x800e0036 from world 2262944 to dev "naa.6006016002302f00de17ed6898bde411" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:17:51.136Z cpu15:33575)ScsiDeviceIO: 2331: Cmd(0x412e8ae66100) 0x2a, CmdSN 0x800e0054 from world 2262944 to dev "naa.6006016002302f00de17ed6898bde411" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:17:51.743Z cpu0:33575)ScsiDeviceIO: 2331: Cmd(0x412e88a0b640) 0x8a, CmdSN 0x800e0056 from world 2262944 to dev "naa.6006016002302f00de17ed6898bde411" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
=============================================================
H:0x3: This status is returned when the command in-flight to the array times out.
-----------------------------------------------------------------------------------------------------------------
2016-10-10T08:13:32.998Z cpu21:33002)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:656: Path "vmhba1:C0:T4:L212" (UP) command 0xa3 failed with status Timeout. H:0x3 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T09:03:11.383Z cpu20:33000)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:656: Path "vmhba1:C0:T5:L80" (UP) command 0xa3 failed with status Timeout. H:0x3 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T09:45:52.051Z cpu0:33001)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:656: Path "vmhba1:C0:T5:L20" (UP) command 0xa3 failed with status Timeout. H:0x3 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
=============================================================
H:0x5: This status is returned if the driver aborts commands in-flight to the target. This occurs due to a command timeout or parity error in the frame.
------------------------------------------------------------------------------------------------------------------
2016-10-10T01:10:44.805Z cpu18:32823)ScsiDeviceIO: 2369: Cmd(0x41368544c3c0) 0xfe, CmdSN 0x320b4 from world 32797 to dev "naa.60060160252041004864f657ca48a0e5" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T01:10:44.807Z cpu18:32823)ScsiDeviceIO: 2369: Cmd(0x41368c890900) 0xfe, CmdSN 0x44fe4 from world 32797 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x0 0x0.
2016-10-10T01:10:44.807Z cpu18:32823)ScsiDeviceIO: 2369: Cmd(0x412e88a0b280) 0xfe, CmdSN 0x484ae from world 32797 to dev "naa.60060160252041003a25ee57beb061a2" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
=============================================================
H:0x7: This status is returned when a device is reset due to a Storage Initiator Error. This typically occurs due to an outdated HBA firmware or possibly (though rarely) as the result of a bad HBA.
------------------------------------------------------------------------------------------------------------------
2016-10-10T10:12:31.471Z cpu22:33575)ScsiDeviceIO: 2369: Cmd(0x412e82926d40) 0x8a, CmdSN 0x80000055 from world 2084335 to dev "naa.6c81f66000cbf667000002865436a015" failed H:0x7 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:17:32.475Z cpu14:33575)NMP: nmp_ThrottleLogForDevice:2458: Cmd 0x8a (0x412e800334c0, 2084335) to dev "naa.6c81f66000cbf667000002865436a015" on path "vmhba1:C0:T0:L3" Failed: H:0x7 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2016-10-10T10:17:32.475Z cpu14:33575)ScsiDeviceIO: 2369: Cmd(0x412e800334c0) 0x8a, CmdSN 0x8000004e from world 2084335 to dev "naa.6c81f66000cbf667000002865436a015" failed H:0x7 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
===============================================================
H:0x8: This status is returned when the HBA driver aborts I/O. It also occurs if the HBA resets the target.
----------------------------------------------------------------------------------------------------------------------
2016-10-10T10:18:02.052Z cpu18:33575)ScsiDeviceIO: 2369: Cmd(0x4136864a87c0) 0xfe, CmdSN 0x4ae1c from world 32797 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x8 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2016-10-10T10:18:04.126Z cpu14:33575)ScsiDeviceIO: 2313: Cmd(0x413689303d80) 0x28, CmdSN 0x4ae1b from world 34044 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x8 D:0x0 P:0x0
2016-10-10T10:18:04.126Z cpu14:33575)ScsiDeviceIO: 2313: Cmd(0x412e809d33c0) 0x28, CmdSN 0x4ae1d from world 2448210 to dev "naa.60060160252041002ba1f4577351fc3c" failed H:0x8 D:0x0 P:0x0
===============================================================
State in Doubt error -These messages appear as the Host Bus Adapter (HBA) driver aborts a command because the command took longer than the timeout period of 5 seconds to complete.Refer to the following vmware kb - https://kb.vmware.com/kb/1022026
---------------------------------------------------------------------------------------------------------------------
2016-10-10T10:54:06.947Z cpu0:33569)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.60060160252041001b77f7577dc86804" state in doubt; requested fast path state update...
2016-10-10T10:56:25.641Z cpu23:33569)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6006016025204100d8f1f55717242522" state in doubt; requested fast path state update...
2016-10-10T10:56:30.602Z cpu12:33569)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6006016025204100a85bf657846d3209" state in doubt; requested fast path state update...
Resolution
Change of SAN Switch port resolved the issue.
Affected Products
Dell EMC Unity 500Products
Dell Unity 300, Dell EMC Unity 400, Dell EMC Unity 500, Dell EMC Unity 600Article Properties
Article Number: 000054771
Article Type: Solution
Last Modified: 12 Dec 2025
Version: 3
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.