VNX: Data unavailable during a controlled reboot when running OE for BLOCK Rel 33 P155 (User Correctable)

In Rel 33 P155, during a controlled reboot, an issue may be encountered where a LUN (or LUNs) may not accept I/O for 50+ seconds during the trespass process.

There is a strong probability that this issue will be impactful when upgrading from Rel 33 P155 to any later release of code. Dell EMC strongly recommends installation of  KB488877-01.01.5.001-armada64_free.ndu (available on support.emc.com) prior to attempting an install of any VNX2 OE version when upgrading from Rel 33 P155.

This issue only affects Rel 33 P155 and not any earlier revisions of VNX2 OE. This issue is resolved in Rel 33 P184.

Note: For VNX2 Series Operating Environment upgrade procedures to 05.33.009.5.236 supporting SHA-2 including how to recover from any errors, refer to KB article 529353

This issue is caused by a pool LUN shutdown implementation which incorrectly waits for an event that would never come, all the while holding a lock until the Pool driver shutdown timer is hit. This leads to a 50+ second delay in the shutdown processing and the trespassing of LUNs to the surviving SP.

A rebootless, NDU package can apply a change that prevents this issue from reoccurring.

Once installed, it prevents subsequent controlled reboots or NDUs from hitting the code path.  

The package is designed to take no action once the array is no longer running Rel 33 P155 VNX2 OE and will be obsoleted by a later code release.

Q: What if I do not install the package?
A: Installing the package will eliminate an unneeded delay for I/O failure and is recommended to be installed (especially for hosts that are sensitive to longer than normal I/O delays)

Q: How long does it take to install the package?
A: The package installs in about 5 minutes and is a rebootless package.

Q: Is this patch exclusively for upgrades to higher revisions of code?
A: No this code can be used (and is recommended to be used) as a method to prevent an unneeded delay for I/O Failure when rebooting an SP under normal circumstances on Rel 33 P155. 

Example of installing the package via Unisphere Service Manager (USM):

1. Log in to the array using Unisphere Service Manager (USM).
2. Select Software > System Software > Prepare for Installation (Step 1) and follow the wizard. Browse and select the KB488877-01.01.5.001-armada64_free.ndu file you downloaded earlier and hit Next till you finish all the steps.                  

3. Select Install Software (Step-2) in the USM and click Next and follow the steps in the wizard until the patch KB488877 is loaded on the array.

Example of installing the package via CLI:

naviseccli -h <SPIPAddress> -user <user> -password <password> -scope 0 ndu -install KB488877-01.01.5.001-armada64_free.ndu
Running install rules... (removed for breveity)
The requested package(s) will be installed. Do you wish to proceed? :  (y/n)? y 

*IMPORTANT* if statistics logging is enabled the package will not install (this is exactly the same for every other type of NDU install). Please disable statistics logging prior to installing the package.

Please verify that the package is installed successfully

naviseccli -h <SPIPAddress> -user <user> -password <password> -scope 0 ndu -list

....other enablers will appear here.

Name of the software package:        KB488877
Revision of the software package:    -
Commit Required:                     NO
Revert Possible:                     NO
Active State:                        YES
Is installation completed:           YES
Is this System Software:             NO

Name of the software package:        VNX-Block-Operating-Environment
Revision of the software package:    05.33.009.5.155
Commit Required:                     NO
Revert Possible:                     NO
Active State:                        YES
Is installation completed:           YES
Is this System Software:             NO

If KB488877 is not present in the output of naviseccli -h <SPIPAddress> -user <user> -password <password> -scope 0 ndu -list then the package is not installed.