ViPR Controller: What information should a customer provide for ViPR Controller issues?
Summary: This article details the information that a customer should provide for ViPR Controller issues
Instructions
For ViPR Controller issues, we need the information detailed below for further investigation. Attach the information below to the SR.
-
What is the ViPR Controller version (from System > Dashboard > Version & License, vipr-xxxx)?
-
What is the ViPR Controller Virtual Machines configuration: 2+1 (3 nodes) or 3+2 (5 nodes)?
-
What are the steps / changes made to the environment that preceded the issue? If an error is displayed, attach a screenshot of the error or the failed order (including the failed order number and expanded Logs & Execution Steps sections) if the error occurred in an order.
-
Is ViPR Controller installed in a lab environment or in a production environment?
-
Is a VPLEX discovered in this ViPR Controller instance? If so, what is the VPLEX version?
-
Is the System > Dashboard - System Health Controller Status stable and is the System > Health Status green for all ViPR nodes? Attach screenshots showing that information for each of the 3 or 5 ViPR nodes.
Collect ViPR Controller system logs including the orders as detailed below.
-
Select System > Logs > Download.
-
Set Node: to All Nodes.
-
Set Services: to All.
-
Set Log Level: to DEBUG.
Note: Although Log Level is set to DEBUG, logs will actually be collected at INFO level unless the ViPR Controller configuration is also modified to enable DEBUG logging per KB30464 (000008413). The modification to enable debug logging should not be used for initial ViPR Controller log collection and should only be used when specifically requested by ViPR Controller Technical Support due to DEBUG Log Level's verbose content. -
Set Start Time: so that the logs/alerts for the time period of interest are captured, usually about a day before the issue occurred.
-
Set End Time: to current.
-
Set Orders: to All Orders
-
Select the Download button.
-
A logs archive (.zip) file called logs-<date>-<time>.zip is downloaded.
-
This logs archive contains all log, system configuration, and order information.
Attach the zip file to the Service Request.
Column Family Information
For ViPR Controller version 3.6.x and higher:
A new diagutils tool to collect ViPR Controller information is built-in to ViPR Controller as of version 3.6.x and higher. The diagutils tool can collect the column family information previously collected by the slither tool, but it does not require a separate download as with slither. Since slither is deprecated and will not be updated, diagutils (which includes the slither functionality) should be used as of version 3.6.x and higher to collect column family information.
The diagutils tool has the capability to send data directly to an FTP server if available without an intermediate transfer using the diagutils -ftp option as shown in the example below:
./diagutils -min_cfs -ftp ftp://ftp.emc.com -u username -p password
If a subdirectory exists on the ftp server, diagutils can be used to copy data to the subdirectory as shown in the example below:
./diagutils -all_cfs -properties -health -zk -ftp ftp://ftp.emc.com/subdirectoryname -u username -p password
A DellEMC ftp site can be provided through a request to ViPR Controller Technical Support. Note: DellEMC ftp temp accounts expire after 7 days to the hour at which time the account and any data are automatically deleted.
Collect the ViPR Controller column family, properties, health, and zookeeper data as detailed below:
1. Log in to one of the ViPR Controller nodes as root using Putty or equivalent
3. Run diagutils using the options:
./diagutils -all_cfs -properties -health -zk
as shown below:
ViPR version: vipr-3.6.1.0.193
Collecting cfs info..
Now generating dbutils listings, this may take some time................................................finish
Capturing RelationIndex output, AltIndex output and system properties...finish
Archiving cfs data..finish
Collecting properties..
Collecting health information..
Collecting memory disk related information on local node........finish
Collecting nodetool related information of each node...finish
Collecting zk info..
Creating the final archive(/data/diagutils-data/diagutils-20170913160944.zip)...success
ViPR diag finished.
vipr1:/opt/storageos/bin #
data collection) may take more than an hour to complete. In such cases the diagutils -min_cfs option (equivalent to slither (m)inimal data collection) may be used as shown below:
ViPR version: vipr-3.6.1.0.193
Collecting cfs info..
Now generating dbutils listings, this may take some time..........................finish
Capturing RelationIndex output, AltIndex output and system properties...finish
Archiving cfs data..finish
Collecting properties..
Collecting health information..
Collecting memory disk related information on local node........finish
Collecting nodetool related information of each node....finish
Creating the final archive(/data/diagutils-data/diagutils-20170914161151.zip)...success
ViPR diag finished.
vipr1:/opt/storageos/bin #
For ViPR Controller version 3.5.x and lower:
Collect a slither 1.4 output as detailed below or a diagutils output (preferred) as detailed above. Diagtutils is compatible with ViPR Controller starting with version 2.4. Diagutils is available for download at
https://support.emc.com/downloads/32034_ViPR-Controller > Product Tool > Diagutils data collection utility for ViPR Controller
or
https://download.emc.com/downloads/DL84052_Diagutils-data-collection-utility-for-ViPR-Controller.zip
-
What are the array types & versions?
-
For the arrays above what are the corresponding SE / SMI-S versions?
-
If any SMI-S errors are displayed please include the SE / SMI-S logs from the relevant SE / SMI-S host(s) as detailed below:
EMCReports output - download available at:
https://support.emc.com/search/?text=*&product_id=17096&resource=ST&source=promotion&facetProductId=26424
OR
symapi logs from: <%INSTALL_DRIVE%>:\<%INSTALL_DIRECTORY%>\emc\SYMAPI\log (complete
SE & SMI-S logs from Linux machine:
EMC Grab output - download available at:
https://support.emc.com/search/?text=*&product_id=17096&resource=ST&source=promotion&facetProductId=17096
OR
symapi logs from: /usr/emc/API/symapi/log (complete folder)
SMI-S Provider logs from: /opt/emc/ECIM/ECOM/log (complete folder)
For switch related issues please include the switch information detailed below:
-
Brocade / CMCNE switches
Brocade CMCNE supportsave outputs from the CMCNE UI > Monitor > Technical Support > SupportSave > check Server SupportSave, check Include Database, hit the Full button, check Client SupportSave > hit the OK button > attach the resulting
DCM-SS*.zip and DCM-Client-SS*.zip files to the SR.
The resulting logs are located at:
DCM-SS*.zip in C:\Program Files\CMCNE 12.1.2\support
DCM-Client-SS*.zip in C:\Users\user\CMCNE\localhost\support
-
Cisco switches
Cisco show tech support outputs
Additional Information
For more information on diagutils see the following article:
501341 - ViPR Controller: How to use the Diagutils to collect ViPR data