Skip to main content
  • Place orders quickly and easily
  • View orders and track your shipping status
  • Enjoy members-only rewards and discounts
  • Create and access a list of your products
  • Manage your Dell EMC sites, products, and product-level contacts using Company Administration.
Some article numbers may have changed. If this isn't what you're looking for, try searching all articles. Search articles

Dell VxRail: How to run the VxVerify tool

Summary: This article will introduce VxRail VxVerify tool and how to successfully run VxVerify in VxRail environment.

This article may have been automatically translated. If you have any feedback regarding its quality, please let us know using the form at the bottom of this page.

Article Content


Instructions

Introduction to VxRail VxVerify:

  • VxVerify is designed to proactively detect issues which could cause complications or failures during VxRail upgrades. VMware Cloud Foundation (VCF) on VxRail customers can refer to KB article Dell VxRail: How to run the VCF Verify tool for information on how to run the VCFVerify tool.  
  • The VxVerify tool unpacks a Python program called the 'minion', which is sent to run on each ESXi node. This 'minion' reviews a list of host checks, such as checking iDRAC information and reviewing the vSAN health-check for each node.
  • Given the frequent updates to VxVerify tool itself, the lifecycle of the 'minion' is designed to last 21 days. Always download the latest version (see additional information section for links to download) before running VxVerify.


Install VxVerify:

  • To install VxVerify, download the latest vxverify_x-x-xxx.zip file (see additional information section below for links to download) and copy it to VxRail Manager via scp. SSH on VxRail Manager, extract the vxverify_x-x-xxx.zip file and execute VxVerify. 
    • The VxVerify pyc filename will include the file version, whereas the examples below are simplified to just vxverify.pyc. 
    • If the pyc is renamed, VxVerify can still be run from Python, as listed below, but the menu script method of starting VxVerify (vxverify.sh) would not work.

  • VxVerify runs by default from the following folder, which would be the best place to copy the file to (create it if necessary): 
/tmp/vxv
  • VxVerify and VxRail use the same IP ports. VxVerify results are generated via SSH to the nodes and API from VxRM. Other ports are used to check specific services, such as port 9090 to the nodes.

Run VxVerify (using vxverify.sh):

  • The mystic user does not have sufficient permissions to VxVerify, so either the 'sudo' must be used or use 'su' to log in as root.
  • It is recommended to use the menu system (vxverify.sh), which will prompt the user for what type of health check is desired based on the inputs provided.  
sudo ./vxverify.sh
For example:
Shell menu for running VxVerify on VxRail Manager
Shell menu for running VxVerify on VxRail Manager

VxVerify Best Practice: 

  • Vxverify.sh will prompt the user to provide the vCenter root and administrator SSO users & passwords to execute the tests.
    • If using a VxRail-managed vCenter VxRail Engineering recommends providing these credentials to allow all tests execute fully.
    • If using a customer-managed vCenter these tests may report setting or conditions on the vCenter that do not apply to the VxRail
  • Providing VxVerify.sh root credentials, allows additional VxRM tests to run (such as the tests in the following KB article [only available to registered customers]: VxRail: VxRM health-check fails for test 'thump' (Certificate Thumbprint), but logging in as a standard user, such as 'mystic', is sufficient for all the host tests and most of the VxRM tests.


Troubleshooting and Log Collection:

Refer to the following KB article [only available to registered customers]Dell VxRail: VxVerify Troubleshooting Guide.  
Permissions issues exist accessing some Python packages in some VxRail 4.7 releases and on VxRail 7.0.010 and later. VxVerify can be run as the root user to address the permission issues. 
  • If the vCenter root user is not included, the VCSA tests do not run (sample warning below) but ESXi and VxRM tests do run with or without the root user.
  • A warning such as what is shown below may display if the VCSA root credentials are not supplied:
| vCenter_root           | Warning  21527 | warning: VCSA tests not run: no root password supplied                           .|
  • A warning such as what is shown below may display if the SSO administrator credentials are not supplied:
| vCenter_admin          | Warning  21527 | warning: VCSA admin tests not run: no SSO credentials supplied                   .|
  • To run and create logs, VxVerify MUST have write permissions to the /tmp/vxv folder even if the current user is root. If permission is not set properly, other users might fail to run VxVerify afterwards. The best practice is to set permissions to be as unrestricted as possible.
  • By default, VxVerify restarts VxRail Platform Services (/etc/init.d/vxrail-peservice) when it executes, to clear any stale Platform Services information. Refer to KB article VxRail: Node health-check fails for test 'ps_restart' for more information. 

 

Review the following video " Dell VxRail: How to run the VxRail Verify Tool":



Watch on https://www.youtube.com/watch?v=8o1OClt8U-8
 

Additional Info can be viewed by the article’s designated audience.

Run VxVerify (using Python):

If following a procedure that involves running VxVerify pyc directly, without the Shell script (refer to article section: Run VxVerify (using vxverify.sh)), VxVerify can be run directly from Python. 
When running VxVerify from Python, the SSO and root credentials must be added manually as arguments, in addition to the target code level:

python ./vxverify.pyc -r root -u administrator@vsphere.local -g 7.0.401
  • 'sudo' may need to be added in front of the command above, if not running it from root (the same applies to vxverify.sh).
  • The Python pyc file is compiled for a specific Python release family, such as Python 3.6 (vxverify3).  Running the wrong VxVerify pyc file for the VxRail release will result in Python responding with 'magic number' errors.
  • The example above will prompt for the passwords that match the specified users.
  • If the root user is not included, the VCSA-root tests do not run, but ESXi and VxRM tests do run with or without the root user.
  • If the SSO user is not included, the VCSA-admin tests do not run and some VxRM tests would have reduced functionality.
  • Without the additional credentials listed above, VxVerify will still run, but will not include tests that require those credentials and so some issues will not be tested for, which could potentially cause an upgrade to fail.

Alternative Python Versions

Some VxRail releases contain more than one version of Python, which means that it may be possible to run more than one version of VxVerify on that release.  However, VxVerify requires a number of additional Python libraries to be present in the various 'site-packages' folders, which may not be present for some Python levels. 
The default Python level (which runs from just the command 'python'), may not have the necessary packages and so the correct Python level may need to be specified in the Python command. E.g.

python3.11 ./vxverify4.pyc -r root -u administrator@vsphere.local -g 8.0.210
  • 'sudo' may need to be added in front of the command above, if not running it from root (the same applies to vxverify.sh).


VxVerify Release Train:

Use the VxVerify version applicable to the VxRail version that is being upgraded from, regardless of the destination VxRail version.
  • VxVerify 2.xx.xxx is for VxRail 4.5, 4.7 & 7.0.000 (which uses Python 2.7)
  • VxVerify 3.xx.xxx is for VxRail 7.0.010+ (which use Python 3.6)
  • VxVerify 4.xx.xxx is for VxRail 8.0.210+ (which use Python 3.11)

The VxVerify zip bundles numbered x.40 and above, contain packages for all supported VxRail releases (as shown above).  Running VxVerify using vxverify.sh will automatically select the correct pyc file, to match the Python level running on VxRM.


Download latest VxVerify:

Dell Technologies Services - Central (https://central.dell.com/solutions/VxVerify)

Refer to the "Associated Files" section to download the Readme file for a full list of changes.
Readme file

Related Resources
Here are some recommended resources related to this topic that might be of interest:

Additional Information

 

     

      Article Properties


      Affected Product

      VxRail, VxRail Appliance Series

      Product

      VxRail Appliance Family, VxRail Software

      Last Published Date

      09 Feb 2024

      Version

      37

      Article Type

      How To