PowerStore: System Health Checks Detects Lack of Space in cyc_node

The system health check may display messages similar to:

/cyc_node free space is less than 200 MB. (KB#000198173)

Or:

Unable to parse passed url (0xE04040020008)

The system may display a normal alert like:

Root partition usage of node x has exceeded xx% on mount /cyc_node.

In the following examples, both nodes of an appliance have insufficient space in /cyc_node.

• Running a System Check using PowerStore Manager with the Run Upgrade Extensions option:

Tip: The Profile field displays Upgrade Extensions when the Run Upgrade Extensions option is used to perform a System Check.

• Running a System Check using PowerStore Manager (UI) with the Run System Check option:

Tip: The Profile field displays Service Engagement when the Run System Check option is used to perform a System Check.

• Running the System Health Service Script (svc_health_check) using an SSH connection:

$ svc_health_check run -rhc cyc_node_space_check   
Name                          Location Status     Description
cyc_node space check          node_a   FAILED     /cyc_node free space is less than 200MB. (KB#000198173)
cyc_node space check          node_b   FAILED     /cyc_node free space is less than 200MB. (KB#000198173)

Example of the error:

"Unable to parse passed url"

Common scenarios linked to this alert are as follows and are addressable with the svc_partition_cleanup service script:

• Article # 000202707 PowerStore: Pre-Upgrade Health Check fails due to lack of space in /cyc_cfs
• Article # 000193605 PowerStore: Data Collection Fails, and the PowerStore Manager User Interface Reports Abnormal Information
• Article # 000324110 PowerStore Alerts: Root partition usage of node X has exceeded 91 percent on mount /.
• Article # 000202949 PowerStore: Dell SupportAssist database may fill up and lead /cyc_node/ (an internal partition) to be full, causing either NDU failure or Node reboot
• Article # 000223342 PowerStore: Intermittent alert codes 0x00400601 and 0x00400602 for mount /cyc_node
• Article # 000328471 PowerStore: Root Partition usage increasing rapidly

Most causes leading to partition full conditions have been resolved in PowerStoreOS LTS-v4.1.x. After resolving the current condition, update the PowerStore Appliance to PowerStoreOS LTS-v4.1.x or later.

Workaround

With earlier versions, if both nodes are in normal mode, you may attempt to temporarily disable SupportAssist. Usually, this clears out the SupportAssist files under "/cyc_node.
 

Before attempting to disable SupportAssist, verify that the PowerStore is not exposed to PowerStore: Data Collection Fails, and the PowerStore Manager User Interface Reports Abnormal Information. If you suspect that the PowerStore may be experiencing this issue, resolve this first before proceeding to the next steps.

Steps to disable SupportAssist from the PowerStore Manager user interface (UI)

1. Settings > Support Connectivity > Connection Type > toggle to Disable and click Apply.
   Verify that SupportAssist did disable. Once the job appears to have finished, refresh the UI page and see if it shows disabled or enabled.

   • If it shows enabled after a couple of attempts, then disabling SupportAssist from the UI did not work, go to step 5.
   • If it does show disabled after a refresh of the UI page, continue to step 2.
2. Wait at least 15 minutes.
3. Reenable SupportAssist.

4. Check /cyc_node partition on both nodes over SSH using the command:

df -h

5. If the issue persists, a further self-service action is to install and use the svc_partion_cleanup service script to clean up the root partitions. 

• General Installation Instructions: Article # 000371058 PowerStore: How To Install svc_injectable service scripts (Log in as a registered Dell Support user may be required to view this article.)
• svc_partition_cleanup Procedure: Article # 000214954 PowerStore: How to run the injectable service script svc_partition_cleanup to clean up the partitions /cyc_node, /cyc_var and /cyc_cfs (Log in as a registered Dell Support user may be required to view this article.)

6. Retry the System Health Checks or Pre-Upgrade Health Checks to ensure that the issue is resolved. 
7. If this does not resolve the issue, contact Dell Technical Support or your Authorized Service Representative, and reference this article ID.