Connectrix Cisco MDS-Series: NX-OS Temp File Filling Up Expect to Crash Against The ESRS Plugin Script Issue
Summary: The ESRS plugin scripts fill up the temp directory and space on the switch which might result in an NXOS crash.
Symptoms
The fix has been added to the ESRS plugins.
Problem:
NX-OS temp-file is filling up, and expect to be unresponsive the switch against the ESRS plugin script.
The ESRS plugin scripts fill up the temp directory and space on the switch which might result in an NXOS crash.
Environment:
Cisco software: NX-OS 7.3(1)
Cisco software: NX-OS 8.2(1)
To check how much space is free:
Example:
switch9132T# dir bootflash: 4096 Jan 09 02:27:40 2017 .partner/ 4096 Jan 09 02:30:02 2017 .patch/ 50503 Feb 08 21:55:51 2017 20170208_214916_poap_4513_init.log 204830 Mar 06 12:04:54 2017 20170306_114327_poap_4513_init.log Usage for bootflash://sup-local 1017880576 bytes used 2563514368 bytes free -> Available free space in switch 3581394944 bytes total
To check the size of the temp-file and the free space:
switch9132T# dir log: 31 Dec 27 12:44:59 2017 dmesg 0 Dec 27 12:45:33 2017 libfipf.4440 0 Dec 27 12:45:34 2017 libfipf.4472 0 Dec 27 12:45:34 2017 libfipf.4477 18491 Feb 02 04:42:03 2018 messages 2386 Dec 27 12:45:35 2017 pss_helper_ncftp.log 480 Dec 27 13:00:05 2017 snmp_log 2956175 Feb 02 04:51:29 2018 startupdebug 726 Dec 27 12:45:35 2017 syslogd_ha_debug Usage for log://sup-local 3026944 bytes used 49401856 bytes free 52428800 bytes total
Cause
The old scripts keep on creating a temp which is not deleted and is filling up the memory space.
Resolution
Fix:
-
Remove the existing scripts that are mapped to the alert group using below command:
# conf t conf #callhome callhome# no alert_group <XXX> script-name <script-name.tar> (specify the alert group that you must disable) callhome# commit Below is the list of available alert groups: SVT9132T(config-callhome)# no alert-group All Inventory Supervisor-Hardware Cisco-TAC License Syslog-group-port Crash Linecard-Hardware System Environmental RMON Test
Select all alert groups individually to which the old scripts are mapped.
-
Download the new scripts from the support.emc.com site. They are the scripts which contain the fix for the issue.
-
Do the necessary changes on the new scripts as per the old one. Download the procedure from SolVe on how to configure the esrs plugin scripts.
-
Place the new scripts on the switch.
-
Enable the plugin on the switch. The process is available in the SolVe on how to enable ESRS plugin on the MDS switches.
Additional Information
To be able to check what date on the installed script, one can do the following command to check the dates:
Example:
switch9132T# dir bootflash://sup-active/scripts 108032 Mar 21 03:04:13 2017 ch_script_9132T.tar 108544 Oct 06 11:06:47 2017 ch_script_9132T_822.tar 109568 Jan 15 02:59:05 2018 ch_script_9132T_831_new.tar 109056 Dec 13 01:38:31 2017 ch_script_9132t_8_2_2_updated.tar Usage for bootflash://sup-active 1017880576 bytes used 2563514368 bytes free 3581394944 bytes total