PowerScale OneFS: How to place the cluster into Maintenance Mode
Summary: How to place the PowerScale OneFS cluster into Maintenance Mode to avoid receiving alerts or triggering Dial-Home service requests (SR) during a maintenance activity.
Instructions
PowerScale OneFS provides a Maintenance Mode feature that suppresses the Clusterwide Event Log (CELOG) alerts and Dial-Home service requests (SR) while tests or planned maintenance activities are being performed on the cluster.
The steps to enable and disable Maintenance Mode differ depending on the OneFS version. Select the section that applies to your environment:
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
OneFS 9.9 and Later
Beginning with OneFS 9.9, a redesigned Maintenance Mode is available that includes an Auto Maintenance Mode feature. When Auto Maintenance Mode is enabled, the cluster automatically detects maintenance tasks (such as drive replacements, firmware upgrades, and reboots) and enters Maintenance Mode without manual intervention.
CLI -
Step 1 — Verify Auto Maintenance Mode Status
Check whether Auto Maintenance Mode is already enabled:
#isi cluster maintenance status
Example output:
Auto Maintenance Mode Enabled: Yes
Maintenance Mode Active: No
Manual Maintenance Window Enabled: No
Manual Maintenance Window Duration: 8 Hours
Manual Maintenance Window Start Time: -
Manual Maintenance Window End Time: -
- If Auto Maintenance Mode Enabled is Yes, the cluster automatically handles maintenance detection. No further action is required, proceed with your maintenance tasks.
- If Auto Maintenance Mode Enabled is No, proceed to Step 2 to manually enable Maintenance Mode.
Step 2 — Manually Enable Maintenance Mode (Only if Auto Maintenance Mode is Disabled)
#isi cluster maintenance settings modify --active=true
Confirm Maintenance Mode is active:
#isi cluster maintenance settings view
Example output:
Auto Maintenance Mode Enabled: No
Maintenance Mode Active: Yes
Manual Maintenance Window Enabled: Yes
Manual Maintenance Window Duration: 8 Hours
Step 3 — Perform Maintenance Tasks
Perform your maintenance tasks (upgrades, drive replacements, reboots, and so on).
Step 4 — Disable Manual Maintenance Mode When Complete
Once the maintenance activity is complete, disable the manual Maintenance Mode:
#isi cluster maintenance settings modify --active=false
Confirm Maintenance Mode is disabled:
#isi cluster maintenance status
Web UI (OneFS 9.9 and Later)
- Click Cluster Management > Events and Alerts > Maintenance Mode tab.
- Verify the current status:
- If Auto Maintenance Mode is enabled, no action is needed — the cluster automatically manages maintenance detection. Proceed with your maintenance tasks.
- If Auto Maintenance Mode is not enabled, click the toggle button to enable Manual Maintenance Mode before the maintenance activity begins.
- Perform your maintenance tasks.
- If you manually enabled Maintenance Mode, return to Cluster Management > Events and Alerts > Maintenance Mode tab and click the toggle button to disable Maintenance Mode when the maintenance activity is complete.
CLI
1. Enable CELOG Maintenance Mode before work begins:
#isi event maintenance modify --enable=true
2. Confirm Maintenance Mode is active:
#isi event maintenance view
3. Perform your maintenance tasks (upgrades, drive replacements, reboots, and so on).
4. Before disabling Maintenance Mode, resolve any events that occurred during the maintenance window:
#isi event groups list#isi event groups modify --id=<eventgroup_ID> --resolved=true --ignore=true
5. Disable Maintenance Mode when done:
#isi event maintenance modify --enable=false
6. Confirm Maintenance Mode is disabled:
#isi event maintenance view
Web UI (OneFS 9.2 through 9.8)
View Maintenance Mode status:
- Click Cluster Management > Events and Alerts > Alert Management.
Enable Maintenance Mode:
- Click Cluster Management > Events and Alerts > Alert Management.
- Click Enable CELOG maintenance mode.
- A confirmation message appears:
Are you sure you want to enable CELOG maintenance mode? - Click Enable CELOG maintenance mode.
The CELOG maintenance mode is enabled and the maintenance window duration to date appears.
Disable Maintenance Mode:
- Click Cluster Management > Events and Alerts > Alert Management.
- Click Disable CELOG maintenance mode.
The Disable CELOG maintenance mode dialog box appears displaying:- CELOG maintenance window start date and time
- Duration to date of the maintenance window
- Details of events that occurred during the maintenance mode
- Review the events listed. Resolve or ignore any events as needed before proceeding.
- Click Disable CELOG maintenance mode.
The CELOG maintenance mode is disabled.
Additional Information
Additional Info
- Placing the cluster in Maintenance Mode does not affect client activity or performance. The maintenance or test activity itself may affect client activity or performance, depending on the type of activity.
- For OneFS 9.9 and later:
- Auto Maintenance Mode is enabled by default. The cluster automatically detects common maintenance tasks and suppresses alerts accordingly. Manual intervention is only required if Auto Maintenance Mode has been disabled.
- The default manual maintenance window duration is 8 hours. If the maintenance activity completes before the window expires, disable Maintenance Mode manually as described above.
- For further details and options, see the relevant OneFS CLI Reference Guide or Administration Guide for your version:
- PowerScale OneFS 9.9 and later
- PowerScale OneFS 9.2 through 9.8
To work around this issue:
- Manually ignore and resolve the event groups that occurred during the maintenance activity before the maintenance window ends. For example:
#
isi event groups modify --id=<eventgroup_ID> --resolved=true --ignore=true
- If you have manually ended the maintenance window or it has expired and you are being spammed with old alerts, disable the alert channels. CELOG then works through processing the events but alerts are not sent. This may take several minutes to a few hours depending on how long maintenance mode was enabled.
#isi event channels modify <channel_name> --enabled=no
To find the event channel name, use:
Disabling the alert channel can also be done in the Web UI. The Enabled checkbox is at the top of the Edit Alert Channel display. See the OneFS Administration Guide for more information.# isi event channels list