Isilon: Node Firmware updates immediately error on Generation 6 nodes with a missing/failed M2 Vault Card

Summary: Isilon: Node Firmware updates immediately error on Generation 6 nodes with a missing/failed M2 Vault Card

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms



Generation 6 nodes require use of an M.2 Vault Card in each node to perform node firmware updates.  If the M.2 Vault Card is missing or has failed, attempts to perform node firmware updates on those nodes will encounter an error.

In addition to errors in the upgrade view, the log file, /var/log/isi_firmware.log, on the node where the error was encountered will have a line which includes "no such object ada0" similar to the following: 
2020-01-01 04:54:25,169 INFO     [11111] : FW action: Cleaning up fw partition
2020-01-01 04:54:25,170 INFO     [11111] : FW action: toggle_debug: off
2020-01-01 04:54:25,241 INFO     [11111] : FW action: Updating Node 1
2020-01-01 04:54:25,263 INFO     [11111] : Updating device EPssp_infinity
2020-01-01 04:54:25,263 INFO     [22222] : <rpc> EPssp_infinity(EPssp_infinity): version=02.50 target=02.81
2020-01-01 04:54:25,264 INFO     [11111] : Updating Firmware EPssp_infinity - old: 02.50 new : 02.81
2020-01-01 04:54:25,526 ERROR    [11111] : Node 1: 'no such object ada0'
2020-01-01 04:54:25,565 INFO     [11111] : FW action: Cleaning up fw partition
2020-01-01 04:54:25,565 INFO     [11111] : FW action: toggle_debug: off

Cause

missing vault card

Resolution

When encountered, the M.2 Vault Card on the node should be replaced.

Additional Information

The Isilon On-Cluster Analysis health check script includes a check to identify when the M.2 Vault Card is missing or has exceeded it's SMART status threshold and may report results similar to the following: 
Vault Card                                        FAIL
  FAIL: The vault card located at ada0 in the following Generation 6 nodes are not reporting in the output of camcontrol devlist: 1
  FAIL: The vault card located at ada0 in the following Generation 6 nodes are reporting SMART status is threshold exceeded: 1

To run only the check for the Vault Card, use the following additional argument when running the Isilon On-Cluster Analysis tool: --run=checkVaultCard

Affected Products

Isilon Gen6

Products

Isilon Gen6
Article Properties
Article Number: 000082048
Article Type: Solution
Last Modified: 03 Mar 2025
Version:  4
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.