iDRAC Platform Firmware Updates or Rollback Failures When Partition is Near Capacity
Сводка: Dell PowerEdge server firmware updates that leverage iDRAC partitions for staging may fail when the iDRAC partition is near capacity.
Симптомы
When the iDRAC or Lifecycle Controller (LC) is used to update server firmware (FW), a copy of the current FW is retained for rollback purposes. The new firmware package is then staged on the iDRAC partition and extracted to perform the update. Since the iDRAC or Lifecycle Controller has limited storage space, it may not have enough available capacity for both the previous and new firmware images. The Lifecycle log may record any of the following warning events: RED032, RED008, RED096.
Firmware Update Lifecycle Log Examples:
2023-10-03 07:45:19 RED032 Reached maximum size limit allowed for storing firmware images. Deleted all rollback firmware images.
Log Sequence Number:
46547
Detailed Description:
The rollback firmware images previously stored were deleted to provide space for storing the firmware images for the requested operation. All the rollback firmware images are deleted.
Recommended Action:
No response action is required.
2023-10-03 08:13:11 RED008 Unable to extract payloads from Update Package.
Log Sequence Number:
46553
Detailed Description:
The firmware payloads in the Update Package cannot be extracted. This may be because the file is not valid or the security signature cannot be verified.
Recommended Action:
Re-acquire the Update Package from the service provider.
2023-10-03 08:12:59 RED096 iDRAC flash storage has reached its upper limits. Rollback will no longer be supported for this component.
Log Sequence Number:
46551
Detailed Description:
The maximum iDRAC storage space allocated for storing firmware image files is reached. The firmware image of the earlier version that was stored for a rollback operation is now deleted.
Recommended Action:
No response action is required.
RED032 is recorded, Rollback action is no longer possible. The rollback version is listed as 'NULL' in the Rollback page of the Lifecycle Controller UIs. The iDRAC UI does not list the impacted component within the iDRAC Rollback page.
Причина
The iDRAC retains two firmware version images for devices that support rollback feature (BIOS, Network Controllers, iDRAC, PERC, Backplanes, and DPU). As firmware image files continue to grow in size, the static partition on the iDRAC controller can run out of capacity to stage multiple image files. When the partition is low on space, this leads to firmware update or rollback operations to fail.
Разрешение
While improvements in later iDRAC9 firmware versions (7.00.30.00) include improvements in managing this iDRAC partition, this behavior is a limitation in the partition size. In order to free up capacity on the partition, manually deleting rollback images may be required. To free up space on the Lifecycle Controller partition, running a system erase of the lcdata deletes all rollback images.
Lifecycle Controller Repurpose or Retire Wizard Example:
System Erase RACADM Example:
racadm>>racadm systemerase lcdata
RAC1061: SystemErase operation initiated successfully.
Check the job status by running the RACADM command "racadm jobqueue view -i JID_963398489564"
System Erase Redfish API Example:
POST …/redfish/v1/Managers/{ManagerId}/Oem/Dell/DellLCService/Actions/DellLCService.SystemErase
Payload = lcdata
iDRAC9 Redfish API | Dell Technologies Developer
lcdata deletes the Lifecycle log from the iDRAC in addition to ALL stored firmware images. Rollback images are only populated on partitions as additional firmware updates are performed.