Linux DSU latest iDRAC upgrade loop for the last month on at least all of my R640, R6515 and R6615 servers

Hi,

Have you tried to reset the iDRAC? When you access into iDRAC, does it say the version is zero?

Reset article: https://dell.to/3y5f0q5.

Hello,

Could you do these steps and supply results?

Run these two racadm command:

racadm get iDRAC.OS-BMC.AdminState

ip a show dev eth0

Then run DSU with --log-level=7

@DELL-Charles R 

Any new information you are able to share? The Dell ticket shows activity from the 9th, but my login does not allow me to see any of the posted information :(

@DELL-Joey C​ 

I should have been more specific when I originally noted, "reboot of the iDRAC" was a "racadm racreset" operation. So yes, that has already been done. I have also done that again now.

@DELL-Charles R​ 

# racadm get iDRAC.OS-BMC.AdminState
[Key=iDRAC.Embedded.1#OS-BMC.1]
AdminState=Disabled

ip a show dev eth0 >>> I do not have an eth0 on this system. The primary interface is eno3

# ip a show dev eno3
2: eno3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 00:0a:f7:b6:6a:aa brd ff:ff:ff:ff:ff:ff
    altname enp1s0f0
    inet 172.50.10.247/24 brd 172.50.10.255 scope global dynamic noprefixroute eno3
       valid_lft 438sec preferred_lft 438sec
    inet6 fe80::20a:f7ff:feb6:6aaa/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever

# dsu --log-level=7 --non-interactive 2>&1 | tee /tmp/dsu-non-interactive.txt
DELL System Update 2.0.2.3
Copyright (C) 2014 -- 2023 DELL Proprietary.
Verifying catalog installation ...
Installing catalog from repository ...
Fetching dsucatalog ...
Reading the catalog ...
Verifying inventory collector installation
Getting System Inventory ...
Determining Applicable Updates ...
Fetching iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00 ...
Installing iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00
Installed successfully
Done! Please run 'dsu --inventory' to check the inventory
Progress report is available at:/usr/libexec/dell_dup/DSU_STATUS.json
Exiting DSU!

I expected more screen output from dsu...

The noted DSU_STATUS.json file contained:

{"SystemUpdateStatus":[{"System":{"id":"0716","idType":"BIOS","hostAddress":"LocalHost"},"InvokerInfo":{"name":"DSU","version":"2.0.2.3","command":"--log-level , --non-interactive","exitStatus":0,"statusMessage":"Command has run successfully"},"UpdateableComponent":[{"name":"iDRAC","componentType":"FRMW","componentTypeDisplay":"FIRMWARE","componentID":25227,"version":"0.00.00.00","baseLineVersion":"7.00.00.171","updateStatus":"SUCCESS","rebootRequired":false}]}]}

And yes, the "zero" version is shown in that json file.

The /var/log/dell/updatepackage/log/support/iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00.log file contained:

=================> Update Package application started <=============

Command:        /root/iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00.BIN -f -q

Date:           Sun May 12 10:09:32 AM CDT 2024

=========================================================================

Release ID: TNYR2A00

Update Package version: 22.01.003 (BLD_231)

Collecting inventory...
<?xml version="1.0"?>
<SVMInventory lang="en">
  <Device componentID="25227" display="iDRAC">
    <Application componentType="FRMW" version="7.00.00.171" display="iDRAC"/>
  </Device>
  <System systemID="716"/>
  <OperatingSystem osVendor="linux" osArch="x64" majorVersion="9.0" minorVersion="3" spMajorVersion="0" spMinorVersion="0"/>
  <Device componentID="159" display="BIOS" impactsTPMmeasurements="TRUE">
    <Display>BIOS</Display>
    <Application componentType="BIOS" version="2.21.2" display="BIOS"/>
  </Device>
</SVMInventory>
Creating payload file list for UpdRollBack by framework, if needed later.
Creating payload file list for UpdRollBack by framework, if needed later.
MovePayload: Exiting.
Running validation...

iDRAC
Application: iDRAC
Previous version: 7.00.00.171
New version: 7.00.00.171

The version of this Update Package is the same as the currently installed version.
Software application name: iDRAC
Package version: 7.00.00.171
Installed version: 7.00.00.171


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER PRODUCTS WHILE UPDATE IS IN
PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
Atleast one device updated: Check return 0
Rollback is supported using rollback tag: Check return 4
Device: iDRAC
  Application: iDRAC
  Update Successful.

============================> Update Result <============================

Update complete
Application: iDRAC
Previous version: 7.00.00.171
New version: 7.00.00.171
=========================================================================
Exit code = 0 (Success)
Sun May 12 10:15:42 AM CDT 2024

This log does *not* have the "zero" firmware version noted.

Hi,

I'm unsure if Charles has some idea about your issue, we'll probably wait for his reply or finding about your issue. 

Hello,
Thank you for that information. My engineer is working on it. I can follow up when I have more information.

Hello,

Could you try one of the earlier version DSU and see it it will detect the iDRAC firmware correctly?

2.0.2.0, A0017 Mar 2023

2.0.1.0, A0026 Sep 2022

Hello, Did you get a chance to try one of the earlier versions and results?

# dsu --version
DELL System Update 2.0.2.0
Copyright (C) 2014 -- 2023 DELL Proprietary.
[root@tshh247 ~]# dsu --log-level=7 --preview --non-interactive 2>&1 | tee /tmp/dsu-preview.txtDELL System Update 2.0.2.0
Copyright (C) 2014 -- 2023 DELL Proprietary.
Verifying catalog installation ...
Catalog not present
Installing catalog from repository ...
Fetching dsucatalog ...
Reading the catalog ...
Fetching invcol_LN64_44RXW_24_03_00_92_A00 ...
Verifying inventory collector installation
Getting System Inventory ...
Determining Applicable Updates ...
------------------ Update Preview -----------------
# : Type : Component : Version : Filename
---------------------------------------------------
1 : Firmware : iDRAC : 7.00.00.171 : iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00
NOTE: The preview option displays the components which can be updated based on Catalog. This option does not update.
Run --inventory for checking the component status post DSU commit to check what has been installed.
Progress report is available at:/usr/libexec/dell_dup/DSU_STATUS.json
Exiting DSU!

# cat /usr/libexec/dell_dup/DSU_STATUS.json
{"SystemUpdateStatus":[{"System":{"id":"0716","idType":"BIOS","hostAddress":"LocalHost"},"InvokerInfo":{"name":"DSU","version":"2.0.2.0","command":"--log-level , --preview , --non-interactive","exitStatus":0,"statusMessage":"Command has run successfully"}}]}​​

Thank you for the update and the results.
I know the engineer is working to get this fixed. I don’t know if it will be the current version or the next release.

I can update you when I have more information.

# rpm -qf $(which dsu)
dell-system-update-2.0.2.3-23.11.00.x86_64​

Also, the 2.0.1.0 does the same thing at this time:

# dsu --log-level=7 --preview --non-interactive |& tee /tmp/dsu-preview-dsu-2.0.1.0.txt
DELL System Update 2.0.1.0
Copyright (C) 2014 -- 2022 DELL Proprietary.
Verifying catalog installation ...
Catalog not present
Installing catalog from repository ...
Fetching dsucatalog ...
Reading the catalog ...
Fetching invcol_LN64_44RXW_24_03_00_92_A00 ...
Verifying inventory collector installation
Getting System Inventory ...
Determining Applicable Updates ...
------------------ Update Preview -----------------
# : Type : Component : Version : Filename
---------------------------------------------------
1 : Firmware : iDRAC : 7.00.00.171 : iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00
NOTE: The preview option displays the components which can be updated based on Catalog. This option does not update.
Run --inventory for checking the component status post DSU commit to check what has been installed.
Progress report is available at:/usr/libexec/dell_dup/DSU_STATUS.json
Exiting DSU!

Hello, please retry the current DSU version.

They rolled back the Dell changes that caused the problem.

# dsu --log-level=7 --preview --non-interactive |& tee /tmp/dsu-preview-dsu-2.0.2.3.txt
DELL System Update 2.0.2.3
Copyright (C) 2014 -- 2023 DELL Proprietary.
Verifying catalog installation ...
Catalog not present
Installing catalog from repository ...
Fetching dsucatalog ...
Reading the catalog ...
Fetching invcol_LN64_44RXW_24_03_00_92_A00 ...
Verifying inventory collector installation
Getting System Inventory ...
Determining Applicable Updates ...
------------------ Update Preview -----------------
# : Type : Component : Version : Filename
---------------------------------------------------
1 : Firmware : iDRAC : 7.00.00.171 : iDRAC-with-Lifecycle-Controller_Firmware_TNYR2_LN64_7.00.00.171_A00
NOTE: The preview option displays the components which can be updated based on Catalog. This option does not update.
Run --inventory for checking the component status post DSU commit to check what has been installed.
Progress report is available at:/usr/libexec/dell_dup/DSU_STATUS.json
Exiting DSU!​

The invcol_LN64_44RXW_24_03_00_92_A00 is the same as before.