VxRail: La actualización falló con el error "La programación del firmware mediante el servicio de plataforma de VxRail falló con tiempo de espera agotado"

La actualización falla durante el proceso de preparación del firmware con el siguiente error: La programación del firmware mediante el servicio de plataforma de VxRail falló con tiempo de espera

agotado Lcm-web.log:

2022-03-15 14:57:04,936 ERROR [LCM] [lcm-node-0] c.v.l.c.b.BatchUpgrade [BatchUpgrade.java:1223] Attempt 2/3 of vSAN access exception. but failed with error:
com.vce.lcm.exception.LCMInternalException: Schedule firmware using VxRail Platform Service failed with timeout.
 at com.vce.lcm.core.upgrade.esxi.EsxiFirmwareUpgrader.checkStatus(EsxiFirmwareUpgrader.java:315)
        at com.vce.lcm.core.upgrade.esxi.EsxiFirmwareUpgrader.scheduleBatchUpgradeStaging(EsxiFirmwareUpgrader.java:358)
        at com.vce.lcm.core.batch.BatchUpgrade.scheduleFirmwareStaging(BatchUpgrade.java:1809)
        .............................
        .............................
2022-03-15 14:57:05,152 ERROR [LCM] [lcm-node-0] c.e.m.m.u.s.LcmNodeUpgradeServiceImpl [LcmNodeUpgradeServiceImpl.java:83] failed to upgrade node with exception:
com.vce.lcm.exception.LCMException: Schedule firmware using VxRail Platform Service failed with timeout.
at com.vce.lcm.core.batch.BatchUpgrade.upgradeHost(BatchUpgrade.java:1573)
        at com.vce.lcm.core.batch.BatchUpgrade.performBatchUpgrade(BatchUpgrade.java:1023)
        at com.vce.lcm.core.batch.BatchUpgrade.performBatchUpgrade(BatchUpgrade.java:1205)
        .............................
        .............................​​​​​​​
Caused by: com.vce.lcm.exception.LCMInternalException: Schedule firmware using VxRail Platform Service failed with timeout.
        at com.vce.lcm.core.upgrade.esxi.EsxiFirmwareUpgrader.checkStatus(EsxiFirmwareUpgrader.java:315)
        at com.vce.lcm.core.upgrade.esxi.EsxiFirmwareUpgrader.scheduleBatchUpgradeStaging(EsxiFirmwareUpgrader.java:358)
        .............................
​​​​​​​         .............................
2022-03-15 14:57:57,331 ERROR [LCM] [lcm-core-0] c.v.l.c.u.ComponentUpgradeService [ComponentUpgradeService.java:310] Component VMWARE_ESXI upgrade failed due to Schedule firmware using VxRail Platform Service failed with timeout..
2022-03-15 14:57:57,399 ERROR [LCM] [lcm-core-0] c.v.l.a.LCMServiceImpl [LCMServiceImpl.java:1653] failed to upgrade: VXRAIL_COMPOSITE-7.0.320-27377804_for_4.7.x.zip, with exception:
com.vce.lcm.exception.LCMException: Schedule firmware using VxRail Platform Service failed with timeout.
        at com.vce.lcm.core.upgrade.ComponentUpgradeService.performComponentUpgrade(ComponentUpgradeService.java:329)
        at com.vce.lcm.api.LCMServiceImpl.performBatchUpgrade(LCMServiceImpl.java:1933)
        at com.vce.lcm.api.LCMServiceImpl.performCompositeUpgrade(LCMServiceImpl.java:1285)
        .............................
       ​​​​​​​ .............................
2022-03-15 14:57:57,622 INFO [LCM] [lcm-core-0] c.e.m.m.u.r.BaseVirtualApplianceUpgradeProfilePool [BaseVirtualApplianceUpgradeProfilePool.java:798] add error message status, profile: VXRAIL_COMPOSITE-7.0.320-27377804_for_4.7.x.zip, step: Upgrading, target: VXRAIL_COMPOSITE-7.0.320-27377804_for_4.7.x.zip, action: Failure occurred while running an upgrade for bundle: VXRAIL_COMPOSITE-7.0.320-27377804_for_4.7.x.zip., detail messages: Failure occurred while running an upgrade for bundle: VXRAIL_COMPOSITE-7.0.320-27377804_for_4.7.x.zip. The error message: Schedule firmware using VxRail Platform Service failed with timeout..

• Al revisar la interfaz de usuario web de iDRAC, no había trabajos programados de firmware durante el proceso de almacenamiento provisional.
• Se revisaron los platform_svc.log y se encontraron los siguientes errores:

2022-03-15T12:09:51Z platform_svc: [Thread-7] INFO - Updating in progress: 69
2022-03-15T12:10:14Z platform_svc: [Thread-2] INFO - Inventory update process is quiesced
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO - start to check the upgrade progress ...
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO - PTAgent response 200:
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO -     {
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO -         "inProgress": "true",
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO -         "progressPercentage": "69"
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO -     }
2022-03-15T12:10:51Z platform_svc: [Thread-7] INFO - Updating in progress: 69
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO - start to check the upgrade progress ...
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO - PTAgent response 200:
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO -     {
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO -         "inProgress": "true",
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO -         "progressPercentage": "69"
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO -     }
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO - Updating in progress: 69
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO - Upgrade timeout. PTAGENT seems alive. We have to restart it.
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO - no software vib change in progress, do not wait
2022-03-15T12:11:51Z platform_svc: [Thread-7] INFO - Call ptagent start/restart command/etc/init.d/DellPTAgent restart
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR - Error occurs during upgrading via PTAgent. Retrying ...
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR -   Traceback (most recent call last):
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR -     File "/opt/vxrail/bin/platforms/dell/plugin/__init__.py", line 1097, in do_pt_payload_fw_upgrade
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR -       idrac_fw_packages)
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR -     File "/opt/vxrail/bin/platforms/dell/plugin/__init__.py", line 1034, in _onetime_pt_payload_fw_upgrade
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR -       raise Error('PTAgent firmware upgrade timeout')
2022-03-15T12:13:08Z platform_svc: [Thread-7] ERROR -   endpoints.error.Error: PTAgent firmware upgrade timeout

Estos errores en platform_svc.log se encontraron reintentándolo en bucle hasta que la actualización falló en la GUI de vCenter.

Cuando se actualiza manualmente el firmware a través de la interfaz de usuario web de iDRAC, podemos ver uno de los siguientes errores:

Mensaje: An internal error occurred. No se puede completar la operación especificada.
Acción de respuesta recomendada: Vuelva a intentar la operación. Si el problema persiste, restablezca iDRAC y vuelva a intentar la operación.

Mensaje: El trabajo solicitado no se puede programar porque Lifecycle Controller no está activado.
Acción de respuesta recomendada: Habilite Lifecycle Controller y vuelva a intentar la operación. Lifecycle Controller se puede activar con F2 System Setup presionando F2 durante el inicio del servidor, luego seleccione iDRAC Settings > Lifecycle Controlller y habilite la función Lifecycle Controller. Vuelva a intentar la operación después de reiniciar el servidor.

LifeCycle Controller se encontró en estado Deshabilitado. Con LCC deshabilitada, iDRAC no puede cargar ni programar el firmware en la cola de trabajos.

Ejecute el comando racadm get LifeCycleController.LCAttributes para verificar lo siguiente:

racadm>>racadm get LifeCycleController.LCAttributes
#AutoDiscovery=Off
AutoUpdate=Disabled
BIOSRTDRequested=False
CollectSystemInventoryOnRestart=Enabled
#DiscoveryFactoryDefaults=Off
IgnoreCertWarning=On
IPAddress=
IPChangeNotifyPS=Off
#Licensed=No
LifecycleControllerState=Disabled
PartConfigurationUpdate=Apply Always
PartFirmwareUpdate=Match firmware of replaced part
ProvisioningServer=
#StorageHealthRollupStatus=2
#SystemID=0716
!!UserProxyPassword=******** (Write-Only)
UserProxyPort=80
UserProxyServer=
UserProxyType=HTTP
UserProxyUserName=

Para resolver este problema: 

1. Conéctese a la iDRAC del nodo que falla durante el proceso de preparación del firmware a través de SSH.
2. Habilite LCC con el comando racadm set LifeCycleController.LCAttributes.LifecycleControllerState 1

racadm>>racadm set LifeCycleController.LCAttributes.LifecycleControllerState 1
Object value modified successfully

3. Vuelva a validar el estado de LCC con el comando racadm get LifeCycleController.LCAttributes

racadm>>racadm get LifeCycleController.LCAttributes
#AutoDiscovery=Off
AutoUpdate=Disabled
BIOSRTDRequested=False
CollectSystemInventoryOnRestart=Enabled
#DiscoveryFactoryDefaults=Off
IgnoreCertWarning=On
IPAddress=
IPChangeNotifyPS=Off
#Licensed=No
LifecycleControllerState=Enabled <---- (correct value)
PartConfigurationUpdate=Apply Always 
PartFirmwareUpdate=Match firmware of replaced part
ProvisioningServer=
#StorageHealthRollupStatus=2
#SystemID=0716
!!UserProxyPassword=******** (Write-Only)
UserProxyPort=80
UserProxyServer=
UserProxyType=HTTP
UserProxyUserName=

4. Vuelva a intentar la actualización y verifique en la interfaz de usuario de iDRAC que el firmware se está cargando y programando en la cola de trabajos.

VxRail Appliance Family, VxRail Appliance Series, VxRail G Series Nodes, VxRail D Series Nodes, VxRail D560, VxRail D560F, VxRail E Series Nodes, VxRail E460, VxRail E560, VxRail E560F, VxRail E560N, VxRail E660, VxRail E660F, VxRail E660N , VxRail E665, VxRail E665F, VxRail E665N, VxRail G560, VxRail G560F, VxRail P Series Nodes, VxRail P470, VxRail P570, VxRail P570F, VxRail P580N, VxRail P670F, VxRail P670N, VxRail P675F, VxRail P675N, VxRail S Series Nodes, VxRail S470, VxRail S670, VxRail Software, VxRail V Series Nodes, VxRail V470, VxRail V570, VxRail V570F, VXRAIL V670F, VxRail VD-4510C, VxRail VD-4520C, VxRail VD Series Nodes, VxRail VE-660, VxRail VE-6615, VxRail VE-670, VxRail VP-760, VxRail VP-7625, VxRail VP-770, VxRail VS-760 ... Ver más about warranties Ver menos about warranties