OME 3.6.0 Refresh Inventory Fails on Most 12th and 13th Generation Servers

That thread, and the one it links to, refers to issues logging in and being logged out. They do not describe the issue this post describes. Is the upcoming patch mentioned in the linked thread supposed to resolve issues with Refresh Inventory as well?

Hi, thanks for choosing Dell.

Would you refer to this? This may help you understand the situation.

https://dell.to/2U3yFml

Wish you a great week ahead. ^^

Hello, I will see if this has been submitted. Please know this will take time. Thank you.

Same issue but I didn't see this thread before creating mine: https://www.dell.com/community/Dell-OpenManage-Enterprise/13G-Server-Inventory-issues-since-3-6-0-b41/m-p/7906766#M4165

This is still happening on the newer Version 3.6.1 (Build 6). Any update?

Having the same issue.  12th and 13th Gen server inventories are not updating.

Same issue here.

Any update on this? I upgraded our OMEnt test server to 3.7.0.82 today, and it is still experiencing this issue.

Upgraded from 3.5.0 to 3.7.0 and I'm not able to run inventory on anything, either 12th Gen or even 14th Gen.  The job just sits there at 0% for more than 10 minutes.  The Warranty Application Settings gives me an "unknown error" when I try to change it.

I have just noticed the same. Several or ours M630 and FC630 cannot refresh inventory. Message int he job view:

The Inventory operation failed. Inventory details were not provided by device.
Please retry refresh inventory for the device.
Task Failed. Completed With Errors. 

I also wasn't able to update to the latest iDRAC on those blades with OME.

Exception occurred while checking LifeCycle Controller Status
Remote Services are not available. 

Even after manual update of iDRAC inventory still doesn't work with OME.

Only some blades are affected. I have other M630 and FC630 which work just fine.

I have noticed some error messages on the ome server in /var/log/dell/mcsi/monitorservice/monitorservice.log when I refresh the inventory for one of those devices:

[WARN ] 2021-08-26 07:28:12.338 [Inventory-Task-Pool-1033]  InventorySubTask - processTarget: inventory is running for task: 117485  deviceId: 25072
[ERROR] 2021-08-26 07:28:20.472 [Inventory-Task-Pool-1033]  RedfishClient - Can not get EntitySets. URI:https://10.25.12.61:443/redfish/v1/Managers/iDRAC.Embedded.1/Attributes
org.apache.olingo.client.api.communication.ODataClientErrorException: (Base.1.2.GeneralError) A general error has occurred. See ExtendedInfo for more information [HTTP/1.1 404 Not Found]
        at org.apache.olingo.client.core.communication.header.ODataErrorResponseChecker.checkResponse(ODataErrorResponseChecker.java:99) ~[odata-client-core-4.8.0.jar:?]
...
[WARN ] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishClient - processODataExceptions:EEMI Message extendedinfo:[MCSIEEMIMessageExtendedInfo{ message=Unable to complete the operation because the resource Attributes entered is not found.,severity=Critical,resolution=
Enter the correct resource and retry the operation. For information about valid resource, see the Redfish Users Guide available on the support site.,messageId=IDRAC.1.6.SYS403,messageArgs=[Attributes] }, MCSIEEMIMessageExtendedInfo{ message=The resource at the URI Attributes was
 not found.,severity=Critical,resolution=Place a valid resource at the URI or correct the URI and resubmit the request.,messageId=Base.1.2.ResourceMissingAtURI,messageArgs=[Attributes] }]
[ERROR] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishClient - response is null from DeviceUri https://10.25.12.61:443/redfish/v1/Managers/iDRAC.Embedded.1/Attributes
[ERROR] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishPluginImpl -  Command failed with errorcode:
[ERROR] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishPluginImpl -  Response is null.
[WARN ] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishPluginImpl - executeCommand: responseCode: Operation failed.
[ERROR] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishServerDiscoveryAction - populateServerDeviceInfo : Failed to get device information /redfish/v1/Systems/System.Embedded.1
[ERROR] 2021-08-26 07:28:20.473 [Inventory-Task-Pool-1033]  RedfishServerDiscoveryAction - getServerDiscoveryDataUriList : No data found
[ERROR] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishClient -  Can not create EntitySet. entitySetURI:https://10.25.12.61:443/redfish/v1/Dell/Managers/iDRAC.Embedded.1/DellLicenseManagementService/Actions/DellLicenseManagementService.ShowLicenseBits
org.apache.olingo.client.api.communication.ODataClientErrorException: (Base.1.2.GeneralError) A general error has occurred. See ExtendedInfo for more information [HTTP/1.1 405 Method Not Allowed]
        at org.apache.olingo.client.core.communication.header.ODataErrorResponseChecker.checkResponse(ODataErrorResponseChecker.java:99) ~[odata-client-core-4.8.0.jar:?]
...
[WARN ] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishClient - processODataExceptions:EEMI Message extendedinfo:[MCSIEEMIMessageExtendedInfo{ message=Unable to run the method because the requested HTTP method is not allowed.,severity=Informational,resolution=Enter a valid HTTP method and retry the operation. For information about valid methods, see the Redfish Users Guide available on the support site.,messageId=IDRAC.1.6.SYS402,messageArgs=null }]
[ERROR] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishPluginImpl -  createEntity failed for https://10.25.12.61:443/redfish/v1/Dell/Managers/iDRAC.Embedded.1/DellLicenseManagementService/Actions/DellLicenseManagementService.ShowLicenseBits
[ERROR] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishPluginImpl -  Command failed with errorcode:405,segment:redfish/v1/Dell/Managers/iDRAC.Embedded.1/DellLicenseManagementService/Actions/DellLicenseManagementService.ShowLicenseBits, httpMethod:POST
[ERROR] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishPluginImpl -  Response is null.
[WARN ] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishPluginImpl - executeCommand: responseCode: Operation failed.
[WARN ] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedfishServerGetLicenseBits - Unable to collect the Device license bits.
[ERROR] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedFishServerUpdateCapabilityBean - Error while getting license details for device: 25072
[WARN ] 2021-08-26 07:28:21.279 [Inventory-Task-Pool-1033]  RedFishServerUpdateCapabilityBean - No license available for the device id: 25072
[ERROR] 2021-08-26 07:28:21.283 [Inventory-Task-Pool-1033]  InventorySubTask - Unable to perform inventory request for device.
com.dell.enterprise.core.integration.lib.common.exception.RuntimeCoreException:
        at com.dell.enterprise.core.integration.lib.common.exception.RuntimeCoreException.handleRuntimeCoreException(RuntimeCoreException.java:332) ~[common-0.0.1-SNAPSHOT.jar:?]
...
[WARN ] 2021-08-26 07:28:21.283 [Inventory-Task-Pool-1033]  InventorySubTask - No device connection status was provided.
[WARN ] 2021-08-26 07:28:21.283 [Inventory-Task-Pool-1033]  InventorySubTask - No device operation status was provided.
[ERROR] 2021-08-26 07:28:21.289 [Inventory-Task-Pool-1033]  InventorySubTask - An exception was caught during a sub-task operation.
com.dell.enterprise.core.integration.lib.common.exception.RuntimeCoreException: Failed to get inventory.
        at com.dell.enterprise.common.integration.lib.tasks.inventorytask.InventorySubTask.processTarget(InventorySubTask.java:93) ~[inventorytask-0.0.1-SNAPSHOT.jar:?]
        at com.dell.enterprise.common.integration.lib.taskengine.CorePlatformSubTask.run(CorePlatformSubTask.java:320) ~[taskengine-0.0.1-SNAPSHOT.jar:?]
        at com.dell.enterprise.common.integration.lib.taskpool.CorePlatformTaskPool$WorkerThread.run(CorePlatformTaskPool.java:1027) ~[taskpool-0.0.1-SNAPSHOT.jar:?]
[WARN ] 2021-08-26 07:28:21.297 [Inventory-Task-Pool-1033]  MBMessageSender - Sending Message to topic : DeviceConfig

I don't see any of these for the devices which work. It's not all servers but only some. I have M630s  bought at the same time, sitting next to each other in a M1000e, running the same iDRAC version by now, one has the problem, the other does not.

I have also checked those EntitySetURLs mentioned in the errors. I can access those URLs with curl GET using basic auth and get the same error message mentioned in the "EEMI Message extendedinfo" part.

However, I get exact same responses with curl if I change it to an IP of a device for which inventory works.

Hello @gvde,

You mentioned the iDRAC version of M630 have been updated, just to confirm they are on 2.81.81.81 right? Also, the servers that have inventory issue, are they discovered by iDRAC in OME? What are you OME version now?

May I know if you're having only modular servers issue, how about if any rack server having issues?

Have you tried removing the problem server's discovery and rediscover, does that help?

Hello,

I don't have so much idea to solve this issue.

Please can you perform these 

1. Reset the Idrac
2. Delete the device from OME
3. Rediscover it.

Thanks

Marco

---

@DELL-Joey C wrote:

Hello @gvde,

 

You mentioned the iDRAC version of M630 have been updated, just to confirm they are on 2.81.81.81 right? Also, the servers that have inventory issue, are they discovered by iDRAC in OME? What are you OME version now?

---

Yes, all my M630 are on 2.81.81.81. Those, I wasn't able to update those with the inventory issue through OME, thus I have updated them eventually manually through iDRAC/CMC.

They are all discovered and listed as "Managed" in the Devices list, just as all the others.

OME is currently "OpenManage Enterprise Current Version: 3.7.0 (Build 82)".

---

@DELL-Joey C wrote:

May I know if you're having only modular servers issue, how about if any rack server having issues?

---

Yes, looks like it. 5x FC630, 3x M620, 5x M630. I have others of each which work fine.

---

@DELL-Joey C wrote:

Have you tried removing the problem server's discovery and rediscover, does that help?

---

Yes, I tried that with one of the M630, but I got the same "Inventory failed" after discovery.

O.K. That seem to have helped, though, one of the M630 I had to reset and delete twice before it picked up the inventory again, and then even had to reset idrac another time before I was able to schedule a firmware update.