Start a Conversation

Unsolved

W

35 Posts

8390

January 31st, 2021 08:00

Replaced IDSDM module in R630 and no longer see redundancy

I've got a PowerEdge R630 running esxi 6.0. One of the IDSDM modules failed and it was clearly noted in iDRAC. This is the 'before' picture:

WorksHow_0-1612109503446.png

We swapped out the SD1 module. As it was booting, I was prompted to overwrite the new SD card in Slot 1 (or whatever the verbiage was). I entered ‘y’ at the prompt in the bios to confirm and it appeared to rebuild and eventually loaded the esxi OS. That part was good.

Now, the main page in the iDRAC shows all green, but when I view the flash media in the DRAC, I no longer see the redundancy or both SD modules listed. This is the 'after' picture:

WorksHow_1-1612109960917.png

This is a working system and it is difficult to get someone on-site or squeeze in any opportunities to reboot or shut it down. 

Any help would be appreciated!

4 Operator

 • 

3K Posts

January 31st, 2021 18:00

Can you reboot iDRAC and check the behavior. If it is not resolved the issue you can remotely reboot the server using iDRAC and check whether iDRAC is showing IDSDM details. 

Can you also check whether you have latest FW on IDSDM and iDRAC?

35 Posts

February 1st, 2021 09:00

Can I reboot the iDRAC without interrupting the server? And  not sure how to do that. 

But I do have some new info: In the lifecycle log I found this:  'Internal Dual Module rebuild failed because read/write to one of the SD cards failed'

Is there a way to invoke the rebuild again or should we try reseating the SD card first? Thanks!

WorksHow_0-1612200202178.png

 

4 Operator

 • 

3K Posts

February 2nd, 2021 08:00

You can login to iDRAC and on Summary page you can find an option to Reset iDRAC under "Quick Launch Tasks" section. Resetting iDRAC will not impact or reboot server. 

For IDSDM rebuild we need to reboot server. I also recommend to reinsert SD card and try.

35 Posts

February 4th, 2021 12:00

I have reset the iDRAC and it's scary, but I don't believe it. If it were true I don't think the server would be working at all. 

WorksHow_0-1612471268854.png

The firmware on the iDRAC is old:

WorksHow_1-1612471362795.pngWorksHow_2-1612471383870.png

 And I see that the IDSDM Firmware is at .15, but I cannot find the download for the new one.

What are the next steps? If it does not rebuild on a reboot, and a reseat does not help, should I plan on updating these two items?  Thank you!

35 Posts

February 4th, 2021 13:00

I found this:

WorksHow_2-1612474822003.png

But the older versions do not list 0.15, so not sure it is the correct thing. 

WorksHow_1-1612474741874.png

 

 

4 Operator

 • 

3K Posts

February 4th, 2021 17:00

This looks strange. You can try reseat of IDSDM and see whether it will resolve the issue. If that not fix the issue you can try updating iDRAC and BIOS first then later IDSDM

35 Posts

February 5th, 2021 10:00

Tomorrow I will be able to try reseating the SD card. In the meanwhile I have just updated the iDRAC firmware so it is the latest. (The IDSDM still shows as both having failed). 

WorksHow_0-1612550129785.png

 

35 Posts

February 6th, 2021 14:00

We replaced the dual card reader.

Initially we were able to boot into the OS with SD1 as primary and the mirroring disabled. We were also able to boot into the OS with SD2 as primary and the mirroring disabled. But the entire time we never saw both SD cards show up in the iDRAC. And occasionally we would see one SD card show up but always in a failed state.

I have updated the BIOS and iDRAC/lifecycle controller firmware. I don't think that the IDSDM firmware update was successful because it still reads 0.15.

Now we get these:

WorksHow_0-1612648812770.png

I have migrated the live VMS off of this system and put the host in maintenance mode so I can at least work on it whenever we need too. 

Moderator

 • 

4.4K Posts

February 7th, 2021 19:00

Hi, how about we try Version 1.7, A02 instead? I’m thinking the version might be showing the incorrect numbering…

4 Operator

 • 

3K Posts

February 8th, 2021 00:00

Did you replaced IDSDM module or SD cards?  

35 Posts

February 8th, 2021 05:00

So far I have replaced two parts: SD1 (originally showed as failed) and also the Dual Card Reader. I've also updated the iDRAC firmware and the BIOS. 

I see now that the IDSDM firmware file on the Dell website does show as correct, however on Dell's 'older version' page they list it incorrectly. Even so, I am unable to get that firmware to install so the current version is still at 0.15. Here are the 3 versions they have:

WorksHow_0-1612790830176.png

This is what is currently listed in iDRAC but it doesn't see ANY SD cards anymore at all and it no longer has an OS listed. 

WorksHow_1-1612790919226.png

WorksHow_2-1612791092800.png

And here is how I currently have things set in the BIOS. Though it no longer matters how I change this, as it won't boot anyway:

WorksHow_3-1612791166447.png

 

Moderator

 • 

2.6K Posts

February 8th, 2021 06:00

Hello,

 

When the server is available to restart, although the iDRAC and BIOS are not very old, there are new versions available, you can update them. Apart from that, there is a fix like this in IDSDM 1.11 version. You can try to update to this new version.

 

iDRAC 2.75.100.75 https://dell.to/3cRvXHL

 

BIOS 2.12.1 https://dell.to/36T0wce

 

IDSDM 1.11 https://dell.to/3d50ouv
- Resolved defect where IDSDM marks SD cards as "missing" or "failed" due to IDSDM boot up issue
- Corrected potential loss of log data due to IDSDM reset or sudden power loss

If you cannot update after clearing the SEL log in iDRAC and soft reset, You can then check out

 

Alternative FW update methods here pg 61 Updating device firmware https://dell.to/3rqfLl0

35 Posts

February 8th, 2021 08:00

Thank you Erman.

So, this really looks to be EXACTLY the issue I am struggling with!

Right now, I am having trouble updating the firmware. I was trying to update the BIOS and iDRAC again as you suggested.  

So far, the way I have been updating the firmware is through the quick launch tasks and then the 'Update and Rollback' selection. I hope this is correct that I can legitimately do it here. A colleague of mine feels that this is only for the iDRAC firmware update. 

WorksHow_1-1612801969739.png

 

The .exe files there are able to upload just fine, and then it seems to be ok when I tell it to install. However, it is now getting stuck and I cannot seem to update anything further. I get this message:

WorksHow_0-1612801945335.png

The only way I can get out of this is to reset the iDRAC.  I see that my screenshot of the firmware levels did not show in the post so here are the Current listings:

BIOS: 2.11.0, iDRAC and Lifecycle: 2.75.75.75, IDSMD: 0.15

4 Operator

 • 

2.9K Posts

February 8th, 2021 08:00

Hello,

 

In older model servers, your colleague would have been correct. However, with the modern equipment, you should be able to update the rest of your firmware through that interface.

 

If you haven't already, you might try disconnecting power from the server and holding the power button down for a moment. You can then power up as normal. This is a really basic step, but one I lean on heavily, that can help with a number of iDRAC issues.

35 Posts

February 8th, 2021 09:00

ok, thank you for that clarification. I was having a hard time convincing him that I was almost positive that's exactly how I had updated the BIOS.

And that is an excellent idea to try draining the current out of the system. I'm not sure how soon I can get that accomplished but I will work on. it.

Thanks and by all means please do let me know if you have any other ideas..

No Events found!

Top