Unsolved
This post is more than 5 years old
13 Posts
0
245046
March 14th, 2014 12:00
KVM SIP Not Responding (Offline) after Server Reboot
Have a weird issue. After a reboot or two of our new servers, we're loosing KVM access to them and the KVM reports the SIPS offline. We’ve verified that there’s no cabling issues by replacing the network cables to the SIPS with new cables, tried rebooting the KVM, disconnecting the network cable and reconnecting them, but they will not come back online. (Screenshot below)
The issue is only resolved by physically unplugging the USB connection for the SIP from the server and reconnecting them. The SIPS appear to have the power LED lit before we have to physically resetting them.
Also, once this happens, reboots take 10+ min for the USB Media search to time to error out and pass on to OS Boot from the the local disks. (Screenshot below)
On our R620 servers, we were running the latest BIOS, 2.1.3, but 2.2.2 is now out. The R620 servers are connected to our 2162DS KVM running the latest firmware of 1.16.0.20726. The USB2+CAC SIPs are connected to the R620s and 2162DS running 1.0.1.13 Application.
Going to try the new 2.2.2 BIOS, but no notes on this issue in the release notes.
Needless to say, this is very annoying and difficult to get to the USB connection in our rack's current configuration.
Any thoughts, comments, or reported repeatability would be appreciated.



Daniel My
10 Elder
•
6.2K Posts
0
March 16th, 2014 11:00
Hello
The only issue I'm aware of with the USB2+CAC SIPS going offline is when they are used with port expansion modules. It doesn't appear you are using PEMs though.
Are you using these same SIPs on other model servers? Are you able to swap these SIPs with SIPs you are using with other servers to find out if this is an issue with the SIPs or the R620s? Is there a lot of PCI devices in these servers or are GPUs installed? Anything non-standard about their components or configuration?
Thanks
jbennettmsjc
13 Posts
0
March 17th, 2014 14:00
Are you using these same SIPs on other model servers?
Yes, we are using them on PowerEdge R510, R710, and R810 servers - but they are on application 1.0.1.11. I've upgraded a few to 1.0.1.13 to compare. I noticed on our other 2162DS that the 1.0.1.11 Application USB2+CAC SIPs are not responding on some of the other systems, even after upgrading to 1.0.1.13, but they do show Online - just no video or control. I can confirm video via iDRAC console view.
Are you able to swap these SIPs with SIPs you are using with other servers to find out if this is an issue with the SIPs or the R620s?
Sure, I'll give it a shot.
Is there a lot of PCI devices in these servers or are GPUs installed?
Just one QLogic 2562 in the PCI slot, PERC H710 Mini on board, and Intel x520 DP 1g + DP 10gb on board
Anything non-standard about their components or configuration?
Not that I'm aware. Dual E5-2690s and 12x16GB DDR3 Modules
jbennettmsjc
13 Posts
0
March 18th, 2014 15:00
I've tried swapping SIPs (like models), but no video. They have the same Application level, but no video even after a reboot and power on the LEDs on the unit.
Daniel My
10 Elder
•
6.2K Posts
0
March 19th, 2014 07:00
Are you having this issue on multiple 2162's?
If you don't mind please send me a private message with the service tag of the 2162. This is sounding like a compatibility issue, and I show those SIPs listed as compatible for that KVM. I'll engage someone more familiar with the product and see what we can come up with.
Thanks
jbennettmsjc
13 Posts
0
March 19th, 2014 08:00
Easier said then done... Tried in IE and Chrome
Daniel My
10 Elder
•
6.2K Posts
0
March 19th, 2014 08:00
I'll send you an email.
Daniel My
10 Elder
•
6.2K Posts
0
March 19th, 2014 14:00
I was informed that the latest version of Java causes a lot of issues with the KVM. There is a firmware update that is about to be released to address these issues. There is no current ETA on it's release but it could be released any day.
The current work-around is to use Java 1.7.4. Alternatively, you can try lowering security settings and you may get functionality to return. This Java issue would explain the no video, but I'm not sure it will affect the SIPs going offline.
Please check to see what version of Java you are running. If it is later than 1.7.4 then please install that version and test. Let me know if the no video and SIP offline issues persists with that version.
I will be out of the office the next few days. I will ask a colleague to monitor this post in my absence.
Thanks
jbennettmsjc
13 Posts
0
March 20th, 2014 09:00
Looks like we're running Java 1.7.0_45-b18. I'll upgrade it and give it another shot. I agree with you about not having anything to do with the Offline SIPs. I'm going to try the R620 2.2.2 BIOS. My hunch is there's something the R620 or Windows Server 2012 is doing during the restart process that is causing this, because the offline issue is only happening on the R620 models. The other systems are also only running 2008 R2 and below.
I'll report back by tomorrow.
jbennettmsjc
13 Posts
0
March 21st, 2014 16:00
After upgrading one of our PowerEdge R620's to the latest BIOS, 2.2.2, I believe the issue is no longer present. I tested one server by updating the BIOS, reseated the USB connection to the SIP - in order to bring it back Online after the BIOS update, and rebooted and shutdown the system multiple times. I couldn't replicate the original issue any longer. This was with one of the original five SIPs I've been having this issue with.
The slightly older SIP - shown in the pictures that I swapped out with - had no effect on the R620 2.1.3 or 2.2.2 BIOS. It is something specific with one of the USB2+CAC SIPs that we purchased most recently and the R620 firmware 2.1.3 and below.
I'll keep an eye on it and report if the issue comes back - as it may be a time related issue as well.
Also, the latest Java did resolve the other video issue with the SIPs that were online but had no video.
Thank you,
Justin
Daniel My
10 Elder
•
6.2K Posts
0
March 22nd, 2014 11:00
Thanks for the update!
So all of the issues are resolved, correct?
Changing Java version correct the no video issue, and updating the R620 BIOS correct the USB2+CAC issue of going offline during reboots. I'll report this to the escalations team I have been working with so that they are aware of it.
Thank you for taking the time to troubleshoot this issue and report back. I'm sure this will help many others.
jbennettmsjc
13 Posts
0
March 24th, 2014 08:00
Well, I take that back... just checked the KVM this morning - no reboots - just idling all weekend. The one SIP I swapped has no issue, the others now all show no power again. :emotion-12:
jbennettmsjc
13 Posts
0
March 24th, 2014 08:00
Yes, everything does appear to be resolved.
Justin
Daniel My
10 Elder
•
6.2K Posts
0
March 24th, 2014 10:00
Have you tried to access the ones listed as no power? It looks like the operating systems has powered down the USB. Trying to access it may bring it back online.
If that doesn't work then disable power management on that USB device to see if that is the issue. In Windows you go to device manager, locate the device, properties, power management, and uncheck the option to allow the OS to turn off the device.
Thanks
jbennettmsjc
13 Posts
0
March 24th, 2014 11:00
The effected SIPs are the 9FC37 and I'm not able to wake them up through any means, other than unplugging the USB or physically pulling power from the R620 system and letting the 5V power drain out.
jbennettmsjc
13 Posts
0
March 24th, 2014 11:00
I've checked all of the USB devices on one of the affected servers and all of the check boxes "Allow the comptuer to turn off this device to save power" for each USB device is already unchecked.