Start a Conversation

Solved!

Go to Solution

18098

May 28th, 2019 05:00

iSCSI connection failures after KB4499177

Heads up on KB4499177

We encountered an odd issue on some of our Win Server 2016 nodes, that connect to a PS4210 array, started this morning at about 3am.

Trying to connect to some volumes (but not necessarily /all/) on the array was reporting a "Target error", and found elsewhere reports about it being an authentication failure... Takes a while to try until it hits a timeout threshold.

Firmware is up to date on the array, and drivers/firmware on the hosts are also up to date.
Plentiful host reboots, nothing resolved it until...

Now uninstalled KB4499177 (2019-05 Cumulative Update) - rebooted - and wham, instant connectivity again. Have repeated the incident on a 2nd node in the Failover Cluster - same issue, same resolution.

So, possibly Dell related, but most presumedly MS led issue on this one.
Couldn't see anything relevant to this as a known issue in the KB.

Other error messages reported from Windows Event Viewer:
Cluster Shared Volume 'XYZ' ('XYZ') is no longer accessible from this cluster node because of error '(1460)'. Please troubleshoot this node's connectivity to the storage device and network connectivity.

Event 1: Unexpected failure. Error code: 48F@01000003

Event 43: Target failed to respond in time for a login request.

and from Group Manager:
iSCSI session to target 'XYZ from initiator 'XYZ' was closed. iSCSI initator connection failure. No response on connection for 6 seconds.

iSCSI login to target 'XYZ' from initiator 'XYZ' failed for the following reason:
Requested target not found.

3 Apprentice

 • 

1.5K Posts

June 7th, 2019 21:00

Hello,

 Thank you for posting this.  That's very interesting about the switch.  Did you happen to open a support case while this was happening?

 Regards,

Don

 

1 Message

June 9th, 2019 15:00

I have also experienced this after applying the KB4497934 patch on windows 2019 datacenter with the desktop.  once I remove it, it works.  this is for both a PS6100 and PS6000.  oddly enough, it does not happen with windows 2019 datacenter core due to the patch not being installed and with the latest updates.  I have opened a support case may 27th for this as well.

3 Apprentice

 • 

1.5K Posts

June 9th, 2019 19:00

Hello,

Thank you for opening a support case.  Your assistance is appreciated.

 Regards,

Don

6 Posts

June 11th, 2019 05:00

Same here!  Dell R730 Server 2016 host connecting via iSCSI to a PS6210x array.  As soon as KB4499177 was applied last night, about a third of iSCSI connections were stuck in "reconnecting" state.  Thankfully I found this thread and after removing the update and rebooting, all is well.

8 Posts

June 11th, 2019 10:00

Thanks for posting this, I've been wracking my brain trying to figure this out over the past couple of days. AND, as an fyi, I had this exact issue with server 2019 as well. 

I have 2 brand new dell R740's that I am trying to set up to replace our existing host servers. Originally I installed server 2019 and was getting the issue and thinking that this was a compatibility issue with 2019, since the hit software has not been released for it as of yet, I wiped the servers and am starting with fresh 2016. 

What made this hard to track down was that one of our servers was not getting this patch for some reason so I was at a point where I believed that there was an issue with one of the X710 intel 10gb cards in the machine. We have dual ps4210 arrays on Firmware 9.0.8 until we can get rid of our 2008r2 hosts.

 

3 Apprentice

 • 

1.5K Posts

June 11th, 2019 23:00

I created a new topic for this but wanted to include it here as well.

 

There are currently three MS KBs that once installed result in iSCSI login failures with Dell PS Series arrays

Server 2019 -- KB4497934
Server 2016 --KB4499177
Server 2016 --KB4503267 - Released June 11

At this time the only resolution is to remove the KB and iSCSI logins  will complete.

 Regards,

Don

June 13th, 2019 08:00

Any update on this?

June 14th, 2019 07:00

I have been monitoring this thread since I experienced this problem, and I am perplexed there has been little movement towards a solution. I opened a Dell support case and have heard nothing. In the other forum thread it was said Dell has found no array issue. Does that mean no issue has been found anywhere, or an issue has been found outside the array?

Here is my architecture if anyone else wants to point out a commonality:

Server: Dell R630
Operating System: Windows Server 2016 Standard
NIC:  Solarflare 6122
Cabling:  Twinax
Switch: Arista DCS-7148SX
EqualLogic: PS6210E
Firmware:  9.0.5

I have three near-identical systems all experiencing the issue.

3 Apprentice

 • 

1.5K Posts

June 14th, 2019 09:00

Hello,

 As of right now, no issue with the array firmware or hardware has been identified as the cause of this issue.

 Once the MS patch is removed function returns. Suggesting a server side issue.

 But Dell and Microsoft are investigating.

 I have suggested that all those hitting this open cases with Dell and MS to increase awareness of the issue.

 Regards,

Don

June 17th, 2019 08:00

We've experienced it in 2 environments now - one of which was solely running 1Gb / Cat5, no 10Gb connections in sight for that environment. So I don't think it's a NIC mix up issue...

June 17th, 2019 08:00

I opened a case with Tech Support, but soon as I removed the update the problem went away, so closed the case. Issue seem to be with 10Gb connections only, I have similar setups with a 4100 in one location running at 1Gb Cat6, no issues even with both 'bad' 2016 updates. Main location has group comprising a 4100 and 4210, 4100 has 1Gb connections, 4210 has 10Gb. Two Dell servers (R730 and R740)both have issues (with either update) connecting at 10Gb, one has Cat6e connections, one has SPF+ DAC cables. Maybe some kind of issue running mix of 1Gb / 10Gb to the EQL? Tried running a third server to the same group at 1Gb, no issues at all.

3 Apprentice

 • 

1.5K Posts

June 17th, 2019 13:00

Hello,

Correct, customers are seeing on both GbE and 10GbE arrays.  Regardless of what what array firmware is used.

 Regards,

Don

 

 

1 Message

June 19th, 2019 21:00

Adding a +1. We discovered this problem two weeks ago. R720, Server 2019, PS6100, 1GbE. Monitoring this forum.

Thanks to everyone weighing in on this. It appears it's not isolated to just a few.

3 Apprentice

 • 

1.5K Posts

June 19th, 2019 22:00

Hello,

 Glad we could be of assistance.  Yes, many users are seeing this issue. 

 Regards,

Don

 

1 Rookie

 • 

63 Posts

June 25th, 2019 07:00

Four MS KBs result in iSCSI login failures with Dell PS Series arrays now. Server 2019 -- KB4497934 Server 2019 -- KB4503327, KB4501371 - Release June 11 Server 2016 -- KB4499177 Server 2016 -- KB4503267,KB4503294 - Released June 11
No Events found!

Top