Dvr111
1 Nickel

Secondary Control Module redundancy has failed - PS6510

Hi all,

I'm hoping someone could possibly help.

We recently had the secondary controller replaced in our EOL PS6510 by third party support. Ever since the controller was replaced we get an email alert every 24hrs. I am now unable to fail back to the primary controller from the group manager.

-----------------------------------------
ERROR event from storage array Member02
subsystem: logevent [secondary]
event: 35.4.1
time: Tue Mar 19 14:26:22 2019

Secondary Control Module redundancy has failed. Please contact a senior support representative (Ref: QNA42261 / CEMI0.0).
-----------------------------------------


When i attempt to perform a restart, a fail alert appears and I get the same error as i listed above.

No errors or alerts are present in the CLi.

 

Member02> member select Member02 show
_____________________________ Member Information ______________________________
Name: Member02 Status: online
TotalSpace: 21TB UsedSpace: 10TB
SnapSpace: 0MB Description:
Def-Gateway: Serial-Number:
Disks: 48 Spares: 2
Controllers: 2 CacheMode: write-back
Connections: 271 RaidStatus: ok
RaidPercentage: 0.000% LostBlocks: false
HealthStatus: normal LocateMember: disable
Controller-Safe: disabled Low-Battery-Safe: enabled
Version: V9.1.4 (R443182) Delay-Data-Move: disable
ChassisType: 4835 Accelerated RAID Capable: no
Pool: POOL03-R50 Raid-policy: raid50
Service Tag: XXXXXXX Product Family: PS6510
All-Disks-SED: no SectorSize: 512
Language-Kit-Version: de, es, fr, ja, ExpandedSnapDataSize: N/A
ko, zh CompressedSnapDataSize: N/A
CompressionSavings: N/A Data-Reduction: no-capable-hardware
Raid-Rebuild-Delay-State: disabled Raid-Expansion-Status: enabled
_______________________________________________________________________________
____________________________ Health Status Details ____________________________
Critical conditions::
None

Warning conditions::
None
_______________________________________________________________________________
____________________________ Operations InProgress ____________________________

ID StartTime Progress Operation Details
-- ------------------- -------- -----------------------------------------------

 


Thanks
Brendan

Labels (1)
0 Kudos
5 Replies
dwilliam62
3 Zinc

Re: Secondary Control Module redundancy has failed - PS6510

Hello Brendan, 

 There are a couple possibilities I can think of right off the bat. 

 One, they didn't swap out the compact flash card from the old controller, and put it in the replacement controller.   So the controller isn't booting up and connecting to the primary controller.    

 Two, they didn't swap out the CF card and the one in the replacement doesn't match the primary so failover cannot occur. 

 Three, the replacement controller is defective. 

  If you do a member select Member02 show controllers    That will give you more information. 

 Regards,

Don

0 Kudos
Dvr111
1 Nickel

Re: Secondary Control Module redundancy has failed - PS6510

Hi Don,

Cheers for the information that was useful.

I personally do not have faith in the EOL support we are receiving (Non-dell support). They are advising we need to shut down the SAN which is not possible and I dont believe it's the solution.

Here's the output

member select Member02 show controllers

___________________________ Controller Information ____________________________
SlotID: 0 Status: active
Model: 70-0300(TYPE 10) BatteryStatus: ok
ProcessorTemperature: 58 ChipsetTemperature: 0
LastBootTime: 2019-01-25:14:20:04 SerialNumber: -------------
Manufactured: 2710 ECOLevel: C00
CM Rev.: A01 FW Rev.: Storage Array Firmware V9.1.4
NVRAM Battery: good (R443182)
BootRomVersion: 2.3.3 BootRomBuilDate: Wed Mar 31 16:37:31
EDT 2010
_______________________________________________________________________________
_______________________________________________________________________________
SlotID: 1 Status: secondary
Model: 70-0300(TYPE 10) BatteryStatus: ok
ProcessorTemperature: 64 ChipsetTemperature: 0
LastBootTime: 2019-02-22:14:21:45 SerialNumber: -------------
Manufactured: 2313 ECOLevel: C00
CM Rev.: A06 FW Rev.: Storage Array Firmware V9.1.4
NVRAM Battery: good (R443182)
BootRomVersion: 2.3.5 BootRomBuilDate: Mon Apr 30 17:08:16
EDT 2012
_______________________________________________________________________________
______________________________ Cache Information ______________________________
CacheMode: write-back Controller-Safe: disabled
Low-Battery-Safe: enabled
_______________________________________________________________________________
Brendan

cheers

0 Kudos
dwilliam62
3 Zinc

Re: Secondary Control Module redundancy has failed - PS6510

Hello Brendan, 

Well I looked into that error and they are correct.  The only resolution is a complete shutdown. Shtudown the servers.  Power off the array for at least two minutes and bring it back up.  That should resolve the issue. 

 Also, just FYI:  Dell is now offering extended H/W only support up to 12 years from original ship date on arrays like the PS SANs. 

 Regards, 

Don 

0 Kudos
Dvr111
1 Nickel

Re: Secondary Control Module redundancy has failed - PS6510

Thanks Don,

Yes we plan on moving back to dell support shortly.

0 Kudos
dwilliam62
3 Zinc

Re: Secondary Control Module redundancy has failed - PS6510

Hello, 

 You are very welcome.  I am glad that I could assist you. 

 Regards,

Don

 

 

0 Kudos