I'm having problems with a Storage Server Dell PS4210, two weeks ago there was a general blackout and the storage was completely turned off. The configuration is three ps4210 servers, one master and two slaves. Where everyone got up except the master.
After running some commands to verify the array I get the following:
CLI> support exec "raidtool" Driver Status: Admin Intervention Requested RAID LUN 0 Degraded. raid status unrecoverable. 11 Drives (0,2,4,6,8,1,3,5,7,f,f) RAID 6 (64KB sectionPerSU) Capacity 17,617,013,637,120 bytes Available Drives List: 9
It stayed in "storage array still initializing" 10 days ago... please urgent help.
Can you try the steps dwilliam62 mentioned on these two threads I found? Tried to restart the active controller to force a failover, See if the passive can pick up the drives. The next step is to remove all the components, controllers, and drives, including the backplane sits in. make sure they are fully seated, and power it back up again.
You are running a support command, which is normally restricted to PS Series Tec hnical Support personnel. Do not use a support command without instruction from Technical Support. NetBSD 5.0_STABLE NetBSD 5.0_STABLE (EQL.PSS) #0: Thu Sep 1 08:03:53 EDT 2016 build@m64:/buildarea/V8.1.6__Thu_Sep_01_2016_07_43_26_EDT/bin/destdir.sbmips.64.release/EQL.PSS.64 sbmips
P.S. => This is the result from the other command:
CLI> su exec raidtool -Z You are running a support command, which is normally restricted to PS Series Tec hnical Support personnel. Do not use a support command without instruction from Technical Support. Active RAID LUNs: 0 Driver Status = *ADMIN INTERVENTION REQUIRED*. Malloc Bytes = 0KB Outstanding Active I/O's = 0 Pending I/O's = 0 Pending Resource Reqs = 0 Outstanding StripeLocks = 0 Allocated Sectors = 0
Device = 000 status = 008 outio = 00000000 drives = 09 disk luns: 7 5 3 1 8 6 4 2 0 disk count:10 disk lun= 0 status=0x00000400 drive active device=0 disk lun= 1 status=0x00000400 drive active device=0 disk lun= 2 status=0x00000400 drive active device=0 disk lun= 3 status=0x00000400 drive active device=0 disk lun= 4 status=0x00000400 drive active device=0 disk lun= 5 status=0x00000400 drive active device=0 disk lun= 6 status=0x00000400 drive active device=0 disk lun= 7 status=0x00000400 drive active device=0 disk lun= 8 status=0x00000400 drive active device=0 disk lun= 9 status=0x00001000 hot spare no-device CLI>
Thanks for outputs. I'm suspected the controller can't read RAIDset somehow. In disks view one of them seems failed and one of them is empty. Could you do a powerdown/flea power drain?
DELL-Erman O
Social Media and Communities Professional
Dell Technologies | Enterprise Support Services
#IWork4Dell
Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!
This RAIDset is in a lost cache condition. The firmware is also well out of date as well.
When you log back in you can try clearing the cache. CLI>clearlostdata
This will disregard the lost cache and allow the array to boot. However, whatever data was lost is gone. Which could include data for the internal databases the array uses. Which could result in data loss.
If you verified that both controllers were the active one after the restarts then the command to clear the cache is your last hope. If not, then power down the array. Boot each controller individually. If CM0 for example was active, after powering it down, pull it out slightly from the backplane and power up on CM1.
If the array boots, then plug CM0 back in.
If not, then the clearlostdata is your best chance. Once booted up run filesystem checks on all your servers and VMs.
I tell you the following, yesterday I tried to change the CM0 and CM1 as indicated, but the equipment is only working with the CM0, the CM1 connects but does not turn on any light. However, yesterday we connected by SERIAL to see the boot sequence and see if it threw any other error and this is the result.
System will be rebooted in about 5 seconds... [PWRDN] [ENTRY][1][EQL][WDOG][WRESET] [ENTRY][1][EQL][WDOG][210][WFP][MINIT][MSIZE][MLEV0][MLEV1][MLEV2][MLEV3][SCRUB][DDRP][BOOT2][PROC][BOARD][SMP][PCIE][FLASH][NAE][USB]
######################################################### # # # Dell (tm) Inc. Storage Array # # Copyright 2001-2014 # # # # Controller Information: # # Part=70-0485 Rev=A02 SN= ** ECO=C00 # # # ######################################################### Bootloader Version 4.4.6 (SWINT Rev:4) Compiled on Mon Jul 28 13:57:41 EDT 2014 (type h for help) Enter Ctrl-P for boot prompt
Executing bootcmd1 [run] cpu_online_map=ffff, userapp_cpu_map ffff psb_os_active_mask=0, psb_os_mask=0 boot1_info: userapp_cpu_map=ffff, psb_os_cpu_map=0 cpu_online_map = 0xffff Jumping to the application... 0x80231000 ------------------------------------------------------------ Preparing ffff bitmask of cpus to run No network device to cleanup count = 16, total = 16 All slave cpus (16) ack'ed userapp init count = 4, total = 4 All slave cpus (4) ack'ed message ring init ============ cpu_0 ============== func = 0x80231000, args = 0x0 sp = 0xffffffff8f24dfe0, gp = 0xffffffff8f24c000 master_cpu = 0, master_mask = 00000001, buddy_mask = 0000ffff psb_os_cpu_map = 00000000, mode = 1, kseg_master = 0 app_shared_mem: addr = 0000000000000000, size = 0000000000000000, orig = 0000000000000000
Dell Inc. Storage Array
Copyright 2001-2016 Dell Inc.
sbs_early_init: Battery in Ship Mode at array restart - charge to full
plat_pfgxlp_wait_for_battery: Smart Battery Remaining Capacity = 678 mAh after 0-second delaySP:1.00:cache_driver.cc:1056:WARNING:28.3.17:Active control module cache is now in write-through mode. Array performance is degraded. SP:11.16:mips_pss_init.c:363:INFO:28.2.107:Control module in slot 0 with serial number CN-04V1MG-77921-56G-006W is designated as active. MFS set up Building databases... Restoring password file... SP:1663789922.70:emm.c:1333:INFO:28.2.6:Enclosure serial number: CN-01N9TR-70821-53K-11GP-A01. SP:1663789923.05:cache_driver.cc:1058:INFO:28.2.39:Active control module cache set to write-back mode. SP:1663789923.06:emm.c:2363:ERROR:28.4.47:Critical health conditions exist. Correct immediately before they affect array operation. The service life of the control module battery is depleted. There are 1 outstanding health conditions. Correct these conditions before they affect array operation. Wed Sep 21 15:52:10 EDT 2022 Sep 21 15:52:10 init: kernel security level changed from 0 to 1
PS Series Storage Arrays Unauthorized Access Prohibited
My query goes, if it is possible to know what information will be lost if the "clearlostdata" command is executed, on the other hand, of all the disk bays, each one has two LED indicators, of which only two disks are on, both LEDs, and the others just top LEDs.
If there any other procedure recommended before the clearlostdata command.
Ok, Thanks. Just to know, I saw online generic Batteries is there a way to replace them temporarly until the originals arrive. Cause in my local market there is no Replacements part.
DELL-Erman O
Moderator
•
2984 Posts
•
14874 Points
955
0
Posted September 21st, 2022 01:00
Hi,
Can you try the steps dwilliam62 mentioned on these two threads I found?
Tried to restart the active controller to force a failover, See if the passive can pick up the drives. The next step is to remove all the components, controllers, and drives, including the backplane sits in. make sure they are fully seated, and power it back up again.
reference links are:
https://dell.to/3S3k1Vk
https://dell.to/3S3k2sm
Hope that helps!
DELL-Erman O
Social Media and Communities Professional
Dell Technologies | Enterprise Support Services
#IWork4Dell
Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!