Start a Conversation

Unsolved

This post is more than 5 years old

T

10680

February 7th, 2018 13:00

EMC VNXe SP stuck in Service Mode

I have been have an issue reconfiguring an EMC VNXe 3150. Currently, I have managed to get to the point where I can now access EMC Unisphere (Service Mode) but the single Storage Processor is unable to exit Service Mode.

Storage Processor: SPA (Primary)

Status: There is a problem with the system software on this Storage Process (SP).

Recommended Action: Reimage this SP to attempt to correct the system software problem.

I attempted the Reimage to recover the SP software configuration via Unisphere and via SSH but that didn't work.

service@spa spa:~> svc_reimage -r

###############################################################################

WARNING: This action will reimage the SSD and rebuild it from the Backend!!

###############################################################################

Enter "yes" if want to proceed with this action: yes

Clearing boot counters...

        Resetting boot control data to initial defaults...

Clearing bootflash boot block

Rescue Mode

100+0 records in

100+0 records out

51200 bytes (51 kB) copied, 0.00728396 s, 7.0 MB/s

Setting reimage reboot reason thru peer...

ssh: connect to host peer port 22: No route to host

*** WARNING *** This Storage Processor is in Service Mode  *** WARNING ***

*** Run "svc_diag --state=basic" to view more system state information ***

When I try to reinitialize the storage unit via SSH, it fails with the errors below.

service@spa spa:~> svc_reinit

###############################################################################

WARNING: This action will reimage the system and set it to a factory state!!

All data and all settings will be erased!!

###############################################################################

Enter "yes" if want to proceed with this action: yes

Checking if both SPs are in Service mode...

Rescue Mode

Reiniting Backend...

Creating device for disk <0> starting at sector <0x0>

Zeroing out sector <0x1000> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.0147188 s, 34.8 kB/s

Zeroing out sector <0x1400> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.001892 s, 271 kB/s

Zeroing out sector <0x291a0a8> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.00788508 s, 64.9 kB/s

Creating device for disk <1> starting at sector <0x0>

Zeroing out sector <0x1000> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.0142442 s, 35.9 kB/s

Zeroing out sector <0x1400> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.0015092 s, 339 kB/s

Zeroing out sector <0x291a0a8> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.00779338 s, 65.7 kB/s

Creating device for disk <2> starting at sector <0x0>

Zeroing out sector <0x1000> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.0134204 s, 38.2 kB/s

Zeroing out sector <0x1400> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.00280937 s, 182 kB/s

Zeroing out sector <0x291a0a8> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.00777899 s, 65.8 kB/s

Creating device for disk <3> starting at sector <0x0>

Zeroing out sector <0x1000> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.0141424 s, 36.2 kB/s

Zeroing out sector <0x1400> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.00309453 s, 165 kB/s

Zeroing out sector <0x291a0a8> on asidc device

1+0 records in

1+0 records out

512 bytes (512 B) copied, 0.00730093 s, 70.1 kB/s

Clearing Local NVRAM...

Clearing Local memory persistency

Clearing Local boot control data

Recreating local service partition

umount: /dev/mirrora4: not found

mke2fs 1.41.1 (01-Sep-2008)

Could not stat /dev/mirrora4 --- No such file or directory

The device apparently does not exist; did you specify it correctly?

ERROR: Failed to recreate local service partition!

*** WARNING *** This Storage Processor is in Service Mode  *** WARNING ***

*** Run "svc_diag --state=basic" to view more system state information ***

I have tried everything I could think of and all the "fixes" I could find online but it always returns to the Service Mode warning.

*** WARNING *** This Storage Processor is in Service Mode  *** WARNING ***

*** Run "svc_diag --state=basic" to view more system state information ***

I also tried exiting Service Mode manually via SSH, still not working.

service@spa spa:~> svc_rescue_state -c

        Resetting boot control data to initial defaults...

*** WARNING *** This Storage Processor is in Service Mode  *** WARNING ***

*** Run "svc_diag --state=basic" to view more system state information ***

Any ideas?

18 Posts

February 8th, 2018 02:00

Sounds like valiant attempts to resolve, but now is the time to open a DELL EMC Service support call for assistance.

February 8th, 2018 03:00

The device was purchased second hand and no longer under support contract.

8.6K Posts

February 8th, 2018 05:00

then I would suggest to contact the company that sold it to you and ask them to fix it

February 8th, 2018 06:00

That's not an option either unfortunately.

1.2K Posts

February 8th, 2018 09:00

Dell|EMC might also be able to provide time-and-materials service for the hardware.  It's worth opening an SR or reaching out to a local CE or Partner to get a quote for you.  I've found prices are quite reasonable, and if you're interested in getting any life out of such hardware, it's not a bad investment.

No Events found!

Top