UNSOLVED

igmacak

updated

3 years ago

I

igmacak

5 Posts

0

1188

November 3rd, 2020 07:00

VNXe 3150 SP doesn't contain a valid partition table

Hello All,

Due to unexpected power outage both storage procesors end up in service mode (flashing blue and amber light every second) on our VNXe 3150. 

During booting sequence we can see that disk  /dev/asibios0b doesn't contain a valid partition table.

Logs:
2020-11-03 07:15:54 Entering firmware update phase
2020-11-03 07:15:55 Writing firmware images to the backend
2020-11-03 07:15:56 0:0x10000:0x1000:/dev/asiddbs0a
2020-11-03 07:15:59 Disk /dev/asiddbs0a doesn't contain a valid partition table
2020-11-03 07:16:00 0:0x12a00:0x8000:/dev/asibios0b
2020-11-03 07:16:47 Disk /dev/asibios0b doesn't contain a valid partition table
2020-11-03 07:17:21
2020-11-03 07:17:21 Found DDBS image /EMC/Firmware/EVERGREEN-ddbs ; size = 65536 bytes
2020-11-03 07:17:21 device asiddbs0a created successfully...
2020-11-03 07:17:21 Image /EMC/Firmware/EVERGREEN-ddbs matches what's already on device asiddbs0a
2020-11-03 07:17:21
2020-11-03 07:17:21 Found BIOS image /EMC/Firmware/EVERGREEN-intermediate-bios ; size = 2293760 bytes
2020-11-03 07:17:21 device asibios0b created successfully...
2020-11-03 07:17:21 Failed to write image/EMC/Firmware/EVERGREEN-intermediate-bios to asidc device asibios0b
2020-11-03 07:17:21 Failed to write /EMC/Firmware/EVERGREEN-intermediate-bios to asidc device asibios0b
2020-11-03 07:17:21 Failed to write intermediate firmware images to backend.
2020-11-03 07:17:21 =================================================================
2020-11-03 07:17:21 === *** Going into service mode because of a fault *** ===
2020-11-03 07:17:21 =================================================================
2020-11-03 07:17:21 === When escalating to platform services, please make sure to ===
2020-11-03 07:17:21 === include the messages ABOVE this notice. You can ignore ===
2020-11-03 07:17:21 === any errors below. ===
2020-11-03 07:17:21 =================================================================

Looks like system partion is damaged. 
do we need to re-image SP with svc_reimage ?

Also noticed that ssd partion is reporting warning as well

2020-11-03 07:15:06 --- WARNING: Mounting the ssd failed.
2020-11-03 07:15:08 0:0x9000:0x100:/dev/sedlb0
2020-11-03 07:15:10 1:0x9000:0x100:/dev/sedlb1
2020-11-03 07:15:11 2:0x9000:0x100:/dev/sedlb2
2020-11-03 07:15:12 Warning: Could not retrieve primary lockbox.
2020-11-03 07:15:12 Warning: Could not get local SSD backup lockbox.
2020-11-03 07:15:12 Warning: Could not get local bootflash block backup lockbox. 

I would appreciate any advice on this how to proceed further ?  

thank you

  • DELL-Josh Cr

    Community Manager

    9694 Posts

    43679 Points

    933

    0

    Posted November 3rd, 2020 15:00

    Hi,

    I would try to reboot again and see if it comes up. You may also want to reseat the SPs. If that doesn’t work you may need to reimage them.

  • igmacak

    5 Posts

    915

    0

    Posted November 4th, 2020 05:00

    Hello Josh, thanks for reply...we have tried to clear boot counters, reboot SP as well as reimage..however ending up with the same issue. Looks like it cannot mount stystem partion.

    service@spb spb:~> svc_reimage -r
    ###############################################################################
    WARNING: This action will reimage the SSD and rebuild it from the Backend!!
    ###############################################################################
    Enter "yes" if want to proceed with this action: yes
    Clearing boot counters...
    Resetting boot control data to initial defaults...
    Clearing bootflash boot block
    Rescue Mode
    mount: you must specify the filesystem type
     --- WARNING: Could not preserve memory persistence configuration
    100+0 records in
    100+0 records out
    51200 bytes (51 kB) copied, 0.00170112 s, 30.1 MB/s
    100+0 records in
    100+0 records out
    51200 bytes (51 kB) copied, 0.00165254 s, 31.0 MB/s
    Setting reimage reboot reason thru peer...
    INFO: spb - ready to complete reimage...
    *** WARNING *** This Storage Processor is in Service Mode  *** WARNING ***
    
    *** Run "svc_diag" to view system info or "help" for service commands  ***
    
    service@spb spb:~> [  993.339868] Restarting system.

     

     

  • igmacak

    5 Posts

    910

    0

    Posted November 4th, 2020 09:00

    Thanks , unfortunatelly this VNXe is not under support anymore.

  • DELL-Josh Cr

    Community Manager

    9694 Posts

    43679 Points

    912

    0

    Posted November 4th, 2020 09:00

    I think the best option is for you call phone support, they may need to remote into your SPs.

  • DELL-Josh Cr

    Community Manager

    9694 Posts

    43679 Points

    907

    0

    Posted November 4th, 2020 10:00

    it should take it out of service mode and try to boot normally. 

  • DELL-Josh Cr

    Community Manager

    9694 Posts

    43679 Points

    909

    0

    Posted November 4th, 2020 10:00

    Try svc_reimage --clear and rebooting

  • igmacak

    5 Posts

    906

    0

    Posted November 4th, 2020 10:00

    We have already tried to remove boot counters and boot to normal mode, but still stuck in service mode after reboot

    svc_rescue_state -c

    svc_shutdown -r

    Strange is that reimage procedure took just approx 2 minutes and disaplying errors 

    mount: you must specify the filesystem type
    --- WARNING: Could not preserve memory persistence configuration



    service@spb spb:~> svc_rescue_reason
    0x0000



    From boot procedure it looks like it cannot mount ssd partition due to missing filesystem type

    2020-11-04 12:04:18 INFO: mounting ssd ...
    2020-11-04 12:04:18 mount: you must specify the filesystem type
    2020-11-04 12:04:18 --- WARNING: Mounting the ssd failed.
    2020-11-04 12:04:19 0:0x9000:0x100:/dev/sedlb0
    2020-11-04 12:04:21 1:0x9000:0x100:/dev/sedlb1
    2020-11-04 12:04:23 2:0x9000:0x100:/dev/sedlb2
    2020-11-04 12:04:23 Warning: Could not retrieve primary lockbox.
    2020-11-04 12:04:23 Warning: Could not get local SSD backup lockbox.
    2020-11-04 12:04:23 Warning: Could not get local bootflash block backup lockbox.
    2020-11-04 12:04:23 ssh: Could not resolve hostname peer: Name or service not known

     

  • igmacak

    5 Posts

    908

    0

    Posted November 4th, 2020 10:00

    Thanks Josh, I didnt find "--clear" option in the manual with service commands, can you please provide some info what it does ? 

  • DELL-Josh Cr

    Community Manager

    9694 Posts

    43679 Points

    904

    0

    Posted November 4th, 2020 11:00

    Ok, yeah I don’t have anything else to try, it is probably replace the SPs or pay for fee based phone support.

  • falkon.alex

    1 Message

    0

    0

    Posted October 24th, 2023 17:12

    @igmacak​ was you able to find solution for your problem or not? I have exactly the same problem with our 3150 model and can't fix it

    DELL-Sam L

    Community Manager

    8058 Posts

    34386 Points

    0

    October 24th, 2023 21:43

    Hello falkon.alex,

    If you have tried all the steps listed in the post, then you will need to open a support case to get your issue resolved.