Start a Conversation

Unsolved

1 Rookie

 • 

19 Posts

78

October 6th, 2023 08:48

[VNX5300] nas_fsck: Error 5: Input/output error

Hello,

my VNX5300 has experienced a couple of disk failures and a "Data Mover slot has panicked" issue.

All disks have been replaced, but the nas_checkup utility is reporting an unmounted/corrupt file system.

Unfortunately, when I run nas_fsck, it immediately returns an "Error 5: Input/output error".

As an older device, I do not have a support contract in place.

How can I fix this issue?

Thank you.

Andrea

-------------------------------------Errors-------------------------------------

Control Station: Check for correct filesystem mount options

Error HC_CS_14505082982: The following file systems were found to be

         corrupted:

         * MIC on server_2

Action :

 

          Run "/nas/bin/server_mount ALL" manually to find the corrupted file

          system. If the problem persists, escalate this issue through your

          support organization if needed. Provide this output in the

          escalation.

 

--------------------------------------------------------------------------------

 

[nasadmin@emc1-cs0 bin]$ /nas/bin/server_mount ALL

server_2 :

root_fs_2 on / uxfs,perm,rw

MIC-NFS-1 on /MIC-NFS-1 uxfs,perm,rw,<unmounted>,<corrupt>

MIC-NFS-3 on /MIC-NFS-3 uxfs,perm,rw

root_fs_common on /.etc_common uxfs,perm,ro

 

server_3 :

root_fs_3 on / uxfs,perm,rw,<unmounted>

root_fs_common on /.etc_common uxfs,perm,ro,<unmounted>

 

[nasadmin@emc1-cs0 bin]$

[nasadmin@emc1-cs0 bin]$ nas_fs  -list

id      inuse type acl   volume    name                server

1         n    1   0     10        root_fs_1

2         y    1   0     40        root_fs_common      2,1

3         n    5   0     73        root_fs_ufslog

4         n    5   0     76        root_panic_reserve

5         n    5   0     93        root_fs_d3

6         n    5   0     94        root_fs_d4

7         n    5   0     95        root_fs_d5

8         n    5   0     96        root_fs_d6

9         y    1   0     12        root_fs_2           1

10        y    1   0     14        root_fs_3           2

62        y    1   0     294       MIC-NFS-1           1

64        y    1   0     298       MIC-NFS-3           1

 

[nasadmin@emc1-cs0 bin]$

[nasadmin@emc1-cs0 bin]$ nas_fs -info MIC-NFS-1

id        = 62

name      = MIC-NFS-1

acl       = 0

in_use    = True

type      = uxfs

worm      = off

volume    = v294

pool      = clarsas_archive

member_of = root_avm_fs_group_32

rw_servers= server_2

ro_servers=

rw_vdms   =

ro_vdms   =

auto_ext  = no,thin=no

fast_clone_level = 1

deduplication   =

stor_devs = CKM00122601493-0019,CKM00122601493-0016,CKM00122601493-0015,CKM00122601493-0012,CKM00122601493-0011,CKM00122601493-0018,CKM00122601493-0017,CKM00122601493-0014

disks     = d34,d31,d30,d27,d26,d33,d32,d29

disk=d34   stor_dev=CKM00122601493-0019 addr=c0t1l9         server=server_2

disk=d34   stor_dev=CKM00122601493-0019 addr=c16t1l9        server=server_2

disk=d31   stor_dev=CKM00122601493-0016 addr=c0t1l6         server=server_2

disk=d31   stor_dev=CKM00122601493-0016 addr=c16t1l6        server=server_2

disk=d30   stor_dev=CKM00122601493-0015 addr=c0t1l5         server=server_2

disk=d30   stor_dev=CKM00122601493-0015 addr=c16t1l5        server=server_2

disk=d27   stor_dev=CKM00122601493-0012 addr=c0t1l2         server=server_2

disk=d27   stor_dev=CKM00122601493-0012 addr=c16t1l2        server=server_2

disk=d26   stor_dev=CKM00122601493-0011 addr=c0t1l1         server=server_2

disk=d26   stor_dev=CKM00122601493-0011 addr=c16t1l1        server=server_2

disk=d33   stor_dev=CKM00122601493-0018 addr=c0t1l8         server=server_2

disk=d33   stor_dev=CKM00122601493-0018 addr=c16t1l8        server=server_2

disk=d32   stor_dev=CKM00122601493-0017 addr=c0t1l7         server=server_2

disk=d32   stor_dev=CKM00122601493-0017 addr=c16t1l7        server=server_2

disk=d29   stor_dev=CKM00122601493-0014 addr=c0t1l4         server=server_2

disk=d29   stor_dev=CKM00122601493-0014 addr=c16t1l4        server=server_2

[nasadmin@emc1-cs0 bin]$

[nasadmin@emc1-cs0 bin]$

[nasadmin@emc1-cs0 bin]$ nas_fsck -start MIC-NFS-1 -monitor

Error 5: Input/output error

[nasadmin@emc1-cs0 bin]$

[nasadmin@emc1-cs0 bin]$ nas_fsck -start MIC-NFS-1 -mover server_2 -Force

Error 5: Input/output error

[nasadmin@emc1-cs0 bin]$

[nasadmin@emc1-cs0 bin]$

 

1 Rookie

 • 

19 Posts

October 11th, 2023 12:08

--2nd try--

I would greatly appreciate any tips or suggestions on how to bypass the "Error 5: Input/output error" when running nas_fsck. If necessary, I am willing to re-initialize the entire MIC-NFS-1, but it would be advisable to attempt data recovery first.

Thank you

1 Rookie

 • 

19 Posts

October 21st, 2023 13:11

I've decided to give up on running nas_fsck.....

Now, I want to reformat the file system, but the ACLCHK process is preventing me from doing so. It has been a week since ACLCHK started running. How can I stop it?

[nasadmin@emc1-cs0 bin]$ /nas/bin/server_mount ALL
server_2 : 
root_fs_2 on / uxfs,perm,rw
MIC-NFS-1 on /MIC-NFS-1 uxfs,perm,rw,<unmounted>,<corrupt>
MIC-NFS-3 on /MIC-NFS-3 uxfs,perm,rw
root_fs_common on /.etc_common uxfs,perm,ro

server_3 : 
root_fs_3 on / uxfs,perm,rw,<unmounted>
root_fs_common on /.etc_common uxfs,perm,ro,<unmounted>

[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ 

[nasadmin@emc1-cs0 bin]$ nas_fs -delete MIC-NFS-1
Error 3101: MIC-NFS-1 : filesystem is mounted, can not delete  rw_servers=server_2
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fs -delete MIC-NFS-1 -Force
Error 3101: MIC-NFS-1 : filesystem is mounted, can not delete  rw_servers=server_2
[nasadmin@emc1-cs0 bin]$ 

[nasadmin@emc1-cs0 bin]$ /nas/bin/server_umount server_2 MIC-NFS-1
server_2 : 
Error 4425: server_2 : fs MIC-NFS-1 is running ACLCHK
[nasadmin@emc1-cs0 bin]$ 
[nasadmin@emc1-cs0 bin]$ 

[nasadmin@emc1-cs0 bin]$ nas_fsck -list -all
id      type  state        volume name            server
62      1     ACLCHK       294    MIC-NFS-1       1
[nasadmin@emc1-cs0 bin]$ 
[nasadmin@emc1-cs0 bin]$ 

[nasadmin@emc1-cs0 bin]$ nas_fsck -info -all
ACLCHK: in progress for file system MIC-NFS-1

[nasadmin@emc1-cs0 bin]$ 
[nasadmin@emc1-cs0 bin]$ 

No Events found!

Top