Unsolved
1 Rookie
•
19 Posts
0
101
[VNX5300] nas_fsck: Error 5: Input/output error
Hello,
my VNX5300 has experienced a couple of disk failures and a "Data Mover slot has panicked" issue.
All disks have been replaced, but the nas_checkup utility is reporting an unmounted/corrupt file system.
Unfortunately, when I run nas_fsck, it immediately returns an "Error 5: Input/output error".
As an older device, I do not have a support contract in place.
How can I fix this issue?
Thank you.
Andrea
-------------------------------------Errors-------------------------------------
Control Station: Check for correct filesystem mount options
Error HC_CS_14505082982: The following file systems were found to be
corrupted:
* MIC on server_2
Action :
Run "/nas/bin/server_mount ALL" manually to find the corrupted file
system. If the problem persists, escalate this issue through your
support organization if needed. Provide this output in the
escalation.
--------------------------------------------------------------------------------
[nasadmin@emc1-cs0 bin]$ /nas/bin/server_mount ALL
server_2 :
root_fs_2 on / uxfs,perm,rw
MIC-NFS-1 on /MIC-NFS-1 uxfs,perm,rw,<unmounted>,<corrupt>
MIC-NFS-3 on /MIC-NFS-3 uxfs,perm,rw
root_fs_common on /.etc_common uxfs,perm,ro
server_3 :
root_fs_3 on / uxfs,perm,rw,<unmounted>
root_fs_common on /.etc_common uxfs,perm,ro,<unmounted>
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fs -list
id inuse type acl volume name server
1 n 1 0 10 root_fs_1
2 y 1 0 40 root_fs_common 2,1
3 n 5 0 73 root_fs_ufslog
4 n 5 0 76 root_panic_reserve
5 n 5 0 93 root_fs_d3
6 n 5 0 94 root_fs_d4
7 n 5 0 95 root_fs_d5
8 n 5 0 96 root_fs_d6
9 y 1 0 12 root_fs_2 1
10 y 1 0 14 root_fs_3 2
62 y 1 0 294 MIC-NFS-1 1
64 y 1 0 298 MIC-NFS-3 1
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fs -info MIC-NFS-1
id = 62
name = MIC-NFS-1
acl = 0
in_use = True
type = uxfs
worm = off
volume = v294
pool = clarsas_archive
member_of = root_avm_fs_group_32
rw_servers= server_2
ro_servers=
rw_vdms =
ro_vdms =
auto_ext = no,thin=no
fast_clone_level = 1
deduplication =
stor_devs = CKM00122601493-0019,CKM00122601493-0016,CKM00122601493-0015,CKM00122601493-0012,CKM00122601493-0011,CKM00122601493-0018,CKM00122601493-0017,CKM00122601493-0014
disks = d34,d31,d30,d27,d26,d33,d32,d29
disk=d34 stor_dev=CKM00122601493-0019 addr=c0t1l9 server=server_2
disk=d34 stor_dev=CKM00122601493-0019 addr=c16t1l9 server=server_2
disk=d31 stor_dev=CKM00122601493-0016 addr=c0t1l6 server=server_2
disk=d31 stor_dev=CKM00122601493-0016 addr=c16t1l6 server=server_2
disk=d30 stor_dev=CKM00122601493-0015 addr=c0t1l5 server=server_2
disk=d30 stor_dev=CKM00122601493-0015 addr=c16t1l5 server=server_2
disk=d27 stor_dev=CKM00122601493-0012 addr=c0t1l2 server=server_2
disk=d27 stor_dev=CKM00122601493-0012 addr=c16t1l2 server=server_2
disk=d26 stor_dev=CKM00122601493-0011 addr=c0t1l1 server=server_2
disk=d26 stor_dev=CKM00122601493-0011 addr=c16t1l1 server=server_2
disk=d33 stor_dev=CKM00122601493-0018 addr=c0t1l8 server=server_2
disk=d33 stor_dev=CKM00122601493-0018 addr=c16t1l8 server=server_2
disk=d32 stor_dev=CKM00122601493-0017 addr=c0t1l7 server=server_2
disk=d32 stor_dev=CKM00122601493-0017 addr=c16t1l7 server=server_2
disk=d29 stor_dev=CKM00122601493-0014 addr=c0t1l4 server=server_2
disk=d29 stor_dev=CKM00122601493-0014 addr=c16t1l4 server=server_2
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fsck -start MIC-NFS-1 -monitor
Error 5: Input/output error
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fsck -start MIC-NFS-1 -mover server_2 -Force
Error 5: Input/output error
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$
abuzzi
1 Rookie
1 Rookie
•
19 Posts
0
October 11th, 2023 12:08
--2nd try--
I would greatly appreciate any tips or suggestions on how to bypass the "Error 5: Input/output error" when running nas_fsck. If necessary, I am willing to re-initialize the entire MIC-NFS-1, but it would be advisable to attempt data recovery first.
Thank you
abuzzi
1 Rookie
1 Rookie
•
19 Posts
0
October 21st, 2023 13:11
I've decided to give up on running nas_fsck.....
Now, I want to reformat the file system, but the ACLCHK process is preventing me from doing so. It has been a week since ACLCHK started running. How can I stop it?
[nasadmin@emc1-cs0 bin]$ /nas/bin/server_mount ALL
server_2 :
root_fs_2 on / uxfs,perm,rw
MIC-NFS-1 on /MIC-NFS-1 uxfs,perm,rw,<unmounted>,<corrupt>
MIC-NFS-3 on /MIC-NFS-3 uxfs,perm,rw
root_fs_common on /.etc_common uxfs,perm,ro
server_3 :
root_fs_3 on / uxfs,perm,rw,<unmounted>
root_fs_common on /.etc_common uxfs,perm,ro,<unmounted>
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fs -delete MIC-NFS-1
Error 3101: MIC-NFS-1 : filesystem is mounted, can not delete rw_servers=server_2
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fs -delete MIC-NFS-1 -Force
Error 3101: MIC-NFS-1 : filesystem is mounted, can not delete rw_servers=server_2
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ /nas/bin/server_umount server_2 MIC-NFS-1
server_2 :
Error 4425: server_2 : fs MIC-NFS-1 is running ACLCHK
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fsck -list -all
id type state volume name server
62 1 ACLCHK 294 MIC-NFS-1 1
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$ nas_fsck -info -all
ACLCHK: in progress for file system MIC-NFS-1
[nasadmin@emc1-cs0 bin]$
[nasadmin@emc1-cs0 bin]$