> Can someone either let me know what the max NFS thread count is for Isilon either per node or cluster or let me know where I can find this information? I have a customer running into perf issues with an NS due to the 256 thread-count limit and want to know if Isilon would fix this.
From the
White Paper
NEXT-GENERATION GENOME SEQUENCING USING EMC ISILON SCALE-OUT NAS: SIZING AND PERFORMANCE GUIDELINES
July 2013
On page 18:
NFS number of threads: This is the number of NFS server daemon threads that are started when the system boots. The OneFS NFS server usually has 16 threads as its default setting; this value can be changed via the Command Line Interface (CLI):
"For files under 128Kib, OneFS will mirror the files and not stripe them. The number of mirrors will depend on your protection level. Let's assume the default of N+2:1. So for example a 32Kib file will take a total of 98 Kib of real physical space. 32Kib * 3 (3x mirroring on N+2:1) = 96 Kib + 2 Kib inode overhead. The inode overhead is variable depending on the number of ACLs, the file size and some other factors, but using 2-4Kib/file is reasonable on average."
Peter_Sero
4 Operator
•
1.2K Posts
0
August 14th, 2013 03:00
> Can someone either let me know what the max NFS thread count is for Isilon either per node or cluster or let me know where I can find this information? I have a customer running into perf issues with an NS due to the 256 thread-count limit and want to know if Isilon would fix this.
From the
White Paper
NEXT-GENERATION GENOME SEQUENCING USING EMC ISILON SCALE-OUT NAS: SIZING AND PERFORMANCE GUIDELINES
July 2013
On page 18:
NFS number of threads: This is the number of NFS server daemon threads that are started when the system boots. The OneFS NFS server usually has 16 threads as its default setting; this value can be changed via the Command Line Interface (CLI):
isi_sysctl_cluster sysctl vfs.nfsrv.rpc.[minthreads,maxthreads]
Increasing the number of NFS daemon threads improves response minimally; the maximum number of NFS threads needs to be limited to 64.
(quote end)
I think that's 64 per node (isi_sysctl_cluster just spreads the setting to all nodes.)
And wether 64 Isilon threads do better or worse than 256 "brand X" threads
is up to the implementations; you might need to do tests.
-- Peter
MRWA
83 Posts
0
August 12th, 2013 12:00
Hello DC9707
I do not know on the nfs threads question, but the following thread has some good answers on file sizes. and mirroring/striping
https://community.emc.com/thread/178281
In particular Andrew Chung mentions:
"For files under 128Kib, OneFS will mirror the files and not stripe them. The number of mirrors will depend on your protection level. Let's assume the default of N+2:1. So for example a 32Kib file will take a total of 98 Kib of real physical space. 32Kib * 3 (3x mirroring on N+2:1) = 96 Kib + 2 Kib inode overhead. The inode overhead is variable depending on the number of ACLs, the file size and some other factors, but using 2-4Kib/file is reasonable on average."
The whole thread is definitely worth reading imo.
-Michael