Paconet1

updated

13 years ago

P

Paconet1

1 Rookie

•

68 Posts

1

1966

October 15th, 2013 12:00

file protection overhead

Hi Everyone

I am studing about overhead

In the book

I saw this example

1 MB file @ 4+1  (5 node cluster)

data blocks               Metadata

mirroring                    mirroring

128 * 8KB blocks @ 5/4 + (512 @ 2X)  = 1.251 MB file

1.- What is the meaning of @?

2.-How do I get the value 1.251MB

Because I get a 1MB file, I divide the 1MB between 128, because the stripe unit in the Isilon is 128

the value is 7.8  almost 8

I got the 8 stripe unit

I suppose that I get 2 stripe unit more by parity, If I distribute the unit stripe in the nodes

Could you help to get the overhead?

Is correct my idea?

Thanks

  • Paconet1

    1 Rookie

    •

    68 Posts

    1467

    0

    Posted October 17th, 2013 16:00

    Hi Antonio

    Thanks

    for your answer

    I clarify the concept @

    and I understand the concept

    but If I drill down the concept of stripe unit

    My 1MB file,  will It divide in 8 unit stripe

    1MB/128KB =almost 8 unit stripe

    I have a N+1 protection

    could I get 2  unit stripe more by the parity?

    So Do I have 10 unit stripe in total?

    Thanks

  • 1467

    1

    Posted October 16th, 2013 10:00

    I hope someone will correct me if I'm wrong but this is what I think:

    the @ sign is just telling you "at what protection level".

    the "@ 5/4" is referring to the 4+1 data protection you have. The parity would be an extra 25% of the total file (an extra 1 parity stripe for 4 data stripes).

    For the metatdata the "@ 2x" refers to  2x mirroring. Remember ALL metadata is mirrored and since metadata in itself is considered overhead, all of it is calculated as such.

    So if you look @ it (see what i did there?)  like this, the mirrored metadata from above is equal to 1mb and 25% of the 1 mb file that will represent the overhead is the .251 of the file.

    I hope this helps!

  • 1467

    1

    Posted October 17th, 2013 19:00

    you got it right on. Note that 1mb is actually equal to 1024kb and that DOES equal out to 8 units exactly.

    it would end up being 8 data stripes and 2 parity stripes for a total of 10.

  • Paconet1

    1 Rookie

    •

    68 Posts

    1467

    0

    Posted November 5th, 2013 13:00

    Thanks

    For your answer

  • smaug1

    17 Posts

    1467

    0

    Posted November 5th, 2013 14:00

    To clarify one point, there are only 2 stripes, or protection groups, in this example.  The 128kB data chunks are referred to as stripe units, so the four data and one parity stripe unit make up a stripe of 512kB + 128kB. 

    N M_Protection.jpg

  • Paconet1

    1 Rookie

    •

    68 Posts

    1467

    0

    Posted November 13th, 2013 10:00

    With that picture

    I understand the stripe unit

    Thanks