Highlighted
RolandFritz
1 Copper

ECS Index Questions

Jump to solution

1. What is used to to provide the ECS Index?

2. How large can the Index be on ECS 2.2?

3. Is there a limit on the amount of metadata per object?  If so, what's the maximum?

Tags (3)
1 Solution

Accepted Solutions
JasonCwik
2 Iron

Re: ECS Index Questions

Jump to solution

1. ECS uses its own proprietary database to store the index

2. The index size is unlimited.  ECS shares all its disks for storing both data and index, so there's no limitations where only some drives are storing the index.

3. The internal limit is 2MB per object, but due to the way the S3 protocol works, you will only get around 4kB of metadata per object before you reach the maximum size of HTTP headers.

0 Kudos
3 Replies
JasonCwik
2 Iron

Re: ECS Index Questions

Jump to solution

1. ECS uses its own proprietary database to store the index

2. The index size is unlimited.  ECS shares all its disks for storing both data and index, so there's no limitations where only some drives are storing the index.

3. The internal limit is 2MB per object, but due to the way the S3 protocol works, you will only get around 4kB of metadata per object before you reach the maximum size of HTTP headers.

0 Kudos
RolandFritz
1 Copper

Re: ECS Index Questions

Jump to solution

Thanks very much Jason.

0 Kudos
MattEMC
1 Nickel

Re: ECS Index Questions

Jump to solution

Hi Jason,

I work on a migration from AMOS to ECS.

So we know the capacity and the number of small and large object store on ATMOS (CAS and REST).

We have to size ECS and we have to evaluate the overhead of metada and index on ECS.

I know that ECS :

> require to have a minimum of 10% of free space

> system metadata and index are protected by 3 mirror (no erasure coding)

How we can calculate the ovehead for metadata and index ?

Thanks for your help.

Matthieu

0 Kudos