Start a Conversation

Unsolved

J

1 Message

3625

November 26th, 2018 01:00

Inline Deduplication and Compression

Hi

I think that the isilon dosent have inline deduplication and thereisn´t the compression functionality

It this statement correct?

Somebody know if there will be a roadmap when it will be available these charactersitics ??


Thanks

450 Posts

November 27th, 2018 06:00

Correct, Isilon's SmartDedupe functionality is fixed-length block deduplication of the data at-rest.

Inline? 

Why would you ever want it?  I ask, because the logic is different with Isilon than most scale-out NAS platforms where this kind of thing is offered now and then. 

Scale-up logic for dedupe

Think of it this way, in a scale-up NAS, you have small filesystems, usually with 16 or 64TB max sizes, (of course that's changing some).  Those small filesystems though have limits on their capacity which is the point, and when they grow they consume space from some underlying pool which is comprised, itself of raid groups.  So by temporarily using disk space, if the volume or filesystem has to grow, you've eaten up something real, disk space on the pool backing the volume. 

Scale-out logic for dedupe

But with Isilon?  The whole cluster is a single gigantic filesystem, and that could be 100TB or 50+PB.  So using a bit more space temporarily and then shrinking the data down after the fact as a low-priority job, in the background, is far more efficient than trying to waste CPU cycles or RAM and slow down an incoming write to dedupe the data before it's written.

Make sense?  The only value I could see here would be for an RFP check-box, when someone demands the feature even though they don't know why they really want it.

For any roadmap discussions (to which I have no insight as a DellEMC Select partner), of course contact your DellEMC account team.  And please if you can think of a reason why this would be valuable outside of what I described, pass it along, and ask them to submit an RFE (request for enhancement).

Chris Klosterman

Principal Pre-Sales Consultant, Datadobi

chris.klosterman@datadobi.com

252 Posts

November 27th, 2018 09:00

To add to what Chris already stated, here is the white paper on SmartDedupe
https://www.emc.com/collateral/white-paper/h12395-isilon-smartdedupe-wp.pdf

Here is the original technical demo published by Dell EMC:
Technical Demo: EMC Isilon SmartDedupe - YouTube

No Events found!

Top