I read a lot about Big Data these days, from how cops are using it to predict crime patterns to how the WHO is tracking the spread of epidemics to better provide resources and care to the sick. There are a flood of articles about Big Data, followed by another flood of reports. It was last year's #2 word of the year from Time Magazine. And I've always wondered--all of this data is created, but where is it stored?

Wired recently published an article called Is the Internet of Things creating Data Hoarders? and this particular piece caught my eye:

Take for example, “dark data,” which is typically files, presentations, reports, images, and emails that are stockpiled but not analyzed, used or otherwise monetized. Dark data not only consumes valuable storage, network and management resources, it increases liability unless proactively purged using pre-established criteria for defensible deletion.

I have to admit, I'm guilty of hoarding some forms of dark data. I keep every email notification from this community, for example, just to make sure I have a record of the things that community members have said, requested, or shared. Do I need all these emails? Probably not, since I can just search the content list for the community. Will I delete these emails? Probably not, because "just in case."

I'm curious to know if any of you are data hoarders, or are working on projects that can help prevent hoarding of useless data. The article suggests creating automated processes for deleting data that doesn't meet a certain criteria. Has anyone set up such a process?