Skip to main content
Start a Conversation

Unsolved

This post is more than 5 years old

AnnaLisa1

30 Posts

1956

May 9th, 2011 09:00

Ask Proven: How can the growing digital information be managed?

Please provide your insight to the next generation of IT Professionals! Reply to this thread and provide your input. Don't forget to include your name, location, and certification credentials.

                                       "How can the growing digital information be managed?"

                                                                                    - Mark Smith, Student

Want to see more Q&A?? Click here for the complete list.

chilkuru

32 Posts

May 9th, 2011 22:00

Hi Mark,

Managing the digital information from it's birth to grave is specifically termed as 'Information Lifecycle Management'

This can be done by using tiered storage implementations.

For example a new sales order is received by a company and the data is very critical, accessed frequently so the information is placed in a tier 1 storage like Symmetrix, Clariion which can accept higher I/Os.

Once the order has been fullfilled, now comes the warranty period and the data is less frequently accessed so the data is backed up using products like Avamar, Networker which accept less I/Os and cost less for same data to be stored.

After the warranty period is over the data is most infrequently accessed so the data may be archived for compliance/retention purposes and hence it will be archived in tapes using products like Data Domain, EMC Source One which cost even less for storing the data.

By using the tiered approach and based on the value of information the data is stored in different storage types. EMC is a company which provides complete portfolio for enterprises to meet their storage demands according to their Information Lifecycle Management strategies.

My name is Chilkuru Ragunath. I am working as Associate Software Engineer with EMC Corporation, India. My cerifications include E20-001, E20-040.

anuj1986

24 Posts

May 11th, 2011 10:00

Hi ,

There are  different kind of data briefly Structured and Unstructured Data . Structured Data is stored in databases and rest data is unstructured and most of the the data is unstructured . The challenge lies in managing this unstuctured data and that has lead to the concept of Big Data .

What is Big Data
Big Data refers to massive, often unstructured data that is beyond the processing capabilities of traditional data management tools. Big Data can take up terabytes and petabytes of storage space in diverse formats including text, video, sound, images, and so on. A good example would be websites like Facebook or Twitter, which have data growing by the day. Traditional relational database management systems cannot deal with such large masses of data.

Kinds of Big Data
Big Data consists of such data as search indexes, image and video archives, social networks, research data generated by R&D centers, weather and surveillance data from satellites and other sources, archives of all kinds: company records, medical records, the data generated in such data-heavy fields as astronomy, genomics, economics, and so on. All this data is now being stored digitally, leading to massive accumulation of digital data.

Technological impact
Big Data requires vast storage capacity and new kinds ofdata mining tools to make it accessible and useful. Major data storage vendors such as EMC, IBM, Hitachi are developing new products to meet Big Data needs. Companies such as Greenplum (EMC) are investing heavily in Big Data mining tools. Big Data mining tools requireparallel processing capabilities and storage media with high data throughput rates.

Impact of Big Data on datacenters and datacenter professionals

  • Big Data throws up vast quantities of data to work with. Datacenters will see larger workloads due to Big Data.
  • Datacenter professionals must store, process, and secure what is literally an explosion of data. They may need to develop new skills to stay competitive.

What to consider while evaluating Big Data products

  • Data storage vendors have begun introducing Big Data products. Pay attention to the maximum file system size supported, and the maximum data throughput rate of the storage media being offered.
  • Focus on data transfer rate instead of the IOPS (input/ output operations per second) of the storage media. High IOPS makes better sense when dealing with smaller quantities of data.
  • Big Data needs software tools that can process data significantly faster than traditional data mining tools. It is recommended to ensure that the Big Data hardware and software are mutually compatible. Vendors may recommend using specific Big Data hardware and software together, which has been tested and certified by them for compatibility. For optimum performance, it is also recommended to purchase both solutions from the same vendor.

The future of Big Data

  • The pool of digital data is expected to grow steadily. New digital data is being generated every day by individuals on the internet, by governments and businesses, by universities and research laboratories, by media houses, and by organizations of every size.
  • There is a demand for a new generation of storage media and analytical software that can handle the vast storage and processing requirements of Big Data.
  • Big Data is piped to be the hot new IT trend for 2011.

This is Anuj Sharma working with EMC in India .

EMC CLOUD Architect (Virtualized Data Center and Cloud Infrastructure Design Specialist)

ITIL V3 Foundations Certified
VMware VCP 4.1 Certified
Implementation Engineer, CLARiiON Solutions Specialist Version 5.0 Certified (EMCIE)
EMC CLARiiON Solutions Technology Architect Certification Exam (EMCTA)
Implementation Engineer, Backup and Recovery-Avamar Specialist Certified (EMCIE)
EMC Networker Backup and Recovery Specialist Certfied.(EMCSA)
EMC DataDomain System Administrator
EMC Information and Storage Management Certified. (EMCPA)
EMC Accredited Service Professional.

View More

View All

No Events found!

Top