March 17, 2016
Veritas Technologies this week released the results of its Global Databerg Report. The survey reveals that 52% of all information currently stored and processed by organizations around the world is considered ‘dark’ data, whose value is unknown.
Additionally, another 33% of data is considered redundant, obsolete, or trivial (ROT) and is known to be useless. If left untamed, this dark and ROT business data will unnecessarily cost organizations around the world a cumulative $3.3 trillion to manage by the year 2020.
Organizations are creating and storing data at an ever-increasing rate due to a ‘data hoarding’ culture and an indifferent attitude to retention policy, the company said, adding that this data could be anything from valuable business information to non-compliant information.
The report reveals that IT leaders consider just 15% of all stored data to be classified as business critical information. For the average midsized organization holding 1000TB of data, the cost to store their non-critical information is estimated at more than $650,000 annually.
“Understanding and acknowledging that a data hoarding culture exists is a first step in addressing the problem,” said Ben Gibson, chief marketing officer of Veritas. “More and more organizations are realizing it. The problem most face is they do not know what data to start with, what risk it may contain and where the value is discovered. Once they have visibility into that environment, they can make decisions faster, with more confidence, and bring in other business stakeholders to move forward with a well-conceived plan.”
The Veritas Global Databerg Report provides insights from over 2,500 IT professionals in 22 countries. It follows the company’s introduction of the Data Genomics Index, what it describes as the “the industry’s first accurate view of the composition of enterprise data based on analysis of billions of files.”
The Data Genomics Index found that over 40% of stored data has not been touched in over three years, and is considered ‘stale.’ The Vast Majority of Business Data Sits Below the Waterline
Around the world, the Global Databerg Report found that on average 52% of all stored data is dark. Dark data could either be redundant, obsolete or trivial (ROT) or valuable clean business data.
At 64% (a large 12% above the global average), Canada is the second worst dark data offender, behind only Germany’s 66% and ahead of Australia’s 62%. The U.S. is in a mid-range position at 54% of their data being unknown. The highest proportion of clean and identified business critical data was found in China (25% clean), Israel (24% clean) and Brazil (22% clean). But this still means that more than 75% of all data they are storing is dark or has no value for the business. At 13%, Canada’s clean data level is 2% below the global average.
A Fear of the Delete Key: “ROT data has already been identified by organizations as redundant, obsolete or trivial and provides little or no business value,” Veritas said. “But still 48% of all stored data in Denmark, 44% in the Netherlands and 43% of all data in the United Arab Emirate (43%) belongs to this category. In the U.S., 30% is ROT data. At 23%, Canada’s ROT data is 10% lower than the global average of 33%.