By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: The Case for Data Hoarding
Share
Notification Show More
Latest News
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
ai in omnichannel marketing
AI is Driving Huge Changes in Omnichannel Marketing
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Warehousing > The Case for Data Hoarding
Big DataData Warehousing

The Case for Data Hoarding

MIKE20
Last updated: 2012/12/17 at 4:10 PM
MIKE20
4 Min Read
SHARE

Do we really need all of this data?

Contents
ConsiderationsSimon SaysFeedback

It’s a question that I’ve heard more than a few times in my consulting career, especially as organizations have moved from legacy systems to more contemporary equivalents. Most of these improvements mean that organizations can consolidate data sources and, at least in theory, store all of their data in one place.

Do we really need all of this data?

It’s a question that I’ve heard more than a few times in my consulting career, especially as organizations have moved from legacy systems to more contemporary equivalents. Most of these improvements mean that organizations can consolidate data sources and, at least in theory, store all of their data in one place.

More Read

5 Big Data Storage Solutions

Important Considerations When Migrating to a Data Lake
Cloud Servers Are Fundamentally Rewriting The Rules Of Data Storage
CIOs Still Face Challenges to Reaching Big Data Maturity
What Type Of Data Storage Do Smart Cities Need?

Now, generally speaking, hoarding is not a healthy thing–and I don’t need reality shows to tell me as much. With respect to data management, though, is it really detrimental to an organization?

Amber Simonsen seems to think so. Simonsen is the PMP Executive Project Manager of Pierce Transit and talks about the perils of data hoards. ”What begins as an innocent desire to keep relevant information close at hand can turn into an unhealthy obsession that plagues IT departments and Records Managers in organizations everywhere,” Simonsen warns.

It’s a fair point, but think for a minute about data storage costs. To say that they’ve dropped in cost over the last three decades is the acme of understatement. Consider the following chart:

For more on the methodology used to derive these numbers, click here.

Considerations

So, the cost of data hoarding has dropped exponentially, even as the amount of data available has also risen exponentially. If you do the math, you’ll discover that organizations can store much more information these days than even five years ago for significantly lower costs. As a result, it’s hard to buy the “it’s too expensive to store this data” argument.

Of course, just because an organization can store a great deal of data doesn’t mean that it should. Data storage is a continuum, not a binary. What’s more, CIOs can actively decide not to store certain types of information for all sorts of reasons. Perhaps the most important consideration for an organization is what it uses to access and analyze new forms of data. If you’re trying to cram Big Data into Small Data solutions, then data gathering and storage (never mind) hoarding is going to pose a significant problem. As I write in my new book, you can’t write SQL statements against petabytes of unstructured data and expect to see meaningful results. New tools are needed to make sense of Big Data.

Simon Says

Data hoarding only makes sense if two conditions are met:

  1. Your organization has deployed the right tools–i.e., Hadoop, NoSQL and columnar databases, etc.
  2. Your organization actually does something with that data.

If that’s the case, hoard away.

Feedback

What say you?

TAGGED: Data Storage
MIKE20 December 17, 2012
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

Data Management

5 Big Data Storage Solutions

6 Min Read
tips on migrating to a data lake
Data Lake

Important Considerations When Migrating to a Data Lake

7 Min Read
cloud servers
Cloud Computing

Cloud Servers Are Fundamentally Rewriting The Rules Of Data Storage

5 Min Read
Big Data Maturity
AnalyticsBest PracticesBig DataBusiness IntelligenceCloud ComputingData ManagementData QualityExclusiveIT

CIOs Still Face Challenges to Reaching Big Data Maturity

10 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence
AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?