Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: The Data Lake Debate: Conclusion (With Apologies to the Rolling Stones)
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Software > Hadoop > The Data Lake Debate: Conclusion (With Apologies to the Rolling Stones)
Big DataData ManagementHadoopPolicy and Governance

The Data Lake Debate: Conclusion (With Apologies to the Rolling Stones)

JillDyche
JillDyche
4 Min Read
Image
SHARE

Image

Image

ImageWhen I wrote the introduction to the now-celebrated Data Lake Debate, I couldn’t have anticipated the buzz the exchange would get! Neither Anne Buff nor Tamara Dull pulled any punches in defending her perspective on the value and the perils of the data lake.

Like you, I agree with both of them. From Tamara’s perspective, the data lake presents a fresh and practical solution for easier data access, loading, cleansing, provisioning, and archiving, freeing companies from the yoke of traditional relational database systems and their accompanying processing and labor-intensive infrastructures.

More Read

Analyze Big Data Effectively and Efficiently: Five Opportunities [INFOGRAPHIC]
Do You Really Need a “Sexy” Data Scientist?
How To Use Data Analytics To Launch A Sustainable Technology Business
5 Internet of Things Technologies for 2014 [INFOGRAPHIC]
Is Analytics “Different”?: 2 Lessons in Sales from The Mayflower Madam

But Anne also has a point, which is that the data lake—significant development that it is—is still only a component in an overall data ecosystem that includes data management and governance, quality and master data management solutions, and loading and provisioning standards. And, Anne insists, it need not include Hadoop.

As Anne and Tamara would both agree, you can’t simply hold your nose and jump headfirst into the data lake without risking injury. Business and IT managers should be clear-headed about incumbent capabilities, skills, and tools for data management. They should understand existing skills, and skill gaps. And they should be able to articulate the problems that a data lake can solve, as well as the risks and costs it will incur.

As I said in my introduction, formalizing policies around business data is a more significant factor in information management maturity than any single platform or architecture. Many companies with putatively mature data warehouses have nevertheless slacked off when it comes to data integration standards and data security policies. Adopting a data lake into your existing ecosystem might be a pretext for introducing this rigor. Or it might simply be yet another hammer looking for a nail.

In an homage to the Rolling Stones, I blithely suggested that if you try sometimes, you get what you need—be it more funding, access to third-party data, a more effective executive sponsor, or a Hadoop distribution provider. It’s not an easy decision, but I’d call the data lake debate a draw. After all, when it comes to the verdict on whether or not a data lake is a worthwhile investment, the success stories will start to emerge. In the meantime, I’m happy to watch those stories unfold. Time, after all, is on my side. Yes it is.

(See what I did there?)


In case you missed the Data Lake Debate:

  • The Introduction – by Jill Dyche
  • Pro’s Up First – by Tamara Dull
  • Questioning the Pro – by Anne Buff and Tamara Dull
  • Negative Puts a Stake in the Ground – by Anne Buff
  • Pro Cross-Examines Con – by Tamara Dull and Anne Buff
  • Pro Delivers First Rebuttal – by Tamara Dull
  • The Final Word from Negative – by Anne Buff
  • Pro Delivers Final Rebuttal and Summary – by Tamara Dull

But wait! There’s more! Join Tamara Dull and Anne Buff on May 27, 2015, for a live webcast version of this debate. The gloves will be off. See you there!

TAGGED:Data Lake Debate
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data analytics and truck accident claims
How Data Analytics Reduces Truck Accidents and Speeds Up Claims
Analytics Big Data Exclusive
predictive analytics for interior designers
Interior Designers Boost Profits with Predictive Analytics
Analytics Exclusive Predictive Analytics
big data and cybercrime
Stopping Lateral Movement in a Data-Heavy, Edge-First World
Big Data Exclusive
AI and data mining
What the Rise of AI Web Scrapers Means for Data Teams
Artificial Intelligence Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Image
Best PracticesBig DataHadoopUnstructured Data

The Data Lake Debate: Pro Delivers Final Rebuttal and Summary

5 Min Read
Image
Big DataHadoop

The Data Lake Debate: Pro is Up First

8 Min Read
Image
Big DataData ManagementHadoopOpen SourcePolicy and Governance

The Data Lake Debate: Pro Delivers First Rebuttal

5 Min Read
Image
Best PracticesBig DataData ManagementData WarehousingHadoop

The Data Lake Debate: The Introduction

3 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?