We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Considering the Data Diet
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > Considering the Data Diet
Data MiningData Warehousing

Considering the Data Diet

TeradataExperts
TeradataExperts
6 Min Read
Considering the Data Diet
Illustration generated with FLUX.2 [klein 4B] via Cloudflare Workers AI.
SHARE

I had the unique pleasure of meeting with Pete Fader and Eric Bradlow from the Wharton Interactive Media Initiative last week in Philadelphia. And while it wasn’t the point of the meeting I was really interested in their work about companies going on a data diet. While this is somewhat antithetical to the historical position of data warehousing – where every bit of data should be kept for as long as possible, I think they are doing important work in this space.

Not because I think companies need less data, but because they are going to be getting more and more data. With the emerging Web Squared environment where world wide web meshes with devices, sensors, geospatial and temporal data and the devices interact with this mesh to transform not just the consumer experience but the entire value chain. The volume of data that can be analyzed is not going to be nearly as important as the critical data to the problem you are trying to solve.

As Melyssa Plunket-Gomez from Crimson Hexagon showed me with Social Media data, a lot of what needs to be analyzed is what you exclude. When looking at blog traffic for sentiment about a company you have exclude stuff like job postings because they are irrelevant to the analysis even though they have all the right keywords. I think this is a perfect example of watching what you analyze – a critical part of any data diet.

And while I think the data diet statement can be too simple, I think the concept has an important role to play in how companies utilize tools like Teradata’s multi-temperature data warehousing solutions. Which data is hot and needs high performance disks and chips and which data is not needed all the time and can be moved to lower cost storage? A data diet approach can be useful in determining how to invest in data.

More Read

Tactical Meandering
Tactical Meandering
Big Data Analytics, Business Intelligence and the Mind of Sherlock Holmes
Understanding, Improving & Controlling the Data Landscape — Part 1
Automate the Boring But Essential Parts of Your Data Warehouse
Dashboards should do more than raise your blood pressure

One of the challenges I see for data geeks in the coming years is how to decide what data you need to answer the questions that need to be answered tomorrow? I don’t don’t know what that question is and I don’t know what data I need. There is a big cost to not having the information you need when you need it. A data diet risks summarizing the value out of the data and eliminating data you need, but you don’t know it yet. Sometimes the most expensive data is the data you threw away.

Paul Barrett

—————
A couple follow-ups to earlier posts:

Consumers Taking Control > The district manager of the book store that didn’t get my money invited me to come to the store and meet and have a coffee. I am looking forward to it – I will probably make him spring for an expensive mocha instead of my usual value priced Iced Double Espresso – under $2 almost anywhere.

Millenials have never lived in a Batch World > I am getting ready for my presentation “Customer Time is Now Real-Time” at the Teradata Partners conference, coming up in October. This presentation is about how the confluence of the real-time web and a young generation of consumers are changing the rules for businesses. If you have comments or thoughts on Millenials or the real-time web and how it is impacting your business, please drop me a note at paul.barrett@teradata.com.  

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
Big Data Business Intelligence Exclusive Web Analytics
Flat editorial illustration: A SaaS-editorial scene showing product usage, support patterns, and renewal feedback informing a fle
Using Product Usage Analytics and Support Data to Build a B2B Product Roadmap
Business Intelligence Infographic
From Hiring To Payroll: Managing HR Data Across Business Systems -- AI-generated illustration
From Hiring To Payroll: Managing HR Data Across Business Systems
Big Data Business Intelligence Infographic
Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
Analytics Business Intelligence Exclusive Marketing

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

First Look – Oracle Data Mining Update
Business IntelligenceData MiningPredictive Analytics

First Look – Oracle Data Mining Update

5 Min Read
The 2009 Rexer Data Mining Survey - A conversation with Karl Rexer
Business IntelligenceCRMData MiningPredictive Analytics

The 2009 Rexer Data Mining Survey – A conversation with Karl Rexer

7 Min Read
Automating the Extraction of Useable Knowledge From Videos and Photos
Data MiningNew Products

Automating the Extraction of Useable Knowledge From Videos and Photos

3 Min Read
An Introduction to ElasticSearch
Data Mining

An Introduction to ElasticSearch

4 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?