By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Data Obesity
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > Data Obesity
Data QualityPolicy and Governance

Data Obesity

Gayle Nixon
Last updated: 2012/06/12 at 4:54 PM
Gayle Nixon
3 Min Read
SHARE

Dave Binkley.2011 By David Binkley, Senior Technical Account Manager, Harte-Hanks Trillium Software

Dave Binkley.2011 By David Binkley, Senior Technical Account Manager, Harte-Hanks Trillium Software

Recently, by chance, I happened to view a Mary Meeker slide presentation dealing with the current state of the web. The presentation was fairly lengthy but, fortunately, it was interesting enough to hold my attention through the 100+ slides and as with all presentations, there was much to agree and disagree with.
What really caught my attention was a slide that I still don’t normally see these days – a slide that mentioned data quality. Needle-haystack Obesity

More Read

analyzing big data for its quality and value

Use this Strategic Approach to Maximize Your Data’s Value

Niche Data Tactics to Take Your Business to the Next Level
Preserving Data Quality is Critical for Leveraging Analytics with Amazon PPC
Encryption Importance in the Age of Data Breaches
What Tools Do You Need To Manage Unstructured Data?

That got me thinking about the “SOON…” side of slide and how critical data quality will be in the “Re-Imagination” of data and how much impact “Data Obesity” will have on all of us sooner or later.

Now it’s no secret that many of us have been dealing with a form a data obesity for quite some time – after all data de-duplication has been a key component of data quality since the keypunch days.  In a traditional sense, data de-duplication has always been thought of more along the lines of customer and household identification and de-duplication. 

However when it comes to the looming problem of the “store everything because we can do it inexpensively” mentality of today’s internet and applications, we’re all going to have to think out of the box as to how do we put that data on a diet and how do we successfully find those needles in that haystack?  Quite obviously we’re all going to need some tools to accomplish that – and those tools had better not be centered solely on traditional customer name and address information.

Locating the “fat” will require tools that analyze the data respective of its origin, language, character sets and many other known and unknown characteristics.  We will need to be able to identify redundant information using a wide variety of existing and newly developed matching and de-duplication rules.  Not only are we going to have to be able to locate and de-duplicate that information in batch processes but increasingly we’ll need to accomplish that in real time.

How soon will all of this happen?  Well, I’m already dealing with several corporations who are cleansing and removing “the fat” from millions of global real time transactions per day.  Only 2% of the public had tablets or e-readers three years ago – the figure is 29% now.  I’d venture to say that the rate of data obesity is growing nearly as fast.

Bigger is not always better and we’re all going to be right in the middle of getting our data lean and mean again.  Data obesity does kill people and sooner or later it will kill your applications.

 

Gayle Nixon June 12, 2012
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

analyzing big data for its quality and value
Big Data

Use this Strategic Approach to Maximize Your Data’s Value

6 Min Read
niche data tactics for business success
Big Data

Niche Data Tactics to Take Your Business to the Next Level

6 Min Read
data quality and role of analytics
Data Quality

Preserving Data Quality is Critical for Leveraging Analytics with Amazon PPC

8 Min Read
data encryption importance
Risk Management

Encryption Importance in the Age of Data Breaches

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence
data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?