Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Big Data: It’s About the Data, Not About the Big
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > Big Data: It’s About the Data, Not About the Big
Data QualityData VisualizationModeling

Big Data: It’s About the Data, Not About the Big

Rob Armstrong
Rob Armstrong
5 Min Read
SHARE

Today in my local paper there was an article on the 17th annual Knowledge Discovery and Data Mining conference.  The gist was about the need for data analytics and how companies are looking for good people that understand that realm.  Of course the driving force behind all this was the movement in “BIG DATA”

Today in my local paper there was an article on the 17th annual Knowledge Discovery and Data Mining conference.  The gist was about the need for data analytics and how companies are looking for good people that understand that realm.  Of course the driving force behind all this was the movement in “BIG DATA”

It is a little amusing to those of us that have been in the data warehousing game a long time, especially with Teradata, to hear the term BIG DATA.  At the start of Teradata, people openly wondered if anyone would ever have a need to handle a terabyte of data, and yet today there is talk of petabytes and beyond with hardly a blink of an eye.

More Read

LinkedIn sponsored content
Big Data Helps You Use LinkedIn Sponsored Content Competitively
Big Data, Intelligence and Multi-Faceted Innovation
How Airlines Measure Loyalty Using Big Data & Analytics
How Big Data and AI Are Set to Transform Online Gaming
Tips for Executives – How to Get the Data You Need

Editor’s note: Rob Armstrong is an employee of Teradata. Teradata is a sponsor of The Smart Data Collective.

Big data is not about volume, though it may certainly be voluminous.  The accent is really on the second part, the data.  The term applies to many new and varied data sources such as RFID, Geospatial, Smart meters, social network data, and web logs.  Yes this data can be big but more importantly it provides a source of very rich analytical opportunity.

You can think of this is a few ways.  There is data such as smart metering for a utility company.  Getting a discrete usage tracking at 15 minute intervals will certainly cause much more data coming into the environment.  As opposed to a once a month recording this would be approximately a 3000 times jump (96 a day for 30 days rather than a 1 row per month)!  But the data is still the same structure and very “relationally friendly”.  The data fits the existing model and can enable much better analytics that leads to network optimization, marketing new rates and services, and integration into home appliances.  So here the data is big but easy to handle, provide you have the technology and scalable environment to allow that type of growth

The other side of the coin is data that is not “relationally friendly”.  This may be data from social sites, call center recordings, customer feedback forms, or the like.  Here you have free text (or even txt, LOL J)  The data needs to be interrogated for content and context and then prepared for integration into the relational model.  This is where the “big data” creates a whole new level of data transformation need.  Here is where environments such as Hadoop or Aster data come into play.  Being able analysis the data streams with many to many relationships creates some good insights.  The goal of the KDD conference is finding people and processes that can make sense of the data or can at least figure out processes that allow the data to make sense.

Once you have processes the “BIG DATA” and gleaned some insights from the data streams then you also want to integrate that data into your corporate data structure.  Have tweets about a product you sell?  Link those tweets into the data model and join based on product ID.  Getting comments from facebook users on your service.  Link that sentiment into your data model based on customer attributes such as e-mail address or facebook ID.

 The real point of all this data is that by itself it is just “BIG DATA”, but when analyzed and integrated into a wider perspective it becomes “BIG OPPORTUNITY”. 

[Rob Armstrong works for Teradata, sponsor of Smart Data Collective]

TAGGED:big data
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data analytics and truck accident claims
How Data Analytics Reduces Truck Accidents and Speeds Up Claims
Analytics Big Data Exclusive
predictive analytics for interior designers
Interior Designers Boost Profits with Predictive Analytics
Analytics Exclusive Predictive Analytics
big data and cybercrime
Stopping Lateral Movement in a Data-Heavy, Edge-First World
Big Data Exclusive
AI and data mining
What the Rise of AI Web Scrapers Means for Data Teams
Artificial Intelligence Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Mok Oh: To Do Data Science, You Need a Team of Specialists

13 Min Read
big data competition
Big Data

Why Brands Need Big Data to Survive in the Information Economy

5 Min Read
Cloud storage
Cloud ComputingIT

Cloud Storage: A Logistical Nightmare Turned Dream Come True

4 Min Read
data analytics guide
Analytics

Importance Of Using Data Analytics To Optimize Lead Pipelines

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?