We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Big Data: It’s About the Data, Not About the Big
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > Big Data: It’s About the Data, Not About the Big
Data QualityData VisualizationModeling

Big Data: It’s About the Data, Not About the Big

Rob Armstrong
Rob Armstrong
5 Min Read
Big Data: It’s About the Data, Not About the Big
Illustrative image generated with OpenAI gpt-image-1.
SHARE

Today in my local paper there was an article on the 17th annual Knowledge Discovery and Data Mining conference.  The gist was about the need for data analytics and how companies are looking for good people that understand that realm.  Of course the driving force behind all this was the movement in “BIG DATA”

It is a little amusing to those of us that have been in the data warehousing game a long time, especially with Teradata, to hear the term BIG DATA.  At the start of Teradata, people openly wondered if anyone would ever have a need to handle a terabyte of data, and yet today there is talk of petabytes and beyond with hardly a blink of an eye.

Editor’s note: Rob Armstrong is an employee of Teradata. Teradata is a sponsor of The Smart Data Collective.

Big data is not about volume, though it may certainly be voluminous.  The accent is really on the second part, the data.  The term applies to many new and varied data sources such as RFID, Geospatial, Smart meters, social network data, and web logs.  Yes this data can be big but more importantly it provides a source of very rich analytical opportunity.

More Read

3 Ways Fintech Companies are Using Big Data to Beat the Banks
3 Ways Fintech Companies are Using Big Data to Beat the Banks
How Will Big Data Affect Productivity in the Utility Sector?
How Big Data Has Revolutionized the Gaming Industry
Data Lake Details: All About Cloudwick’s CDL
Bus commuting made tolerable with real-time data

You can think of this is a few ways.  There is data such as smart metering for a utility company.  Getting a discrete usage tracking at 15 minute intervals will certainly cause much more data coming into the environment.  As opposed to a once a month recording this would be approximately a 3000 times jump (96 a day for 30 days rather than a 1 row per month)!  But the data is still the same structure and very “relationally friendly”.  The data fits the existing model and can enable much better analytics that leads to network optimization, marketing new rates and services, and integration into home appliances.  So here the data is big but easy to handle, provide you have the technology and scalable environment to allow that type of growth

The other side of the coin is data that is not “relationally friendly”.  This may be data from social sites, call center recordings, customer feedback forms, or the like.  Here you have free text (or even txt, LOL J)  The data needs to be interrogated for content and context and then prepared for integration into the relational model.  This is where the “big data” creates a whole new level of data transformation need.  Here is where environments such as Hadoop or Aster data come into play.  Being able analysis the data streams with many to many relationships creates some good insights.  The goal of the KDD conference is finding people and processes that can make sense of the data or can at least figure out processes that allow the data to make sense.

Once you have processes the “BIG DATA” and gleaned some insights from the data streams then you also want to integrate that data into your corporate data structure.  Have tweets about a product you sell?  Link those tweets into the data model and join based on product ID.  Getting comments from facebook users on your service.  Link that sentiment into your data model based on customer attributes such as e-mail address or facebook ID.

 The real point of all this data is that by itself it is just “BIG DATA”, but when analyzed and integrated into a wider perspective it becomes “BIG OPPORTUNITY”. 

[Rob Armstrong works for Teradata, sponsor of Smart Data Collective]

TAGGED:big data
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

When Big Hearts Meet Big Data: 6 Nonprofits Using Data to Change the World
Business IntelligenceCollaborative DataCulture/LeadershipSocial Data

When Big Hearts Meet Big Data: 6 Nonprofits Using Data to Change the World

9 Min Read
See Why Businesses Can't Do Without Customer Data Collection
AnalyticsBig DataBusiness IntelligenceCollaborative DataData ManagementData WarehousingDecision ManagementExclusiveNewsWeb Analytics

See Why Businesses Can’t Do Without Customer Data Collection

7 Min Read
NoSQL Databases: 4 Game-Changing Use Cases
ITUnstructured Data

NoSQL Databases: 4 Game-Changing Use Cases

6 Min Read
Restaurant Industry
Big DataBusiness Intelligence

SMB Report: Big Data is the Biggest Disruptor in the Restaurant Industry

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive
5 Great Tips for Using Data Analytics for Website UX
5 Great Tips for Using Data Analytics for Website UX
Big Data

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?