By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: What Will We Call Big Data in 2015?
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > What Will We Call Big Data in 2015?
Big Data

What Will We Call Big Data in 2015?

nraden
Last updated: 2012/07/24 at 8:26 PM
nraden
6 Min Read
1971 Audi 60L
SHARE

 It is pretty much agreed now that the “big” in big data is a relative term. If the volumes of accessible, usable, actionable data continue to grow at current rates, then big data will be big for years to come. But it probably won’t. Going back  few years, data warehouses captured detail at the sales by unit by time level. Size exploded when it went down to the item level, then really exploded when it went down to the customer level. These order-of-magnitude increases were episodic, not continuous.

 It is pretty much agreed now that the “big” in big data is a relative term. If the volumes of accessible, usable, actionable data continue to grow at current rates, then big data will be big for years to come. But it probably won’t. Going back  few years, data warehouses captured detail at the sales by unit by time level. Size exploded when it went down to the item level, then really exploded when it went down to the customer level. These order-of-magnitude increases were episodic, not continuous. But capturing clickstream data turned out to be a little too much for data warehousing (at the detail level), and big data was born.

 Now, capturing and making sense of what we call big data is an episode in progress: Web data, machine-generated data, sensor data, climate data, all sorts of textual data and a host of other things. What else is there? That may be a naïve question,   

 Most of the notable big data has been around for a while. Science, defense and intelligence have been capturing and analyzing data we in the commercial sector can’t even fathom, with proprietary methods and specialized machines. But there is a lot of “big data” we have been looking at for quite a while, we just didn’t use all the data, or even conceive how we could, because we did not have the resources to do it. Telemetry from all sorts of things, from process control systems to commercial aircraft in flight, has been examined in real-time and then either discarded or aggregated because the accumulation of it simply overwhelmed our ability to capture it, store it and examine it and integrate it after the fact.

More Read

data security in big data age

6 Reasons to Boost Data Security Plan in the Age of Big Data

How Big Data Is Transforming the Maritime Industry
Utilizing Data to Discover Shortcomings Within Your Business Model
Embedded BI Tools Bring Huge Benefits to Business Applications
Small Businesses Use Big Data to Offset Risk During Economic Uncertainty

 For example, telecom companies have been using Call Detail Records (CDR) for a slew of applications (I worked on an application as early 1990), but not to the extreme level, actually lowest level, of detail. It had to be either aggregated or sampled, or both. Now we have the tools to look at it in excruciating detail. That’s great, isn’t it?

 Maybe. The coming “trough of disillusionment,” that follows the initial hype of new technology markets, as Gartner describes it, is that big data is still all about data, not outcomes. That it requires “data scientists” with technical skills in configuring a cluster, writing MapReduce code in Java and creating result sets that are the epitome of silos (or DOOP-marts as I’ve named them) is reminiscent of data warehousing in the 90’s, only on steroids.

 What’s needed in big data is some gentrification, the ability to use it without getting into the nuts and bolts. We suggest abstraction.

 Abstraction is applied routinely to systems that are to some degree complex and especially when they are subject to frequent change. A 2012 model car contains more MIPS of computer processing than most computers only a decade ago. Driving the car, even under extreme conditions, is a perfect example of abstraction. Stepping on the gas doesn’t really pump gas to the engine, it alerts the engine management system to increase speed by sampling and alerting dozens of circuits, relays and devices to achieve the desired effect subject to many constraints, such as limiting engine speed and watching the fuel air mixture for maximum economy or lowest emissions. If the driver needed to attend to all of these things directly, he would not get out of the driveway.

 

 1971 Audi 60L 
2012 Audi S8

 A 1971 Audi had virtually no electronics at all. A 2012 Audi S8 practically drives (and stops) itself.  Today, working with big data is still a lot like driving a 1971 Audi. It will quickly (much faster than 40 years!) resemble riding in a 2012 S8. How quickly? 2-3 years. At that point, will we still call it “big data?”

Big data relies on at least some of the business users understanding the location and naming conventions (in the best cases)  and semantics of the data, if not the intricacies of the crafting of queries. This is a huge barrier to progress. Business people need to define their work in their own terms. A business modeling environment is needed for designing and maintaining structures. It is especially important to have business modeling for the inevitable changes in those structures. It is likewise important for leveraging the latent value of those structures through analytical work that is enhanced by understandable models that are relevant and useful to business people.

 

Neil Raden, Hired Brains Research

 

TAGGED: analytics, bi, big data, business intelligence, data warehouse, neil raden, Predictive, statistics
nraden July 24, 2012
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data security in big data age
Big Data

6 Reasons to Boost Data Security Plan in the Age of Big Data

7 Min Read
How Big Data Is Transforming the Maritime Industry
Big Data

How Big Data Is Transforming the Maritime Industry

8 Min Read
utlizing big data for business model
Big Data

Utilizing Data to Discover Shortcomings Within Your Business Model

6 Min Read
embedded bi tools
Business Intelligence

Embedded BI Tools Bring Huge Benefits to Business Applications

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?