Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: What Is Your Big Data Analytics Stack?
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Predictive Analytics > What Is Your Big Data Analytics Stack?
Predictive Analytics

What Is Your Big Data Analytics Stack?

Radhika Subramanian
Radhika Subramanian
5 Min Read
SHARE

We often get asked this question – Where do I begin?  How are problems being solved using big-data analytics?

To answer this question we need to take a step back and think in the context of the problem and a complete solution to the problem.

The objective of big data, or any data for that matter, is to solve a business problem. The business problem is also called a use-case. We always keep that in mind. The easiest way to explain the data stack is by starting at the bottom, even though the process of building the use-case is from the top.

We often get asked this question – Where do I begin?  How are problems being solved using big-data analytics?

More Read

The Future of Soccer is in its Analytics
How to Improve Predictive Accuracy? (Part 1)
Three Critical Junctures
OFF=ON | More and more, the offline world (a.k.a. the real…
Determining Perception Gap Through Twitter [INFOGRAPHIC]

To answer this question we need to take a step back and think in the context of the problem and a complete solution to the problem.

The objective of big data, or any data for that matter, is to solve a business problem. The business problem is also called a use-case. We always keep that in mind. The easiest way to explain the data stack is by starting at the bottom, even though the process of building the use-case is from the top.

Data Layer: The bottom layer of the stack, of course, is data. This is the raw ingredient that feeds the stack. The players here are the database and storage vendors. Hadoop, with its innovative approach, is making a lot of waves in this layer.

Data Preparation Layer: The next layer is the data preparation tool. As we all know, data is typically messy and never in the right form. Data preparation is the process of extracting data from the source(s), merging two data sets and preparing the data required for the analysis step. There are emerging players in this area. 

Analysis Layer: The next layer is the analysis layer. Statistics is the most commonly known analysis tool. For statistics, the commonly available solutions are statistics and open source R. This is the layer for the emerging machine learning solutions. Automated analysis with machine learning is the future.  

Presentation Layer: The output from the analysis engine feeds the presentation layer. The presentation layer depends on the use-case. This layer is called the action layer, consumption layer or last mile.

  • If the result of the use case is to be presented to a human, the presentation layer may be a BI or visualization tool.   Example use-cases are fraud detection, Order-to-cash monitoring, etc. In each case the final result is sent to human decision makers for them to act.
  • For some use-cases, the results need to feed a downstream system, which may be another program. Example use-cases are recommendation systems, real-time pricing systems, etc. In this case the analysis results are fed into the downstream system that acts on it.
  • If the use-case is an alerting system, then the analysis results feed an event processing or alerting system. Example use-cases are medical device failure, network failure, etc. In this case the results of the analysis are fed into a system that can send out alerts to humans or machines that will act on the results in real-time or near real-time.

Use-case Layer: This is the value layer, and the ultimate purpose of the entire data stack. The use-case drives the selection of tools in each layer of the data stack. The number of use-cases is practically infinite. Example use-cases are fraud detection, dropped call alerting, network failure, supplier failure alerting, machine failure, and so on. These are like recipes in cookbooks – practically infinite. As the types and amount of data grows, the number of use-cases will grow.

How do you think about your data stack?

What are your thoughts?

 

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

AI supply chain
AI Tools Are Strengthening Global Supply Chains
Artificial Intelligence Exclusive
data analytics and truck accident claims
How Data Analytics Reduces Truck Accidents and Speeds Up Claims
Analytics Big Data Exclusive
predictive analytics for interior designers
Interior Designers Boost Profits with Predictive Analytics
Analytics Exclusive Predictive Analytics
big data and cybercrime
Stopping Lateral Movement in a Data-Heavy, Edge-First World
Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Image
Big DataBusiness IntelligenceData MiningPredictive AnalyticsSentiment AnalyticsSocial DataText AnalyticsUnstructured Data

That’s Sick! Text Mining and Words with Multiple Definitions

4 Min Read

Explaining Real-Time Predictive Analytics with Big Data [VIDEO]

1 Min Read

Predictive Analytics Gets Closer

7 Min Read

The Fallacy of the Data Scientist Shortage

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?