By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
    analyst,women,looking,at,kpi,data,on,computer,screen
    Promising Benefits of Predictive Analytics in Asset Management
    11 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: What Is Your Big Data Analytics Stack?
Share
Notification Show More
Latest News
ai digital marketing tools
Top Five AI-Driven Digital Marketing Tools in 2023
Artificial Intelligence
ai-generated content
Is AI-Generated Content a Net Positive for Businesses?
Artificial Intelligence
predictive analytics in dropshipping
Predictive Analytics Helps New Dropshipping Businesses Thrive
Predictive Analytics
cloud data security in 2023
Top Tools for Your Cloud Data Security Stack in 2023
Cloud Computing
become a data scientist
Boosting Your Chances for Landing a Job as a Data Scientist
Jobs
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Predictive Analytics > What Is Your Big Data Analytics Stack?
Predictive Analytics

What Is Your Big Data Analytics Stack?

Radhika Subramanian
Last updated: 2015/08/21 at 3:41 PM
Radhika Subramanian
5 Min Read
SHARE

We often get asked this question – Where do I begin?  How are problems being solved using big-data analytics?

To answer this question we need to take a step back and think in the context of the problem and a complete solution to the problem.

The objective of big data, or any data for that matter, is to solve a business problem. The business problem is also called a use-case. We always keep that in mind. The easiest way to explain the data stack is by starting at the bottom, even though the process of building the use-case is from the top.

We often get asked this question – Where do I begin?  How are problems being solved using big-data analytics?

More Read

predictive analytics in dropshipping

Predictive Analytics Helps New Dropshipping Businesses Thrive

Promising Benefits of Predictive Analytics in Asset Management
Albanian Bitcoin Investors Tap the Power of Predictive Analytics
Predictive Analytics Improves Trading Decisions as Euro Rebounds
Can Predictive Analytics Help Traders Navigate Bitcoin’s Volatility?

To answer this question we need to take a step back and think in the context of the problem and a complete solution to the problem.

The objective of big data, or any data for that matter, is to solve a business problem. The business problem is also called a use-case. We always keep that in mind. The easiest way to explain the data stack is by starting at the bottom, even though the process of building the use-case is from the top.

Data Layer: The bottom layer of the stack, of course, is data. This is the raw ingredient that feeds the stack. The players here are the database and storage vendors. Hadoop, with its innovative approach, is making a lot of waves in this layer.

Data Preparation Layer: The next layer is the data preparation tool. As we all know, data is typically messy and never in the right form. Data preparation is the process of extracting data from the source(s), merging two data sets and preparing the data required for the analysis step. There are emerging players in this area. 

Analysis Layer: The next layer is the analysis layer. Statistics is the most commonly known analysis tool. For statistics, the commonly available solutions are statistics and open source R. This is the layer for the emerging machine learning solutions. Automated analysis with machine learning is the future.  

Presentation Layer: The output from the analysis engine feeds the presentation layer. The presentation layer depends on the use-case. This layer is called the action layer, consumption layer or last mile.

  • If the result of the use case is to be presented to a human, the presentation layer may be a BI or visualization tool.   Example use-cases are fraud detection, Order-to-cash monitoring, etc. In each case the final result is sent to human decision makers for them to act.
  • For some use-cases, the results need to feed a downstream system, which may be another program. Example use-cases are recommendation systems, real-time pricing systems, etc. In this case the analysis results are fed into the downstream system that acts on it.
  • If the use-case is an alerting system, then the analysis results feed an event processing or alerting system. Example use-cases are medical device failure, network failure, etc. In this case the results of the analysis are fed into a system that can send out alerts to humans or machines that will act on the results in real-time or near real-time.

Use-case Layer: This is the value layer, and the ultimate purpose of the entire data stack. The use-case drives the selection of tools in each layer of the data stack. The number of use-cases is practically infinite. Example use-cases are fraud detection, dropped call alerting, network failure, supplier failure alerting, machine failure, and so on. These are like recipes in cookbooks – practically infinite. As the types and amount of data grows, the number of use-cases will grow.

How do you think about your data stack?

What are your thoughts?

 

Radhika Subramanian August 21, 2015
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai digital marketing tools
Top Five AI-Driven Digital Marketing Tools in 2023
Artificial Intelligence
ai-generated content
Is AI-Generated Content a Net Positive for Businesses?
Artificial Intelligence
predictive analytics in dropshipping
Predictive Analytics Helps New Dropshipping Businesses Thrive
Predictive Analytics
cloud data security in 2023
Top Tools for Your Cloud Data Security Stack in 2023
Cloud Computing

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

Sign Up for Our Newsletter

Subscribe to our newsletter to get our newest articles instantly!

[mc4wp_form id=”1616″]

You Might also Like

predictive analytics in dropshipping
Predictive Analytics

Predictive Analytics Helps New Dropshipping Businesses Thrive

12 Min Read
analyst,women,looking,at,kpi,data,on,computer,screen
Predictive Analytics

Promising Benefits of Predictive Analytics in Asset Management

11 Min Read
predictive analytics helps Albanian bitcoin investors
Blockchain

Albanian Bitcoin Investors Tap the Power of Predictive Analytics

9 Min Read
benefits of data analytics for financial management
Predictive Analytics

Predictive Analytics Improves Trading Decisions as Euro Rebounds

10 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?