By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    AI analytics
    AI-Based Analytics Are Changing the Future of Credit Cards
    6 Min Read
    data overload showing data analytics
    How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
    8 Min Read
    hire a marketing agency with a background in data analytics
    5 Reasons to Hire a Marketing Agency that Knows Data Analytics
    7 Min Read
    predictive analytics for amazon pricing
    Using Predictive Analytics to Get the Best Deals on Amazon
    8 Min Read
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Evaluating Successful Predictive Analytics Solutions
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Modeling > Evaluating Successful Predictive Analytics Solutions
AnalyticsModelingPredictive Analytics

Evaluating Successful Predictive Analytics Solutions

RichardBoire
Last updated: 2011/04/19 at 7:08 PM
RichardBoire
3 Min Read
SHARE

Numerous studies exist regarding the use of many different kinds of mathematical techniques.  From an academic standpoint, the arguments supporting the merits of using one technique over the other contribute to increasing the knowledge base of its practitioners. Yet, practitioners will apply these techniques on  practical examples with a view to how it actually impacts the business.  This means that model evaluation does not solely reside on  pure statistical measures.

Numerous studies exist regarding the use of many different kinds of mathematical techniques.  From an academic standpoint, the arguments supporting the merits of using one technique over the other contribute to increasing the knowledge base of its practitioners. Yet, practitioners will apply these techniques on  practical examples with a view to how it actually impacts the business.  This means that model evaluation does not solely reside on  pure statistical measures. Instead, the practitioner’s key report in assessing model performance is the gains tables or decile charts.

The key benchmark in this report is how well the model rank orders the desired behavior of the predictive analytics solution.  There are two approaches to conducting this evaluation. The first approach is creating a Lorenz curve which plots the actual or observed behaviour of the solution against the deciles. These deciles or groups are determined by the predictive analytics solutions with decile 1 representing the highest scored names and decile 10 representing the lowest scored names.

 The second approach is to create a curve where the cumulative % of the desired behaviour is plotted against each decile where deciles again are created in the same manner as explained above. If the model is completely ineffective, the result would be a straight line upward while if the model is performing well, the line becomes a parabola. The model’s effectiveness  is determined by the difference in area between the parabola and the straight line which can actually be measured by what is referred to as the KS statistic.      

More Read

AI analytics

AI-Based Analytics Are Changing the Future of Credit Cards

How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
5 Reasons to Hire a Marketing Agency that Knows Data Analytics
Using Predictive Analytics to Get the Best Deals on Amazon
Growing Demand for Data Science & Data Analyst Roles

 As practitioners, either one of these tools can be used to evaluate models and to determine appropriate courses of action in terms of model reuse or model rebuild. Evaluating predictive analytics solutions in this manner also allows us to create further business metrics such as  ROI  which all businesses can easily understand.   

RichardBoire April 19, 2011
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Best Practices Big Data Data Collection Data Management Privacy
data protection for SMEs
8 Crucial Tips to Help SMEs Guard Against Data Breaches
Data Management
How AI is Boosting the Customer Support Game
How AI is Boosting the Customer Support Game
Artificial Intelligence
AI analytics
AI-Based Analytics Are Changing the Future of Credit Cards
Analytics Artificial Intelligence Exclusive

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

AI analytics
AnalyticsArtificial IntelligenceExclusive

AI-Based Analytics Are Changing the Future of Credit Cards

6 Min Read
data overload showing data analytics
Big Data

How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?

8 Min Read
hire a marketing agency with a background in data analytics
Analytics

5 Reasons to Hire a Marketing Agency that Knows Data Analytics

7 Min Read
predictive analytics for amazon pricing
Predictive Analytics

Using Predictive Analytics to Get the Best Deals on Amazon

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?