Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
    pexels pavel danilyuk 8112119
    Data Analytics Is Revolutionizing Medical Credentialing
    8 Min Read
    data and seo
    Maximize SEO Success with Powerful Data Analytics Insights
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Evaluating Successful Predictive Analytics Solutions
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Modeling > Evaluating Successful Predictive Analytics Solutions
AnalyticsModelingPredictive Analytics

Evaluating Successful Predictive Analytics Solutions

RichardBoire
RichardBoire
3 Min Read
SHARE

Numerous studies exist regarding the use of many different kinds of mathematical techniques.  From an academic standpoint, the arguments supporting the merits of using one technique over the other contribute to increasing the knowledge base of its practitioners. Yet, practitioners will apply these techniques on  practical examples with a view to how it actually impacts the business.  This means that model evaluation does not solely reside on  pure statistical measures.

Numerous studies exist regarding the use of many different kinds of mathematical techniques.  From an academic standpoint, the arguments supporting the merits of using one technique over the other contribute to increasing the knowledge base of its practitioners. Yet, practitioners will apply these techniques on  practical examples with a view to how it actually impacts the business.  This means that model evaluation does not solely reside on  pure statistical measures. Instead, the practitioner’s key report in assessing model performance is the gains tables or decile charts.

The key benchmark in this report is how well the model rank orders the desired behavior of the predictive analytics solution.  There are two approaches to conducting this evaluation. The first approach is creating a Lorenz curve which plots the actual or observed behaviour of the solution against the deciles. These deciles or groups are determined by the predictive analytics solutions with decile 1 representing the highest scored names and decile 10 representing the lowest scored names.

 The second approach is to create a curve where the cumulative % of the desired behaviour is plotted against each decile where deciles again are created in the same manner as explained above. If the model is completely ineffective, the result would be a straight line upward while if the model is performing well, the line becomes a parabola. The model’s effectiveness  is determined by the difference in area between the parabola and the straight line which can actually be measured by what is referred to as the KS statistic.      

More Read

War Games: A New Type of Competitive Analytical Tool
SAS BI Dashboard: Google Analytics Dashboard Kicked Up a Notch
Intelligent Enterprise on R, SAS and REvolution Computing
Big Data Helps Gaming Industry Implement Cross-Regional CS Strategies
Battling Data Silos: 3 Tips to Finance and Operations Integration

 As practitioners, either one of these tools can be used to evaluate models and to determine appropriate courses of action in terms of model reuse or model rebuild. Evaluating predictive analytics solutions in this manner also allows us to create further business metrics such as  ROI  which all businesses can easily understand.   

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Generative AI models
Thinking Machines At Work: How Generative AI Models Are Redefining Business Intelligence
Artificial Intelligence Business Intelligence Exclusive Infographic Machine Learning
image fx (2)
Monitoring Data Without Turning into Big Brother
Big Data Exclusive
image fx (71)
The Power of AI for Personalization in Email
Artificial Intelligence Exclusive Marketing
image fx (67)
Improving LinkedIn Ad Strategies with Data Analytics
Analytics Big Data Exclusive Software

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

data cleansing tips for business analytics
Big Data

How Data Cleansing Can Make or Break Your Business Analytics

9 Min Read
data analytics and local seo
Analytics

Search Engine Watch Suggests Data Analytics Key To Local SEO Success

8 Min Read

Web 2.0 Data Scalability

2 Min Read

IBM Research’s nanoMRI microscope (via IBMLabs)

0 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?