By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data-driven image seo
    Data Analytics Helps Marketers Substantially Boost Image SEO
    8 Min Read
    construction analytics
    5 Benefits of Analytics to Manage Commercial Construction
    5 Min Read
    benefits of data analytics for financial industry
    Fascinating Changes Data Analytics Brings to Finance
    7 Min Read
    analyzing big data for its quality and value
    Use this Strategic Approach to Maximize Your Data’s Value
    6 Min Read
    data-driven seo for product pages
    6 Tips for Using Data Analytics for Product Page SEO
    11 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Evaluating Successful Predictive Analytics Solutions
Share
Notification Show More
Latest News
ai in software development
3 AI-Based Strategies to Develop Software in Uncertain Times
Software
ai in ppc advertising
5 Proven Tips for Utilizing AI with PPC Advertising in 2023
Artificial Intelligence
data-driven image seo
Data Analytics Helps Marketers Substantially Boost Image SEO
Analytics
ai in web design
5 Ways AI Technology Has Disrupted Website Development
Artificial Intelligence
cloud-centric companies using network relocation
Cloud-Centric Companies Discover Benefits & Pitfalls of Network Relocation
Cloud Computing
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Modeling > Evaluating Successful Predictive Analytics Solutions
AnalyticsModelingPredictive Analytics

Evaluating Successful Predictive Analytics Solutions

RichardBoire
Last updated: 2011/04/19 at 7:08 PM
RichardBoire
3 Min Read
SHARE
- Advertisement -

Numerous studies exist regarding the use of many different kinds of mathematical techniques.  From an academic standpoint, the arguments supporting the merits of using one technique over the other contribute to increasing the knowledge base of its practitioners. Yet, practitioners will apply these techniques on  practical examples with a view to how it actually impacts the business.  This means that model evaluation does not solely reside on  pure statistical measures.

Numerous studies exist regarding the use of many different kinds of mathematical techniques.  From an academic standpoint, the arguments supporting the merits of using one technique over the other contribute to increasing the knowledge base of its practitioners. Yet, practitioners will apply these techniques on  practical examples with a view to how it actually impacts the business.  This means that model evaluation does not solely reside on  pure statistical measures. Instead, the practitioner’s key report in assessing model performance is the gains tables or decile charts.

- Advertisement -

The key benchmark in this report is how well the model rank orders the desired behavior of the predictive analytics solution.  There are two approaches to conducting this evaluation. The first approach is creating a Lorenz curve which plots the actual or observed behaviour of the solution against the deciles. These deciles or groups are determined by the predictive analytics solutions with decile 1 representing the highest scored names and decile 10 representing the lowest scored names.

 The second approach is to create a curve where the cumulative % of the desired behaviour is plotted against each decile where deciles again are created in the same manner as explained above. If the model is completely ineffective, the result would be a straight line upward while if the model is performing well, the line becomes a parabola. The model’s effectiveness  is determined by the difference in area between the parabola and the straight line which can actually be measured by what is referred to as the KS statistic.      

More Read

data-driven image seo

Data Analytics Helps Marketers Substantially Boost Image SEO

5 Benefits of Analytics to Manage Commercial Construction
Fascinating Changes Data Analytics Brings to Finance
Use this Strategic Approach to Maximize Your Data’s Value
6 Tips for Using Data Analytics for Product Page SEO

 As practitioners, either one of these tools can be used to evaluate models and to determine appropriate courses of action in terms of model reuse or model rebuild. Evaluating predictive analytics solutions in this manner also allows us to create further business metrics such as  ROI  which all businesses can easily understand.   

RichardBoire April 19, 2011
Share this Article
Facebook Twitter Pinterest LinkedIn
Share
- Advertisement -

Follow us on Facebook

Latest News

ai in software development
3 AI-Based Strategies to Develop Software in Uncertain Times
Software
ai in ppc advertising
5 Proven Tips for Utilizing AI with PPC Advertising in 2023
Artificial Intelligence
data-driven image seo
Data Analytics Helps Marketers Substantially Boost Image SEO
Analytics
ai in web design
5 Ways AI Technology Has Disrupted Website Development
Artificial Intelligence

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data-driven image seo
Analytics

Data Analytics Helps Marketers Substantially Boost Image SEO

8 Min Read
construction analytics
Analytics

5 Benefits of Analytics to Manage Commercial Construction

5 Min Read
benefits of data analytics for financial industry
Big Data

Fascinating Changes Data Analytics Brings to Finance

7 Min Read
analyzing big data for its quality and value
Big Data

Use this Strategic Approach to Maximize Your Data’s Value

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive
data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?