We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Test, Learn, Adapt: Using Analytics to Improve Public Policy
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Culture/Leadership > Test, Learn, Adapt: Using Analytics to Improve Public Policy
AnalyticsCulture/LeadershipDecision ManagementKnowledge ManagementPolicy and Governance

Test, Learn, Adapt: Using Analytics to Improve Public Policy

Timo Elliott
Timo Elliott
3 Min Read
Test, Learn, Adapt: Using Analytics to Improve Public Policy
Illustration generated with Qwen Image.
SHARE

test_learn_adapt

test_learn_adapt

Ben Goldacre of Bad Science fame has co-written a UK Cabinet Office paper on how to improve government policy through better analysis, in the form of randomized controlled trials (RCTs).

A qualified doctor and professional debunker of bad medical analysis, Goldacre notes that RCTs are so widely used in areas such as medicine and web advertising that “failing to do them would be regarded as bizarre, or even reckless.”

More Read

The STEM Profession that Women Dominate
The STEM Profession that Women Dominate
The Benefits of Multivariate Testing Data For Your Online Business
Medicare Cost Analysis – Guest Radio Appearance to Explore Data-Driven Insights
Top eCommerce Metrics for Online Businesses to Study with Analytics
CIOs Still Face Challenges to Reaching Big Data Maturity

However, using RCTs to test different approaches to solving public policy problems in social welfare, education, crime, and justice remains rare (see chart below).

image

The paper is a very clear introduction to how RCTs work and why they are so important. The various myths that prevent their wider usage (cost, effort, fairness, etc.) are thoroughly debunked.

The document includes UK examples of RCT successes: trials showed that text messages were effective at prompting people to pay fines on time, but giving the unemployed administratively-cheaper online alternatives to “signing on” every two weeks increased the time it took them to find work.

One example clearly communicates the value of the RCT approach. The US “Scared Straight” program attempted to deter juvenile delinquents from criminal behavior by exposing them to the “frightening realities of leading a life of crime.”

Scared Straight claimed success rates of up to 94%, and was copied in other countries – but the program had not included a control group. A later meta-analysis of randomized trials concluded that the program in fact led to higher rates of offending: “doing nothing would have been better than exposing juveniles to the program.”

The costs associated with the program were over 30 times higher than the benefits – meaning taxpayers spent a significant amount of money to actively increase crime!

The white paper is a great read for anybody interested in persuading others in their organization of the importance of using analytic techniques such as RCTs to improve outcomes — you can download it from the Cabinet Office website.

Share and Enjoy

• Facebook • Twitter • Delicious • LinkedIn • StumbleUpon • Add to favorites • Email • RSS

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
Big Data Business Intelligence Exclusive Web Analytics
Flat editorial illustration: A SaaS-editorial scene showing product usage, support patterns, and renewal feedback informing a fle
Using Product Usage Analytics and Support Data to Build a B2B Product Roadmap
Business Intelligence Infographic
From Hiring To Payroll: Managing HR Data Across Business Systems -- AI-generated illustration
From Hiring To Payroll: Managing HR Data Across Business Systems
Big Data Business Intelligence Infographic
Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
Analytics Business Intelligence Exclusive Marketing

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Social Business Intelligence Q & A with Yellowfin CEO Glen Rabie
AnalyticsBest PracticesBusiness IntelligenceCommentaryCulture/LeadershipDecision ManagementKnowledge Management

Social Business Intelligence Q & A with Yellowfin CEO Glen Rabie

10 Min Read
Giving Employees Access to Big Data Has Big Potential [INFOGRAPHIC]
Big DataBusiness IntelligenceCulture/LeadershipData Management

Giving Employees Access to Big Data Has Big Potential [INFOGRAPHIC]

0 Min Read
Helpful Forecasting Resources
AnalyticsData Management

Helpful Forecasting Resources

3 Min Read
An Introduction To Hands-On Text Analytics In Python
AnalyticsExclusiveText Analytics

An Introduction To Hands-On Text Analytics In Python

7 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?