By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    construction analytics
    5 Benefits of Analytics to Manage Commercial Construction
    5 Min Read
    benefits of data analytics for financial industry
    Fascinating Changes Data Analytics Brings to Finance
    7 Min Read
    analyzing big data for its quality and value
    Use this Strategic Approach to Maximize Your Data’s Value
    6 Min Read
    data-driven seo for product pages
    6 Tips for Using Data Analytics for Product Page SEO
    11 Min Read
    big data analytics in business
    5 Ways to Utilize Data Analytics to Grow Your Business
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Conditional probability: an easier way
Share
Notification Show More
Latest News
construction analytics
5 Benefits of Analytics to Manage Commercial Construction
Analytics
database compliance guide
Four Strategies For Effective Database Compliance
Data Management
Digital Security From Weaponized AI
Fortifying Enterprise Digital Security Against Hackers Weaponizing AI
Security
DevOps on cloud
Optimizing Cost with DevOps on the Cloud
Cloud Computing Development Exclusive IT
machine learning seo
7 Mistakes to Avoid When Using Machine Learning for SEO
Exclusive Machine Learning
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Predictive Analytics > Conditional probability: an easier way
Predictive Analytics

Conditional probability: an easier way

DavidMSmith
Last updated: 2010/04/27 at 5:38 PM
DavidMSmith
5 Min Read
SHARE
- Advertisement -

Conditional probabilities are bane of many students of Statistics, but statements of conditional probability come up surprisingly often in real life. For example, as Steven Strogatz writes in the New York Times, when doctors are asked to estimate the probability that a woman has breast cancer given a positive mammogram test result, most get the answer wildly wrong despite being given the population frequency of breast cancer and the conditional probability of false positives from a mammogram test. Here’s one doctor’s experience trying to come up with a number:

“[He] was visibly nervous while trying to figure out what he would tell the woman.  After mulling the numbers over, he finally estimated the woman’s probability of having breast cancer, given that she has a positive mammogram, to be 90 percent.  Nervously, he added, ‘Oh, what nonsense.  I can’t do this.  You should test my daughter; she is studying medicine.’  He knew that his estimate was wrong, but he did not know how to reason better.  Despite the fact that he had spent 10 minutes wringing his mind for an answer, he could not figure out how to draw a sound inference from the probabilities. …

- Advertisement -

More Read

data science use advertising

The Low-Down On Using Data Science And Statistics In Advertising

Big Data Analytics: The Four Pillars
4 Retail BI Lessons to Learn from Google’s Nexus Fail
Data Visualizations: The Tip of the Iceberg of Understanding
The First Data Scientist on the Evolution of Data Science

Conditional probabilities are bane of many students of Statistics, but statements of conditional probability come up surprisingly often in real life. For example, as Steven Strogatz writes in the New York Times, when doctors are asked to estimate the probability that a woman has breast cancer given a positive mammogram test result, most get the answer wildly wrong despite being given the population frequency of breast cancer and the conditional probability of false positives from a mammogram test. Here’s one doctor’s experience trying to come up with a number:

“[He] was visibly nervous while trying to figure out what he would tell the woman.  After mulling the numbers over, he finally estimated the woman’s probability of having breast cancer, given that she has a positive mammogram, to be 90 percent.  Nervously, he added, ‘Oh, what nonsense.  I can’t do this.  You should test my daughter; she is studying medicine.’  He knew that his estimate was wrong, but he did not know how to reason better.  Despite the fact that he had spent 10 minutes wringing his mind for an answer, he could not figure out how to draw a sound inference from the probabilities.” [The correct answer is 9 percent.]

Most students (and doctors!) are taught to use Bayes’ Theorem to calculate marginal probabilities from conditional probabilities, but as Strogatz point out this isn’t exactly an intuitive calculation, with the dividing of probabilities by probabilities and all. He suggests a more intuitive (but slightly less accurate) method is to think instead about frequencies within concrete groups and sub-groups. For the mammogram test, the calculation becomes:

- Advertisement -

Eight out of every 1,000 women have breast cancer.  Of these 8 women with breast cancer, 7 will have a positive mammogram.  Of the remaining 992 women who don’t have breast cancer, some 70 will still have a positive mammogram.  Imagine a sample of women who have positive mammograms in screening. How many of these women actually have breast cancer?

Since a total of 7 + 70 = 77 women have positive mammograms, and only 7 of them truly have breast cancer, the probability of having breast cancer given a positive mammogram is 7 out of 77, which is 1 in 11, or about 9 percent.

This method is frowned upon by textbooks, because it’s not as accurate (in the example above, rounding to whole numbers of women in the groups), and because it implicitly assumes that the frequency of the event (here, breast cancer) is determined solely by the probability, with no accounting for variation. But it is an intuitive method for understanding conditional probability, that seems more likely (ha!) to come up with an reasonably accurate answer for many people.

Read the rest of Strogatz’s article for other examples of intuitive conditional probability calculations, including a great example from the OJ Simpson trial.

New York Times Opinionator: Chances Are

- Advertisement -

Link to original post

TAGGED: statistics
DavidMSmith April 27, 2010
Share this Article
Facebook Twitter Pinterest LinkedIn
Share
- Advertisement -

Follow us on Facebook

Latest News

construction analytics
5 Benefits of Analytics to Manage Commercial Construction
Analytics
database compliance guide
Four Strategies For Effective Database Compliance
Data Management
Digital Security From Weaponized AI
Fortifying Enterprise Digital Security Against Hackers Weaponizing AI
Security
DevOps on cloud
Optimizing Cost with DevOps on the Cloud
Cloud Computing Development Exclusive IT

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data science use advertising
Big DataMarketing

The Low-Down On Using Data Science And Statistics In Advertising

6 Min Read

Big Data Analytics: The Four Pillars

9 Min Read
google nexus BI lesson
Uncategorized

4 Retail BI Lessons to Learn from Google’s Nexus Fail

5 Min Read

Data Visualizations: The Tip of the Iceberg of Understanding

0 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence Chatbots Exclusive
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?