By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    analyst,women,looking,at,kpi,data,on,computer,screen
    What to Know Before Recruiting an Analyst to Handle Company Data
    6 Min Read
    AI analytics
    AI-Based Analytics Are Changing the Future of Credit Cards
    6 Min Read
    data overload showing data analytics
    How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
    8 Min Read
    hire a marketing agency with a background in data analytics
    5 Reasons to Hire a Marketing Agency that Knows Data Analytics
    7 Min Read
    predictive analytics for amazon pricing
    Using Predictive Analytics to Get the Best Deals on Amazon
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Newsflash: Correlation is Not a Cause!
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Best Practices > Newsflash: Correlation is Not a Cause!
Best PracticesBusiness RulesExclusivePredictive Analytics

Newsflash: Correlation is Not a Cause!

paulbarsch
Last updated: 2011/07/13 at 2:16 PM
paulbarsch
5 Min Read
SHARE

Just about every data scientist and statistician knows that correlation doesn’t necessarily confirm causation. However, popular business and social literature often confuse the two concepts. By understanding the maxim of “correlation is not a cause” more clearly, it’s possible to let loose creativity and imagination of the questioning mind.

Just about every data scientist and statistician knows that correlation doesn’t necessarily confirm causation. However, popular business and social literature often confuse the two concepts. By understanding the maxim of “correlation is not a cause” more clearly, it’s possible to let loose creativity and imagination of the questioning mind.

Humans like to think and speak in declarative terms. For a sampling, imagine statements bandied about by pundits such as; “global warming is caused by humans”, or “the Financial Crisis of 2008 was caused by greedy bankers” or “Republicans lost the 2008 election because they didn’t pay enough attention to immigration issues.”

More Read

data science use advertising

The Low-Down On Using Data Science And Statistics In Advertising

What To Know About Using Artificial Intelligence For Big Data Analysis
How Audience Marketing Allows for Better Analytics of Brand Reputation
The SMART Way to Use Big Data for Retail Businesses
Big Data Analytics: The Four Pillars

Psychologist and author Sue Blackmore says the simple reminder that “correlation is not a cause” (CINAC), would improve just about everyone’s mental toolkit. Case in point, in an Edge.org article, she gives an example of people filling up a railway station as a scheduled train approaches.  She asks, “Did the people cause the train to arrive (A causes B)? Or did the train cause people to arrive (B causes A)?” The answer she says is they both depended on a railway timetable (C caused both A and B)!

Editor’s note: Paul Barsch is an employee of Teradata. Teradata is a sponsor of The Smart Data Collective.

In linear systems, cause and effect is much easier to pinpoint. However, the world around us is considered a complex system where there are often multiple variables pushing an outcome to occur. Nigel Goldenfeld, a professor of physics at University Illinois, sums it up best: “For every event that occurs, there are a multitude of possible causes, and the extent to which each contributes to the event is not clear. One might say there is a web of causation.”

And author Richard Bookstaber says that it’s a difficult search to pinpoint cause in complex systems especially because, “a change in one component can propagate through the system to lead to surprising and apparently disproportionate effect elsewhere, e.g. the famous “butterfly effect””.

The concept that in complex systems there is a “web of causation” may not sit right with some individuals, especially since newscasters, publishers, and even a fair portion of scientists prefer to insist on simple declarations of true and false.  However, the very nature of complex systems is that every object is in some way linked to another with either weak or strong ties and often connections are opaque and mysterious. So even a correlation of one, may not necessarily mean A causes B.

Freeing ourselves from the shackles of CINAC thinking means we have the possibility to let loose our imaginations says psychologist Sue Blackmore. Each definitive report should be greeted with skepticism. And when “A causes B” is held up as the answer, Blackmore cautions, then the critical mind automatically gets to work thinking; “Maybe instead, B actually causes A! And if not, what are the other opportunities?”

It’s human nature to try and explain the world around us. However, when it comes to complexity, we should lead discussions with a measure of humility to include questions and possibilities rather than declarations of certainty.

Questions:

  • How does our “aim to explain” end up stifling innovation and creativity?
  • The US Securities and Exchange Commission posited an explanation for the May 6, 2010 “Flash Crash”, but experts are not buying their simplistic explanation of a single “trigger event”. What are your thoughts?

TAGGED: analysis, Correlation does not imply causation, statistics
paulbarsch July 13, 2011
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data breaches
How Hospital Security Breaches Devastate Local Communities
Policy and Governance
analyst,women,looking,at,kpi,data,on,computer,screen
What to Know Before Recruiting an Analyst to Handle Company Data
Analytics
data perspective
Tackling Bias in AI Translation: A Data Perspective
Big Data
Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Best Practices Big Data Data Collection Data Management Privacy

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data science use advertising
Big DataMarketing

The Low-Down On Using Data Science And Statistics In Advertising

6 Min Read
artificial intelligence for big data analysis
Artificial IntelligenceBig Data

What To Know About Using Artificial Intelligence For Big Data Analysis

6 Min Read
predictive analytics for audience marketing
AnalyticsExclusiveMarketingNewsPredictive Analytics

How Audience Marketing Allows for Better Analytics of Brand Reputation

7 Min Read
big data for retail industry
AnalyticsBig DataBusiness Intelligence

The SMART Way to Use Big Data for Retail Businesses

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data
AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?