By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Is the Mother of All Black Swans Coming?
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Predictive Analytics > Is the Mother of All Black Swans Coming?
Predictive Analytics

Is the Mother of All Black Swans Coming?

PaulBarsch1
Last updated: 2009/08/05 at 5:08 PM
PaulBarsch1
4 Min Read
SHARE

dragon kingWhether you like Nassim Taleb’s writing style or not, his books and the ideas within are worth careful study.

For example, a key theme of Nassim Taleb’s “The Black Swan” is to pay close attention to the possibility of the rare event, the outlier that brings devastating consequence. Taleb forcefully and intelligently argues that these outliers are much more common than we think (1 in 100 year floods happen every 3-5 years) especially when we base our statistical analysis on the assumptions of a normal distribution of data and independence.

However, some interesting research by Didier Sornette at the Swiss Federal Institute of Technology shows that while power laws can explain some of the extreme events that have taken place in history, there are some extreme outliers that even defy classic power laws.

A post in MIT’s Technology Review blog cites the following:

More Read

cloud computing data management solution

The ABC of Data Capacity Management: Always Be (Thinking) Cloud

100 Petabytes of Data in Poop?
Fight Back Against Black Swan Fatigue
How They Fit Together: Bell Curves, Bayesian Inference and Black Swans
Of Baby Black Swans and the Race to Zero

“Sornette gives as an example the distribution of city sizes in France, which follows a classic power law, meaning that there are many small cities and only a few large ones. On a log-to-log scale, this distribution gives a straight line–except for Paris, which is an outlier and many times larger than it ought to be if …


dragon kingWhether you like Nassim Taleb’s writing style or not, his books and the ideas within are worth careful study.

For example, a key theme of Nassim Taleb’s “The Black Swan” is to pay close attention to the possibility of the rare event, the outlier that brings devastating consequence. Taleb forcefully and intelligently argues that these outliers are much more common than we think (1 in 100 year floods happen every 3-5 years) especially when we base our statistical analysis on the assumptions of a normal distribution of data and independence.

However, some interesting research by Didier Sornette at the Swiss Federal Institute of Technology shows that while power laws can explain some of the extreme events that have taken place in history, there are some extreme outliers that even defy classic power laws.

A post in MIT’s Technology Review blog cites the following:

“Sornette gives as an example the distribution of city sizes in France, which follows a classic power law, meaning that there are many small cities and only a few large ones. On a log-to-log scale, this distribution gives a straight line–except for Paris, which is an outlier and many times larger than it ought to be if it were to follow the power law.”

The article also mentions that the city of London also follows this same example.

Sornette calls these extreme outliers “Dragon Kings.” A sobering commentary from the article ensues; “(The) seemingly ubiquitous presence of these dragon kings in all kinds of data sets means that extreme events are significantly more likely than power laws suggest.”

This in turn suggests that the Mother of all Black Swans might be unaccounted for in your data set. And if this is the case, does this mean that we cannot only not predict these extreme events, but that preparation is futile?

I would love to hear your thoughts!


Link to original post

TAGGED: black swan, nassim taleb
PaulBarsch1 August 5, 2009
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

cloud computing data management solution
Big DataBusiness IntelligenceCloud ComputingData Warehousing

The ABC of Data Capacity Management: Always Be (Thinking) Cloud

5 Min Read

100 Petabytes of Data in Poop?

6 Min Read

Fight Back Against Black Swan Fatigue

5 Min Read

How They Fit Together: Bell Curves, Bayesian Inference and Black Swans

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?