We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
    chatgpt image jul 21, 2026, 04 34 30 pm
    4 Core Benefits of Predictive Maintenance after Vibration Analysis
    10 Min Read
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results -- AI-generated illustration
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results
    11 Min Read
    chatgpt image jul 13, 2026, 04 23 45 pm
    How Data Analytics Helps Companies Improve User Engagement
    19 Min Read
    chatgpt image jul 13, 2026, 03 59 46 pm
    How Data Analytics Improves Multi-Location Search Strategies
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Underestimating the tails
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > Underestimating the tails
Data MiningPredictive Analytics

Underestimating the tails

DavidMSmith
DavidMSmith
3 Min Read
Underestimating the tails
Illustration generated with FLUX.2 [klein 4B] via Cloudflare Workers AI.
SHARE

Collective wisdom about the location of Ground Zero for the credit crisis seems to be coalescing around AIG’s Financial Products Unit (AIGFP), which basically invented the credit default swaps at the center of the whole mess. TPMmuckraker provides an excellent history of AIGFP: its inception, rise, and eventual downfall (taking AIG and the economy with it).

I want to focus on one small nugget from that history, under the heading “The Seed Of Ruin Is Planted”. It documents the very first credit default swap deal AIGFP made, in 1998:

JP Morgan approached AIG, proposing that, for a fee, AIG insure JP Morgan’s complex corporate debt, in case of default. According to computer models devised by Gary Gorton, a Yale Business Professor and consultant to the unit, there was a 99.85 percent chance that AIGFP would never have to pay out on these deals. Essentially, this would happen only if the economy went into a full-blown depression.

(Emphasis mine.) I’d guess that 0.15% under-estimated the risk that AIG would have to pay out for these deals, possibly by a significant margin (but hey, that’s easy to claim that with the hindsight we now have). That 99.85% figure is almost certainly an estimate of probability given that the assumptions of the model are upheld. Now, I don’t know anything about the underlying model per se, but I’m willing to bet that the data used to estimate it didn’t go back at least 70 years, to cover the period of the last full-blown (aka Great) depression. Credit Default Swaps are complex instruments, and it’s likely that much of the data needed to build and estimate the model simply doesn’t exist with more than a 10-20 year history at best. So it may be fair to say that there’s a 0.15% chance of failure if a series of fairly unusual things happen, and by “unusual” I mean in the context of the last 20 years. But if a full-blown depression does occur, the model is no longer valid, because it’s never seen data relevant to a depression occurring. In that case, when it comes to estimates of risk and probability, all bets are off. 

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Technical architecture diagram and decision framework for ai-powered logo generation: design.com vs looka
AI-Powered Logo Generation: Design.com vs Looka
Artificial Intelligence Exclusive
Retailers Should Stop Treating Every Stockout as Equal -- AI-generated illustration
Retailers Should Stop Treating Every Stockout as Equal
Business Intelligence Exclusive
Best Vibe Coding Cleanup Specialists in the USA: Fix or Rebuild? -- AI-generated illustration
Best Vibe Coding Cleanup Specialists in the USA: Fix or Rebuild?
Development Exclusive
Using Warehouse, Transportation and Order Data to Plan Distribution-Center Capacity -- AI-generated illustration
Using Warehouse, Transportation and Order Data to Plan Distribution-Center Capacity
Big Data Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

The Life Saved By a Database May Be Your Own! Dot-Connecting Is Serious Business
Business IntelligenceData Mining

The Life Saved By a Database May Be Your Own! Dot-Connecting Is Serious Business

5 Min Read
The Datafication of People and Stuff and Things
Big DataBusiness IntelligenceData MiningData WarehousingHadoopSocial DataUnstructured DataWorkforce Data

The Datafication of People and Stuff and Things

5 Min Read
Information Availability: Exploiting the Full Value of Information to Drive Business
AnalyticsBusiness IntelligenceData QualityPredictive AnalyticsSentiment AnalyticsSQLText AnalyticsUnstructured Data

Information Availability: Exploiting the Full Value of Information to Drive Business

5 Min Read
Mobile Advertising, Clustering Algorithms, and Your Ticket for a Free Ride
AnalyticsBig DataCollaborative DataData MiningData VisualizationExclusiveITLocationMarketingMarketing AutomationMobilityPredictive AnalyticsSocial DataSocial Media AnalyticsSoftwareStatistics

Mobile Advertising, Clustering Algorithms, and Your Ticket for a Free Ride

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

From Bolts to Bots: How AI Is Fortifying the Automotive Industry
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?