We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
    chatgpt image jul 21, 2026, 04 34 30 pm
    4 Core Benefits of Predictive Maintenance after Vibration Analysis
    10 Min Read
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results -- AI-generated illustration
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results
    11 Min Read
    chatgpt image jul 13, 2026, 04 23 45 pm
    How Data Analytics Helps Companies Improve User Engagement
    19 Min Read
    chatgpt image jul 13, 2026, 03 59 46 pm
    How Data Analytics Improves Multi-Location Search Strategies
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Why Predicting the Future is So Darn Difficult
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Culture/Leadership > Why Predicting the Future is So Darn Difficult
AnalyticsCulture/LeadershipExclusiveModelingPredictive AnalyticsRisk Management

Why Predicting the Future is So Darn Difficult

paulbarsch
paulbarsch
5 Min Read
Why Predicting the Future is So Darn Difficult
Illustrative image generated with OpenAI gpt-image-1.
SHARE

Predicting the future is difficult—just ask George Soros.  While Soros is often celebrated for the $1 billion profit he made in 1992 on a bet that the pound sterling would collapse in valuation, other trades ended up costing him almost as much money as he made.

As detailed in Sebastian Mallaby’s “More Money than God”, leading up to October 19, 1987, Soros’ Quantum fund had been up 60%.  However, when “Black Monday” hit and the Dow Jones lost 22.6% of its value, Soros was in the middle of the mess deciding whether to sell or buy. While he held his positions through Wednesday of that week, on Thursday he abruptly changed his mind and sold positions worth $1 billion.  Soros’ decision to unload his massive portfolio sparked other traders to also sell stocks and bonds, thus causing a downward spiral in markets. At the end of the day, Soros was out of the market; however his Quantum fund lost $840 million!

Alas, that’s the problem with gut decision making, you say. Soros should have used quantitative analysis, right?  Even quantitative analysis can produce the wrong outcome.

Editor’s note: Paul Barsch is an employee of Teradata. Teradata is a sponsor of The Smart Data Collective.

More Read

Deep Learning Is Creating A Competitive Edge For Social Traders
Deep Learning Is Creating A Competitive Edge For Social Traders
Predictive Analytic Strategies to Out-Predict the Competition
The Evolving Importance of Analytics in Generating Leads through PPC
How Big Data Opens The Door For Awesome Broadband Deals
Understanding User Expectations

According to Roger Lowenstein’s “When Genius Failed”, hedge fund Long Term Capital Management (LTCM) was chock full of the best minds in finance.  Assembling PhDs in finance, mathematics, economics and more, LTCM partners built sophisticated trading models based on the assumption that while investors sometimes panic or get too optimistic, eventually markets settle towards equilibrium. And in moments of panic or too much optimism, LTCM’s partners believed there was money to be made.

Unfortunately, LTCM is a case study in over reliance on analytical models for decision making.  Lowenstein writes, “LTCM Partners believed that all else being equal, the future would look like the past” and this—of course—turned out to be a calamitous assumption. LTCM bet heavily on models, often doubling down on investments that they believed had an infinitesimal probability of failing. The assumption underpinning these models was that markets are efficient and rational. And when markets proved otherwise, Lowenstein notes, “The fund with the highest IQs lost 77% of its capital, while the ordinary stock investor doubled his money during the same period.”

It is apparent in studying Soros and LTCM, that even the most experienced minds supplemented by analytical tools and techniques can make extremely poor decisions about the future.  So why is predicting the future so difficult?

In Scientific American, author Michael Shermer has an answer. He says that the world is a “messy, complex and contingent place with countless intervening variables and confounding factors which our brains are not equipped to evaluate.”  He says we should stick to short term predictions rather than those longer term trends which we so often get wrong.

Does this mean that any attempt to predict the future is for naught? Of course not, as there are definitely limited applications for prediction models in preventing fraud, recommending products, discerning customer defections, and more. Even three day weather forecasts are more right than wrong!

The real lesson is that predicting the future is hard, especially when we’re confronted with millions of potential variables. Deciding which variables to pay attention to, and weighting the importance of those variables is especially difficult.

And maybe then, the solution is not so much to spend countless hours predicting the future (especially for strategic decisions), but instead to expend energy preparing for it. 

Question:

  • Do you agree with Michael Shermer that our brains are not equipped to evaluate our “messy world”?
  • What other case studies have you encountered where either gut or analytical decision making was taken to the extreme?
TAGGED:Decision Makingforecastingrisk management
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects weekly technician productivity and related shop metrics to timely scheduling an
Workforce Analytics for Auto Repair Shops: Reading Technician Productivity Weekly
Business Intelligence Exclusive
Flat editorial illustration: A business-editorial depiction of two account-growth routes: data-guided targeted advertising and cr
Targeted Ads and Cross-Promotion: Using Audience Segments and Platform Statistics to Grow
Exclusive Social Data
Flat editorial illustration: Business and SaaS-editorial concept: a prospective development team proves its fit by testing a boun
Hiring a Dedicated Development Team for Your Existing Stack and Delivery Process
Development Exclusive
Flat editorial illustration: The article is about modernizing legacy software incrementally without stopping live operations. A t
7 Top Legacy Software Modernization Companies in Europe for 2027
Exclusive Software

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Lessons from Social Media Meet-Up, Part I – Measuring is Easy; Evaluation is Hard.
Predictive Analytics

Lessons from Social Media Meet-Up, Part I – Measuring is Easy; Evaluation is Hard.

7 Min Read
Forecasting Lessons from Heathrow’s Snowpocalypse
AnalyticsDecision ManagementPredictive Analytics

Forecasting Lessons from Heathrow’s Snowpocalypse

4 Min Read
data migration risk prevention
Big DataData ManagementExclusiveRisk Management

Best Approach to Risk Management for Data Migration in Data-Driven Businesses

8 Min Read
Improving customer interactions one decision at a time
CRM

Improving customer interactions one decision at a time

4 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?