Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    big data and customer service outsourcing
    How Data Analytics Improves Customer Service Outsourcing
    18 Min Read
    How a Specialized Marketing VA Improves Campaign Analytics
    How a Specialized Marketing VA Improves Campaign Analytics
    11 Min Read
    New Data Analytics Breakthroughs Give eCommerce Startups a Fighting Chance
    New Data Analytics Breakthroughs Give eCommerce Startups a Fighting Chance
    6 Min Read
    How Data Analytics Is Reshaping Patient Financing Decisions
    How Data Analytics Is Reshaping Patient Financing Decisions
    13 Min Read
    business using business intelligence
    How to Use a Competitive Intelligence Dashboard to Turn Market Data Into Smarter Marketing Decisions 
    9 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: The Problem with Investing Based on Pattern Recognition
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > The Problem with Investing Based on Pattern Recognition
Analytics

The Problem with Investing Based on Pattern Recognition

ChrisDixon
ChrisDixon
4 Min Read
SHARE

A famous story in artificial intelligence is how the US military developed algorithms to determine whether an image had a tank in it. They used a standard machine learning method: feed the computer a “training set” of photos, some of which had tanks in them and some of which didn’t, and let algorithms identify which features in the photos correlated to tanks being shown.

A famous story in artificial intelligence is how the US military developed algorithms to determine whether an image had a tank in it. They used a standard machine learning method: feed the computer a “training set” of photos, some of which had tanks in them and some of which didn’t, and let algorithms identify which features in the photos correlated to tanks being shown.

This method worked for a while but then mysteriously stopped working. Since the features the computer identified were embedded in complicated mathematical equations, no one could figure out what it was really doing and therefore why it stopped working. Eventually someone realized that in the training set, all of the images with tanks were taken on a cloudy day, and all the images without tanks were taken on a sunny day. The algorithms had fixated on the most obvious pattern – the color of the sky. When the algorithm was tested on new photos where the weather varied, it was completely flummoxed.

More Read

5 Sure-Fire Ways to Use Analytics to Become a Social Business
The Role of Predictive Analytics in Forecasting using Business Intelligence
One-Number Forecasting: A New Worst Practice?
SAS Innovates into the Big Data Analytics Era
Human Resources Analytics – Actionable Insights From Employee Satisfaction Surveys

It is commonly said that good startup investors develop “pattern recognition” that allows them to identify great entrepreneurs and companies. If you look at the hugely successful startups of the last decade, the founders have many similarities that are easy to observe. When they started, many were male, young, unmarried, computer programmers, dropouts of elite universities, etc. As a result, a lot of investors look for founders with these characteristics. But without an understanding of the deeper reasons these founders succeeded, these observable characteristics could just as well be the color of the sky and not the tanks.

At the level of individual investors, pattern recognition can lead to bad investments and missed opportunities. In the context of markets, it can cause companies and sectors with the “right patterns” to be overvalued, and ones with the “wrong patterns” to be undervalued. In the broader cultural context, it can cause large groups of talented entrepreneurs to be denied access to capital.

The classic scientific method provides a better model for investing. Scientists observe data, notice patterns, develop hypotheses, and then test those hypotheses. Pattern recognition is only a step along the way to developing hypotheses about the underlying cause.

Perhaps dropping out of college shows a strong level of commitment. Knowing computer science was probably a necessary condition for starting a tech company in the past, but no longer is. Being young could mean you are inexperienced enough to pursue bold ideas that more experienced people would consider crazy. I am just speculating – I don’t know why these characteristics are common among past successful founders. But the mere repetition of patterns shouldn’t be satisfactory to anyone who wants to understand and predict the success of startups.

TAGGED:Data Science
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

big data for non-QR lending in real estate
How Real Estate Investors Can Use Big Data for Non-QM Lending
Big Data Exclusive
ai video ad generation
How to Build High-Performing Ad Creatives with an AI Short Ad Video Maker?
Artificial Intelligence
big data and customer service outsourcing
How Data Analytics Improves Customer Service Outsourcing
Analytics Exclusive
The End of Unstructured Marketing: Forcing Generative AI into Strict HTML Schemas
The End of Unstructured Marketing: Forcing Generative AI into Strict HTML Schemas
Artificial Intelligence Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

How to Become a Data Scientist

4 Min Read
data scientists can consider careers as ethical hackers
News

5 Reasons for Data Scientists To Learn Ethical Hacking

9 Min Read
data science and business in big data
Big DataBusiness IntelligenceData ScienceExclusive

The Connection Between Data Science And Business In Big Data

6 Min Read
data science solve cybersecurity challenges
AnalyticsBest PracticesBig DataData ManagementData ScienceExclusiveITPredictive AnalyticsRisk ManagementSecurity

Can Advancements In Data Science Address The Challenges To Cybersecurity?

7 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive
giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?