By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data-driven white label SEO
    Does Data Mining Really Help with White Label SEO?
    7 Min Read
    marketing analytics for hardware vendors
    IT Hardware Startups Turn to Data Analytics for Market Research
    9 Min Read
    big data and digital signage
    The Power of Big Data and Analytics in Digital Signage
    5 Min Read
    data analytics investing
    Data Analytics Boosts ROI of Investment Trusts
    9 Min Read
    football data collection and analytics
    Unleashing Victory: How Data Collection Is Revolutionizing Football Performance Analysis!
    4 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Big Data and Ford’s Faster Horses
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > Big Data and Ford’s Faster Horses
Big DataCollaborative DataData QualityKnowledge ManagementPredictive Analytics

Big Data and Ford’s Faster Horses

Arent van 't Spijker
Last updated: 2014/09/16 at 2:59 AM
Arent van 't Spijker
5 Min Read
Image
SHARE

Image

Image

In the late 19th century, a New York City planner put out a warning that by 1950 the city would be completely uninhabitable. The problem, as he saw it, was that at the current growth rates the city would not be able to sustain the growing number of horses. And, more importantly, their waste products. By 1950, so the city planner reasoned, New York would be fully covered in horse manure.

I’m sure for most of you, the anecdote will bring a smile to your face. The city planner, most will reason, was proven wrong because horses were replaced by cars which at least in part, solved the problem. Solid reasoning, but not quite. For cars were not invented to counter the problem of rising piles of horse droppings in the street of America. Cars were invented because people saw an opportunity to overcome the downsides of transportation by horses, not the downfall of their excrements. There may be a correlation between horse manure and the invention of the car, but there is no causality.

More Read

data security unveiled

Data Security Unveiled: Protecting Your Information in a Connected World

Green Data Centers Make Data-Driven Entities More Sustainable
NIST 800-171 Safeguards Help Non-Federal Networks Handling CUI
The Role of Data in Automating Healthcare Processes for Improved Patient Results
Does Data Mining Really Help with White Label SEO?

In a similar fashion, there seems to be a lot of ‘horse manure’ in Big Data. People know me as a protagonist for Big Data and data driven strategies in organizations. But I seem to come across more and more articles promoting Big Data as the ideal solution for ‘predictive analytics’: the use of increasingly large datasets to determine events that will take place in the future. The thought of ‘using larger datasets to improve predictive capability’ should raise a big red flag for anyone. I know from experience that predictive analytics is a viable and reliable solution to some problems. And prediction accuracy can be tinkered to achieve impressive results. But only because some impressively smart people do the tinkering, and hardly ever because they have more data.

In his recent book ‘Big Data: A Revolution That Will Transform How We Live, Work, and Think’, Victor Mayer-Schonberger, offers some compelling examples of predictive analytics, such as how doctors, by analyzing data from hundreds of new born babies, now know that the tell tale signs of an infection in a new born is not the de-stabilization of primary health functions in the baby, but the stabilization of them. Or how fire departments, by analyzing data from previous fires in combination with real estate data and social-demographic data about inhabitants, can quite accurately predict the outbreak of fires and better plan their readiness for particular types of fires in particular neighborhoods. But all of the examples have something important in common: the predictions are not better than usual because of the volume of the dataset, but because of the combination of the right data and a limited and controllable set of variables to tinker with. For people who know what they are talking about it is relatively easy to establish causalities among the correlations presented by Big Data technology. Don’t get me wrong: I’m not downplaying Big Data. But I am downplaying the capability of Big Data to solve problems on its own. It takes in-depth knowledge of the problem to spot the potential solutions that Big Data offers in the range of correlations. Otherwise one may just end up predicting the downfall of a major city by manure.

Luckily for New York, the invention of the car at the beginning of the twentieth century turned the tide on the horse droppings. But it was a narrow escape. Because if it hadn’t been for the stubbornness of one of the leaders in the infant car industry, the problem might just as easily have been increased. After all, it was none other than Henry Ford who said “if I had listened to my customers, I would have built faster horses.”

Arent van 't Spijker September 16, 2014
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

iot and cloud technology
IoT And Cloud Integration is the Future!
Internet of Things
ai in marketing
4 Ways AI Can Improve Your Marketing Strategy
Artificial Intelligence
data security unveiled
Data Security Unveiled: Protecting Your Information in a Connected World
Security
it management for data-driven businesses
7 Major IT Infrastructure Challenges for Data-Driven Companies
IT

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data security unveiled
Security

Data Security Unveiled: Protecting Your Information in a Connected World

8 Min Read
green data center
Big Data

Green Data Centers Make Data-Driven Entities More Sustainable

12 Min Read
data security
Data Management

NIST 800-171 Safeguards Help Non-Federal Networks Handling CUI

5 Min Read
role of big data in healthcare in automation
Big DataExclusive

The Role of Data in Automating Healthcare Processes for Improved Patient Results

7 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?