We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Big Data and Day Trading: The Good, the Bad, the Ugly.
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > Big Data and Day Trading: The Good, the Bad, the Ugly.
CommentaryData Mining

Big Data and Day Trading: The Good, the Bad, the Ugly.

gjmount
gjmount
5 Min Read
Big Data and Day Trading: The Good, the Bad, the Ugly.
Illustration generated with FLUX.2 [klein 4B] via Cloudflare Workers AI.
SHARE

profit-1139073_960_720

Read more and subscribe at georgejmount.com 

These days, I can’t check my LinkedIn without seeing something about data science. Everybody’s on CodeAcademy and Coursera, dreaming of that sexiest of job titles: “Data scientist.”

I’m all for making data an asset, but I see some troubling comparisons between big data and the day trading of the 1990s.

More Read

Because It's the Weekend: Cube-Solving Lego Robot
Because It’s the Weekend: Cube-Solving Lego Robot
SAS and Socialytics
Next Gen Research Group on LinkedIn
When is CAPEX Coming Back?
The Enterprise Graph – From Connections To Customer Insights

While I was only in grade school back then, I studied it a bit in college and grad school.

I make no bones about being either a stock trader or a data scientist. But I do have a master’s in finance and a post-grad certificate in business analytics from two leading business schools, so I hope my comparisons aren’t completely unfounded.

If you are either of these, please share your thoughts in the comments. And go easy on me, I was preparing ribs for the holiday weekend while writing this post :)

I see some similarities between data science and the day trading of a generation ago. They share similar origin stories and fatal flaws.

Here’s how they’re similar — the good, the bad, and the ugly.

The good: democratized information.

Both day trading and big data are a result of the opening up of information to the average end-user.

Back in the 90s, for the first time, traders could easily check prices during the day, run models, and trade from anywhere on the planet.

Similarly today and big data. Using cloud servers and cheap BI software, anyone can crunch huge amounts of data at very little cost.

Democratization and low barrier entries are great. The economy has benefitted tremendously from the abundance of capital and information that these two trends have brought about. 

I am all for this part. Sadly, other trends aren’t so good.

The bad: get rich quick.

I know people who dream of taking Coursera classes, installing a home server, and striking it big as a data scientist. 

This reminds me of the disgruntled 90s employer who would be crushing it in his slippers, if he would only quit his job.

We saw what happened to most day traders. They simply weren’t as smart as they thought. Some did crush it, but it’s nearly impossible to keep out-guessing the market.

I think the same is going to happen in data science. It’s not a 1:1 analogy because some datasets are proprietary and not publicly traded. But it is happening, as more and more data is becoming crowdsourced.

The other setback is hubris and theory, which brings me to my next point. 

The ugly: we’re too smart for theory

The backseat treatment of theory is the most devastating aspect I that see in both the day trading and big data phenomenon.

There’s an attitude that we have mastered the data so thoroughly that we don’t need to consider human behavior or classical economic theory. 

I think of Long Term Capital Management or even the housing bubble. So sure were they that their financial engineering could withstand any calamity, they overlooked catastrophes that simple economic theory could have helped predict.

I wonder if there’s an element to this with big data. It has increasingly become “data mining.” 

While classical statistics may have asked first and shot later, data mining shoots first and ask questions later. Theory takes the back seat. 

This has its place. But it is easy to become overconfident in models that are developed this way. You see that the model works, but you’re not quite sure why. This is dangerous. This is partly where day trading went wrong. And this is where data science veers, as well.

Before you place a put on my stock…

What do you think of these comparisons? Unfounded, partially true, or should I just stick to drinking beer this weekend? 

George J. Mount holds a bachelor of arts magna cum laude in economics from Hillsdale College, a master of science in finance from Case Western Reserve University, and a postgraduate certificate in business analytics from Indiana University. He blogs regularly atgeorgejmount.com.

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Predictive Analytics: 8 Things to Keep in Mind (Part 1)
Business IntelligenceData MiningPredictive Analytics

Predictive Analytics: 8 Things to Keep in Mind (Part 1)

6 Min Read
2009 Marketing Trends and Thoughts on Web 2.0
Business IntelligenceCRMData MiningPredictive Analytics

2009 Marketing Trends and Thoughts on Web 2.0

3 Min Read
Semantic analytics serves the truth & vegetables from a social media diet
Data MiningText Analytics

Semantic analytics serves the truth & vegetables from a social media diet

5 Min Read
How Big Data Will Change Marketing Forever
AnalyticsBig DataBusiness IntelligenceCloud ComputingData MiningITMarketingPredictive AnalyticsSentiment AnalyticsSocial DataSocial Media AnalyticsText AnalyticsUnstructured Data

How Big Data Will Change Marketing Forever

7 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?