We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
    chatgpt image jul 21, 2026, 04 34 30 pm
    4 Core Benefits of Predictive Maintenance after Vibration Analysis
    10 Min Read
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results -- AI-generated illustration
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results
    11 Min Read
    chatgpt image jul 13, 2026, 04 23 45 pm
    How Data Analytics Helps Companies Improve User Engagement
    19 Min Read
    chatgpt image jul 13, 2026, 03 59 46 pm
    How Data Analytics Improves Multi-Location Search Strategies
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Companies encountering a data engineering talent vacuum
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > Companies encountering a data engineering talent vacuum
Big DataData Mining

Companies encountering a data engineering talent vacuum

CIO Dive
CIO Dive
3 Min Read
Companies encountering a data engineering talent vacuum
Illustration generated with Qwen Image.
SHARE

This post originally appears on our sister publication, CIO Dive. Our mission is to provide busy professionals like you with a bird’s-eye-view of the Information Technology industry in 60 seconds. To subscribe to our daily newsletter click here.

Contents
  • Dive Brief:
  • Dive Insight:

Dive Brief:

  • Demand for data engineers is growing faster than demand for data scientists, according to research from Stitch. 
  • From 2013 to 2015, the number of data engineers grew 122%, while the number of data scientists grew 47% in the same time frame, according to the report. But though the pipeline for data engineers is growing, demand is far outpacing the number of data engineers on the market. On LinkedIn there are only 6,500 people who call themselves data engineers. But, according to the report, there are at least 6,600 job listings for data engineers in San Francisco alone. 
  • More than 40% of data engineers come from a software engineering background and the top five skills include SQL, Java, Python, Hadoop and Linux.

Dive Insight:

The labor market for talented tech personnel is growing increasingly competitive, especially in places with a large concentration of technology companies. In January, Robert Half Technology released its 2016 Salary Guide for Technology Professionals and found there is still more demand than supply for IT professionals, creating a competitive recruiting environment.

But organizations have increased demand for specialized roles, especially those involving data, which can help companies better understand their customer and how their products work on the market. To understand that data, companies have to have clean pipelines that can facilitate analysis. That’s where data engineers step in.

Data engineering skill sets can vary depending on company size, according to the report, but now data engineers are tasked with working on large data architecture problems rather than working with business intelligence systems.

More Read

Documents: Your Information Lifeblood
Documents: Your Information Lifeblood
Derailing Your Supply Chain BI Project
Government’s Big Data Affected by Shutdown
How to Pivot Your Data
Big Data: Google’s #1 Weapon against Web Spam

This post originally appears on our sister publication, CIO Dive. Our mission is to provide busy professionals like you with a bird’s-eye-view of the Information Technology industry in 60 seconds. To subscribe to our daily newsletter click here.

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article explains that training robots for physical interaction requires three distinct data cate
Physical AI: What Data Do You Need to Train a Robot?
Artificial Intelligence Exclusive Robotics
What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
Analytics Big Data Exclusive Software
Flat editorial illustration: The article examines AI agents that escalate from legitimate data retrieval to attempted intrusions
OpenAI’s Government Website Incidents Raise a Hard Question for AI Agents: When Should They Stop?
Artificial Intelligence News Security
Flat editorial illustration: The article's core relationship is the alignment between customer behavioral data (visit frequency,
Data-Driven Loyalty: How Restaurants Use Behavioral Analytics to Optimize Revenue
Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

The election in Iran and some real data analysis
Data Mining

The election in Iran and some real data analysis

4 Min Read
Algorithmic Trading
AnalyticsBig DataBusiness IntelligenceDecision ManagementRisk Management

The Use of Big Data Analytics in Algorithmic Trading

6 Min Read
The Data Outhouse
Data Quality

The Data Outhouse

11 Min Read
Big Data

Big Data Changing the Face of Healthcare

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

5 Great Tips for Using Data Analytics for Website UX
5 Great Tips for Using Data Analytics for Website UX
Big Data
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?