Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
    pexels pavel danilyuk 8112119
    Data Analytics Is Revolutionizing Medical Credentialing
    8 Min Read
    data and seo
    Maximize SEO Success with Powerful Data Analytics Insights
    8 Min Read
    data analytics for trademark registration
    Optimizing Trademark Registration with Data Analytics
    6 Min Read
    data analytics for finding zip codes
    Unlocking Zip Code Insights with Data Analytics
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Finding the Best Big Data Talent Through Crowdsourcing
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Culture/Leadership > Finding the Best Big Data Talent Through Crowdsourcing
Culture/Leadership

Finding the Best Big Data Talent Through Crowdsourcing

jonathanbuckley
jonathanbuckley
6 Min Read
Image
SHARE

ImageBusinesses have been eager to use big data as a way to grow their companies, reach more customers, and make their operations more efficient, but utilizing big data analytics takes having the right talent at hand. Data scientists can be highly valuable members of any workforce, but at the moment, the demand for them is far outpacing their numbers.

ImageBusinesses have been eager to use big data as a way to grow their companies, reach more customers, and make their operations more efficient, but utilizing big data analytics takes having the right talent at hand. Data scientists can be highly valuable members of any workforce, but at the moment, the demand for them is far outpacing their numbers. While estimates vary, some experts place the shortfall of data scientists as high as 140,000. Some are even referring to this shortage as a “crisis.” Put simply, businesses want to have data scientists on their teams, but finding them has proven exceptionally challenging. The problem doesn’t appear to be going away either, with more and more companies seeking to hire data scientists each year. With this problem clearly in mind, organizations are looking for alternative approaches to finding the right data talent. One of those ways that has slowly gained more acceptance is the use of crowdsourcing. While it may seem an odd choice for finding data scientists who are talented at machine learning, big data platforms, and engines like Apache Spark, crowdsourcing could prove to be an effective means to discover the people who would make perfect fits for a business.

One of the best examples of finding success with this approach comes from Walmart. While some may think a large company like that shouldn’t have any difficulty finding the talent they want, Walmart executives were finding the data talent shortage a significant barrier. To solve the problem, they turned to Kaggle, a crowdsourced analytics competition platform. Kaggle works by holding competitions that data scientists can enter, solving analytics problems that are put up by actual companies. While their competitions, like many crowdsourced projects, usually featured a financial prize for the determined winner, Walmart had different plans in mind. In this case, the best data minds from the competition would be offered jobs on Walmart’s data analytics team.

The results were a total success for Walmart. Data scientists for various backgrounds were able to demonstrate their skills solving real world problems, giving the company a better idea of what they could accomplish. In one instance, one of the winners was an expert in physics with little formal data analytics background. Had Walmart recruiters gone only on resumes, he probably wouldn’t have been given a second thought. The crowdsourcing was deemed to be such a success, Walmart held the same type of competition the next year.

More Read

Image
Changing Your Mind About Big Data Isn’t Dumb
The Dirty (Not so Secret) Secret of IT Budgets
Should You Jump on the Gamification Bandwagon?
Big Data: A Revolution That Will Transform How We Live, Work, and Think
Rules for Assuring Poor Performance

From these outcomes and others like it, it’s clear that crowdsourcing offers up some unique advantages when it comes to finding high quality big data talent. As seen in the Walmart example, it expands the pool of potential applicants. Recruiters no longer have to depend on words on a resume and can instead focus on the work of people coming with different experiences of their own. Crowdsourced competitions also allow potential employees to show off their skills, not just in big data but in communication. After all, their solutions often have to be explained to corporate executives, many of whom will have little experience with big data analytics. Testing out so many people also opens up the possibility of getting referrals from new employees, once again expanding the number of people a company may target in the future.

While crowdsourcing has definite benefits, it’s not without its challenges as well. Crowdsourced competitions can be difficult to organize and set up, especially when the problem presented is as complex as those posed by big data. Also worth noting is that many enterprise-grade tools used in competitions don’t come with automatic ranking and benchmarking features. Luckily, there are numerous helpful data crowdsourcing platforms to choose from, like the aforementioned Kaggle, InnoCentive, and CrowdANALYTIX. Companies that use these platforms will be in a better position to capitalize on crowdsourced talent.

Crowdsourcing could very well represent the wave of the future, at least when it comes to hiring data scientists. The shortage of data talent is very real, something all too many organizations are experiencing, so it stands to reason that unique ways of finding that talent would come to the forefront. While crowdsourcing has difficulties of its own, it has also shown to be an effective strategy for seeing who would really make a valuable addition to a data team.

Share This Article
Facebook Pinterest LinkedIn
Share
Byjonathanbuckley
Follow:
In 2008, we formed The Artesian Network, LLC, a consortium of nine core marketing and sales professionals focused on finding and proving the repeatable, predictable revenue models for new companies in B2B technology.Though we are a senior team with very high technical adaptability, in recent years we have had demonstrated particular focus in data and network security, very large scale data management and analytics, artificial intelligence and the convergence with robotics and cloud infrastructure development.We are known for providing insights that are uniquely and strategically valuable, even if uncomfortable at times. Since we are involved at the early stage of the company lifecycle, when pursuing the repeatable business model sometimes the data comes in conflict with the original business thesis. This is where having senior counsel becomes crucial.

Follow us on Facebook

Latest News

langgraph and genai
LangGraph Orchestrator Agents: Streamlining AI Workflow Automation
Artificial Intelligence Exclusive
ai fitness app
Will AI Replace Personal Trainers? A Data-Driven Look at the Future of Fitness Careers
Artificial Intelligence Big Data Exclusive
crypto marketing
How a Crypto Marketing Agency Can Use AI to Create Powerful Native Advertising Strategies
Blockchain Exclusive Marketing
data driven insights
How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
Analytics Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Image
AnalyticsBest PracticesBig DataCollaborative DataCulture/LeadershipExclusiveMobilityModelingPredictive AnalyticsSocial Data

Is the Purpose of Analytics Just to Turn a Buck?

4 Min Read
data governance
Culture/LeadershipData ManagementPolicy and Governance

What Does Your Information Governance Program Look Like?

9 Min Read

Revenge of the Nerds

4 Min Read

Norman Nie on Two Big Problems with Big Data

2 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?