Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
    pexels pavel danilyuk 8112119
    Data Analytics Is Revolutionizing Medical Credentialing
    8 Min Read
    data and seo
    Maximize SEO Success with Powerful Data Analytics Insights
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: A Turker’s Got To Know His Limitations
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > A Turker’s Got To Know His Limitations
Uncategorized

A Turker’s Got To Know His Limitations

Daniel Tunkelang
Daniel Tunkelang
2 Min Read
SHARE

“A man’s got to know his limitations,” as Clint Eastwood famously said as Dirty Harry in Magnum Force. Well, as Panos Ipeirotis reports on his blog, Turkers (the people who are paid to perform tasks using Amazon’s Mechanical Turk service), actually do know their limitations.

Read the full post for details, but here is the punch line:

Turkers can self-report accurately the difficulty of labeling an example correctly! Since example difficulty and labeling quality are strongly interconnected, this also means that they are good at estimating their own quality!

It’s great to see Mechanical Turk used in the service of productive research, and not just as a way to shill on the cheap.

More Read

Food+Tech Connect: Promoting a Networked Food System
Watson Analytics: The Data Scientist Accelerator
How vanguard is your change?
Another view: maybe IT doesn’t want to be aligned to the business
New Revenue Recognition Rules Require Software

“A man’s got to know his limitations,” as Clint Eastwood famously said as Dirty Harry in Magnum Force. Well, as Panos Ipeirotis reports on his blog, Turkers (the people who are paid to perform tasks using Amazon’s Mechanical Turk service), actually do know their limitations.

Read the full post for details, but here is the punch line:

Turkers can self-report accurately the difficulty of labeling an example correctly! Since example difficulty and labeling quality are strongly interconnected, this also means that they are good at estimating their own quality!

It’s great to see Mechanical Turk used in the service of productive research, and not just as a way to shill on the cheap.

Link to original post

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

AI and data mining
What the Rise of AI Web Scrapers Means for Data Teams
Artificial Intelligence Big Data Exclusive
power supplies for ATX for data scientists
Why Data Scientists Should Care About SFX Power Supplies
Big Data Exclusive
AI for website optimization
Free Tools to Test Website Accessibility
Artificial Intelligence Exclusive
Generative AI models
Thinking Machines At Work: How Generative AI Models Are Redefining Business Intelligence
Artificial Intelligence Business Intelligence Exclusive Infographic Machine Learning

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Will the New Apple TV Revolutionize the Conference Room?

4 Min Read
Image
Uncategorized

What Uber and Lady Gaga Can Teach You About Analytics

6 Min Read

Online Privacy Changes Imminent from Washington

0 Min Read

July 2009 Early Indications: Love & Work part II

17 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?