Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    sales and data analytics
    How Data Analytics Improves Lead Management and Sales Results
    9 Min Read
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: A Turker’s Got To Know His Limitations
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > A Turker’s Got To Know His Limitations
Uncategorized

A Turker’s Got To Know His Limitations

Daniel Tunkelang
Daniel Tunkelang
2 Min Read
SHARE

“A man’s got to know his limitations,” as Clint Eastwood famously said as Dirty Harry in Magnum Force. Well, as Panos Ipeirotis reports on his blog, Turkers (the people who are paid to perform tasks using Amazon’s Mechanical Turk service), actually do know their limitations.

Read the full post for details, but here is the punch line:

Turkers can self-report accurately the difficulty of labeling an example correctly! Since example difficulty and labeling quality are strongly interconnected, this also means that they are good at estimating their own quality!

It’s great to see Mechanical Turk used in the service of productive research, and not just as a way to shill on the cheap.

More Read

What Data Governance leaders have in common around the world
What does the email address say about the customer?
Will Larry Turn Oracle-Sun Into the New AS/400?
Mining Bitcoins in the Cloud Catches On
Interactive Intelligence Reveals Ambitious Plans for Customer Service

“A man’s got to know his limitations,” as Clint Eastwood famously said as Dirty Harry in Magnum Force. Well, as Panos Ipeirotis reports on his blog, Turkers (the people who are paid to perform tasks using Amazon’s Mechanical Turk service), actually do know their limitations.

Read the full post for details, but here is the punch line:

Turkers can self-report accurately the difficulty of labeling an example correctly! Since example difficulty and labeling quality are strongly interconnected, this also means that they are good at estimating their own quality!

It’s great to see Mechanical Turk used in the service of productive research, and not just as a way to shill on the cheap.

Link to original post

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

sales and data analytics
How Data Analytics Improves Lead Management and Sales Results
Analytics Big Data Exclusive
ai in marketing
How AI and Smart Platforms Improve Email Marketing
Artificial Intelligence Exclusive Marketing
AI Document Verification for Legal Firms: Importance & Top Tools
AI Document Verification for Legal Firms: Importance & Top Tools
Artificial Intelligence Exclusive
AI supply chain
AI Tools Are Strengthening Global Supply Chains
Artificial Intelligence Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Defining the Customer – Brandwagon

2 Min Read

Family Sets Up Cloud Controlled Christmas Lights for the World to Enjoy

2 Min Read

SIA Recap: Set It & Forget It – Triggered Campaigns

4 Min Read

The Soft Costs of Information Quality

7 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots
giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?