By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data Analytics instagram stories
    Data Analytics Helps Marketers Make the Most of Instagram Stories
    15 Min Read
    analyst,women,looking,at,kpi,data,on,computer,screen
    What to Know Before Recruiting an Analyst to Handle Company Data
    6 Min Read
    AI analytics
    AI-Based Analytics Are Changing the Future of Credit Cards
    6 Min Read
    data overload showing data analytics
    How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
    8 Min Read
    hire a marketing agency with a background in data analytics
    5 Reasons to Hire a Marketing Agency that Knows Data Analytics
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: This Is Why You Shouldn’t Weight Your Survey Data
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > This Is Why You Shouldn’t Weight Your Survey Data
Uncategorized

This Is Why You Shouldn’t Weight Your Survey Data

AnniePettit
Last updated: 2015/08/12 at 5:14 AM
AnniePettit
4 Min Read
Image
SHARE

ImageFor a long time I’ve been a big proponent of weighting data as little and as rarely as possible. You see, I would rather fill cells to achieve the desired sample size rather than fake cells based on data I’ve already gathered – not on data that I failed to gather.

ImageFor a long time I’ve been a big proponent of weighting data as little and as rarely as possible. You see, I would rather fill cells to achieve the desired sample size rather than fake cells based on data I’ve already gathered – not on data that I failed to gather. Obviously, I failed to gather that data for a specific reason, perhaps one that is completely unknown and unguessable to me.

Let’s look at an example. I asked Excel to randomly generate a score from 1 to 10 for fifty men and fifty women. Then, I copied those scores four times. In the first copy, I deleted the last ten scores of women. In the second copy, I deleted the last twenty scores of women, and so on. What I was left with was five datasets based on the exact same population, but with various percentages of missing data. Why was the data missing? I don’t know. Maybe the introverts didn’t answer the door/pick up the phone/talk to me at the mall. Maybe the high income people were all away from home and at their cottages that weekend. Maybe my interviewer drove up in a beat-up, rusty Pinto and scared people off. Regardless, data analysis must begin!

In the Perfect Sample, we see the results from 50 men and 50 women wherein the weights for both men and women are 1, and both the unweighted and weighted total scores are 5.5. But notice what happens when data from more and more women become missing, and the weights for women must compensate and become higher and higher. Although we know that the “true” score is 5.5, the Unweighted Total Score eventually becomes 4.8 and is made even worse with the Weighted Total Score which eventually becomes 4.5 in Scenario 4. In other words, although weighting the data ensured that women’s opinions were counted just as much as men’s opinions, it didn’t improve the quality of the data. It simply exaggerated a flawed sampling technique.

 

More Read

big data improves

3 Ways Big Data Improves Leadership Within Companies

IT Is Not Analytics. Here’s Why.
Romney Invokes Analytics in Rebuke of Trump
WEF Davos 2016: Top 100 CEO bloggers
In Memoriam: Robin Fray Carey
 Random SampleScenario 2Scenario 3Scenario 3Scenario 4
Unweighted Total Score5.55.35.14.94.8
Number of men5050505050
Number of women5045403530
Weight for men1.01.01.01.01.0
Weight for women1.01.111.251.431.67
Weighted Total Score5.55.35.04.84.5

 

The moral of the story is this.

Never use weighting to adjust or correct for missing data.

Fill every cell, and then use weighting sparingly to adjust for extremely minor differences that resulted from oversampling (not undersampling).

This message has been brought to you by the letter α and the number 27644437.

 

AnniePettit August 12, 2015
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

smart home data
7 Mind-Blowing Ways Smart Homes Use Data to Save Your Money
Big Data
ai low code frameworks
AI Can Help Accelerate Development with Low-Code Frameworks
Artificial Intelligence
data Analytics instagram stories
Data Analytics Helps Marketers Make the Most of Instagram Stories
Analytics
data breaches
How Hospital Security Breaches Devastate Local Communities
Policy and Governance

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

big data improves
Big DataJobsKnowledge ManagementUncategorized

3 Ways Big Data Improves Leadership Within Companies

6 Min Read
Image
Uncategorized

IT Is Not Analytics. Here’s Why.

7 Min Read

Romney Invokes Analytics in Rebuke of Trump

4 Min Read

WEF Davos 2016: Top 100 CEO bloggers

14 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?