Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    car expense data analytics
    Data Analytics for Smarter Vehicle Expense Management
    10 Min Read
    image fx (60)
    Data Analytics Driving the Modern E-commerce Warehouse
    13 Min Read
    big data analytics in transporation
    Turning Data Into Decisions: How Analytics Improves Transportation Strategy
    3 Min Read
    sales and data analytics
    How Data Analytics Improves Lead Management and Sales Results
    9 Min Read
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: DQ Alert: Easy Savings by Removing Dups
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > DQ Alert: Easy Savings by Removing Dups
Uncategorized

DQ Alert: Easy Savings by Removing Dups

DataQualityEdge
DataQualityEdge
3 Min Read
SHARE

Poor data quality costs over $600 billion annually as per TDWI surveys and studies.

Whether you are the VP looking over your latest sales, the secretary compiling a mailing list, the data quality analyst rummaging through data sets, the business analyst working on a data integration project, or an accountant going over the projected budget.

Whether you are in a large Fortune 500 company, in the government, or a small community association you will benefit.

Duplicate records

Duplicate records of customers cause discontented customers and multiple mail-outs. How is it possible to have duplicate records?

More Read

Improving Website and WordPress Performance with Hard-Coded Share Buttons
The New Chasm
#9: Here’s a thought…
Top Technology Considerations When Opening a New Office
Three Healthcare IT Trends for 2013
  • Records are manually entered twice;
  • Processes create record twice;
  • Participants registered under multiple names;
  • Participants registered at multiple locals.

So before you send out a mailing list to your community members, or potential program participants for marketing campaigns or program sign-ups for this year’s sports, arts, sales, and/or membership drive seasons:

  1. Sort that list by name. Why because you may have the child on the list twice, or three times; after sorting by name;
  2. Sort by address, you may have the same family household multiple times because one the parents registered …


Poor data quality costs over $600 billion annually as per TDWI surveys and studies.

Whether you are the VP looking over your latest sales, the secretary compiling a mailing list, the data quality analyst rummaging through data sets, the business analyst working on a data integration project, or an accountant going over the projected budget.

Whether you are in a large Fortune 500 company, in the government, or a small community association you will benefit.

Duplicate records

Duplicate records of customers cause discontented customers and multiple mail-outs. How is it possible to have duplicate records?

  • Records are manually entered twice;
  • Processes create record twice;
  • Participants registered under multiple names;
  • Participants registered at multiple locals.

So before you send out a mailing list to your community members, or potential program participants for marketing campaigns or program sign-ups for this year’s sports, arts, sales, and/or membership drive seasons:

  1. Sort that list by name. Why because you may have the child on the list twice, or three times; after sorting by name;
  2. Sort by address, you may have the same family household multiple times because one the parents registered under their name, and/or siblings are registered with your organization as well.

Don’t know how to sort… here’s a good way to start if you’re using Microsoft Excel… highlight your records and click on this little icon , it’s easy as breaking eggs.

Or

New SQL type programming here’s a simple query that will identify duplicate records.

SELECT attribute1, attribute2, attribute3, attributen… count(*)
FROM
dbo.tablex
GROUP BY attribute1, attribute2, attribute3, attributen…
HAVING (COUNT(*) > 1)

I hope this helps anyone working with customer lists.

TAGGED:data quality
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

car expense data analytics
Data Analytics for Smarter Vehicle Expense Management
Analytics Exclusive
using accrual data to improve financial forecasts
Using Accrual Data to Improve Financial Forecasts
Big Data Exclusive
image fx (60)
How Finance & BI Teams Choose Accounting Software
Big Data Business Intelligence Exclusive
Why the AI Race Is Being Decided at the Dataset Level
Why the AI Race Is Being Decided at the Dataset Level
Artificial Intelligence Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Don’t Sweat the Small Stuff, Except in Data Quality

5 Min Read

Leadership Lessons in Data Quality – Part 1

9 Min Read

ISO TC 184/SC 4 Conference in Canada

2 Min Read
analyzing big data for its quality and value
Big Data

Use this Strategic Approach to Maximize Your Data’s Value

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?