We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
    chatgpt image jul 21, 2026, 04 34 30 pm
    4 Core Benefits of Predictive Maintenance after Vibration Analysis
    10 Min Read
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results -- AI-generated illustration
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results
    11 Min Read
    chatgpt image jul 13, 2026, 04 23 45 pm
    How Data Analytics Helps Companies Improve User Engagement
    19 Min Read
    chatgpt image jul 13, 2026, 03 59 46 pm
    How Data Analytics Improves Multi-Location Search Strategies
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: DQ Alert: Easy Savings by Removing Dups
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > DQ Alert: Easy Savings by Removing Dups
Uncategorized

DQ Alert: Easy Savings by Removing Dups

DataQualityEdge
DataQualityEdge
3 Min Read
DQ Alert: Easy Savings by Removing Dups
Photo by Anete Lusina on Pexels (https://www.pexels.com/photo/crop-unrecognizable-man-cleaning-computer-system-unit-4792719/)
SHARE

Poor data quality costs over $600 billion annually as per TDWI surveys and studies.

Whether you are the VP looking over your latest sales, the secretary compiling a mailing list, the data quality analyst rummaging through data sets, the business analyst working on a data integration project, or an accountant going over the projected budget.

Whether you are in a large Fortune 500 company, in the government, or a small community association you will benefit.

Duplicate records

Duplicate records of customers cause discontented customers and multiple mail-outs. How is it possible to have duplicate records?

More Read

Interoperating Services Are the Heart of Cloud Data Integration
Interoperating Services Are the Heart of Cloud Data Integration
Data Management and the Customer Interaction
Ralph Vince 2009 Leverage Space …
How Algorithms Changed The World [INFOGRAPHIC]
Enhance Your CRM Data to Sharpen Your Sales Pitch
  • Records are manually entered twice;
  • Processes create record twice;
  • Participants registered under multiple names;
  • Participants registered at multiple locals.

So before you send out a mailing list to your community members, or potential program participants for marketing campaigns or program sign-ups for this year’s sports, arts, sales, and/or membership drive seasons:

  1. Sort that list by name. Why because you may have the child on the list twice, or three times; after sorting by name;
  2. Sort by address, you may have the same family household multiple times because one the parents registered under their name, and/or siblings are registered with your organization as well.

Don’t know how to sort… here’s a good way to start if you’re using Microsoft Excel… highlight your records and click on this little icon , it’s easy as breaking eggs.

Or

New SQL type programming here’s a simple query that will identify duplicate records.

SELECT attribute1, attribute2, attribute3, attributen… count(*)
FROM
dbo.tablex
GROUP BY attribute1, attribute2, attribute3, attributen…
HAVING (COUNT(*) > 1)

I hope this helps anyone working with customer lists.

TAGGED:data quality
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Technical architecture diagram and decision framework for ai-powered logo generation: design.com vs looka
AI-Powered Logo Generation: Design.com vs Looka
Artificial Intelligence Exclusive
Retailers Should Stop Treating Every Stockout as Equal -- AI-generated illustration
Retailers Should Stop Treating Every Stockout as Equal
Business Intelligence Exclusive
Best Vibe Coding Cleanup Specialists in the USA: Fix or Rebuild? -- AI-generated illustration
Best Vibe Coding Cleanup Specialists in the USA: Fix or Rebuild?
Development Exclusive
Using Warehouse, Transportation and Order Data to Plan Distribution-Center Capacity -- AI-generated illustration
Using Warehouse, Transportation and Order Data to Plan Distribution-Center Capacity
Big Data Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Information Theory Approach to Data Quality and MDM
Uncategorized

Information Theory Approach to Data Quality and MDM

15 Min Read
#7: Here's a thought...
Business IntelligenceCRMData Visualization

#7: Here’s a thought…

7 Min Read
The Data-Information Continuum
Uncategorized

The Data-Information Continuum

7 Min Read
Leadership Lessons in Data Quality - Part 1
Uncategorized

Leadership Lessons in Data Quality – Part 1

9 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?