By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics in sports industry
    Here’s How Data Analytics In Sports Is Changing The Game
    6 Min Read
    data analytics on nursing career
    Advances in Data Analytics Are Rapidly Transforming Nursing
    8 Min Read
    data analytics reveals the benefits of MBA
    Data Analytics Technology Proves Benefits of an MBA
    9 Min Read
    data-driven image seo
    Data Analytics Helps Marketers Substantially Boost Image SEO
    8 Min Read
    construction analytics
    5 Benefits of Analytics to Manage Commercial Construction
    5 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Data Cleanup: Michael Clayton and The Consultant’s Role
Share
Notification Show More
Latest News
data analytics in sports industry
Here’s How Data Analytics In Sports Is Changing The Game
Big Data
data analytics on nursing career
Advances in Data Analytics Are Rapidly Transforming Nursing
Analytics
data analytics reveals the benefits of MBA
Data Analytics Technology Proves Benefits of an MBA
Analytics
anti-spoofing tips
Anti-Spoofing is Crucial for Data-Driven Businesses
Security
ai in software development
3 AI-Based Strategies to Develop Software in Uncertain Times
Software
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > Data Cleanup: Michael Clayton and The Consultant’s Role
Data Quality

Data Cleanup: Michael Clayton and The Consultant’s Role

MIKE20
Last updated: 2010/10/11 at 8:00 AM
MIKE20
4 Min Read
SHARE

data

Contents
The Consultant’s RoleTreading CarefullyFeedback

I recently attended the DataFlux IDEAS 2010 Conference in balmy Palm Springs, CA. I finally had the chance to meet quite a few thought leaders in the field.

data

More Read

The Enterprise 2.0 Consultant

I recently attended the DataFlux IDEAS 2010 Conference in balmy Palm Springs, CA. I finally had the chance to meet quite a few thought leaders in the field.

As expected, one of the principal topics of the conference involved data issues. Put simply, some organizations are quite good at dealing with them–while others continue to struggle. I have certainly come across more than my fair share of data issues in my day. (What consultant hasn’t?)

Many of the conference attendees were on the client side. Their presentations tended to focus on three to five year plans. Their ability to make long-term improvements in their organizations’ data impressed me a great deal for one simple reason: I never get to focus on the long-term. I am a fixer, much like the main character in the eponymous 2007 movie Michael Clayton. In this post, I discuss the role of people like me in dealing with enterprise data issues.

The Consultant’s Role

As a consultant, it is often my role to identify potential or probable data issues for a client. Whether using any number of specialized data cleanup tools or stalwarts such as Microsoft Access or Excel, I have found that it’s typically not terribly difficult to identify potentially questionable records. The key word here is potentially, as many records need to be manually examined in order to fix, consolidate, purge, or retire.

But let’s not get ahead of ourselves. Identification is simply the first step in the process–and often the easiest. After isolating suspect records, they must be investigated and ultimately fixed or consolidated. Here’s where it’s usually a good idea to stop using phrases such as “not terribly difficult.”

Treading Carefully

Some people become defensive when presented with data errors. When at a new client and unaware of the political terrain, I try to say very innocently that “someone may have done something wrong.” I find that it’s much less confrontational than pointing a finger, even when I know who did what when. Often, end users are quick to plead ignorance or blame predecessors for mistakes. In the event that they themselves have made the mistakes (audit trails are pretty hard to dispute), the tone of the conversation is quite different. There’s usually a reason that an end-user did what s/he did.

It’s the client’s role to ultimately make the final call on what to do with suspect records. Far too often, however, end-users do not have the time, desire, or skill set to make these calls. (I have written before on the different focuses on consultants and client end users.) Failure to address data issues in a timely manner typically causes many problems, from cascaded delays on other project tasks to incomplete testing.

Sometimes on IT projects, expectations are totally out of whack. Vendors are sometimes responsible for these chasms because, during the sales cycle, they underestimate the amount of time required to clean up key enterprise information. Let’s not forget that project managers during the engagement tend not to have expertise in data management issues. They tend not to know how long cleanup can take. Nor do clients, for that matter.

It’s the job of the consultant to let everyone know. Just don’t kill the messenger.

Feedback

What say you?

Read more at MIKE2.0: The Open Source Standard for Information Management

TAGGED: Consultants
MIKE20 October 11, 2010
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data analytics in sports industry
Here’s How Data Analytics In Sports Is Changing The Game
Big Data
data analytics on nursing career
Advances in Data Analytics Are Rapidly Transforming Nursing
Analytics
data analytics reveals the benefits of MBA
Data Analytics Technology Proves Benefits of an MBA
Analytics
anti-spoofing tips
Anti-Spoofing is Crucial for Data-Driven Businesses
Security

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

The Enterprise 2.0 Consultant

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?