By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data-driven white label SEO
    Does Data Mining Really Help with White Label SEO?
    7 Min Read
    marketing analytics for hardware vendors
    IT Hardware Startups Turn to Data Analytics for Market Research
    9 Min Read
    big data and digital signage
    The Power of Big Data and Analytics in Digital Signage
    5 Min Read
    data analytics investing
    Data Analytics Boosts ROI of Investment Trusts
    9 Min Read
    football data collection and analytics
    Unleashing Victory: How Data Collection Is Revolutionizing Football Performance Analysis!
    4 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: How to Turn Your Data from Archenemy to Ally
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > How to Turn Your Data from Archenemy to Ally
AnalyticsData Quality

How to Turn Your Data from Archenemy to Ally

Brett Stupakevich
Last updated: 2011/09/01 at 3:15 PM
Brett Stupakevich
4 Min Read
SHARE

How to turn data from archenemy to ally 217x300 photo (data analytics)

Author: Linda Rosencrance
Spotfire Blogging Team

How to turn data from archenemy to ally 217x300 photo (data analytics)

More Read

data-driven white label SEO

Does Data Mining Really Help with White Label SEO?

IT Hardware Startups Turn to Data Analytics for Market Research
The Power of Big Data and Analytics in Digital Signage
Data Analytics Boosts ROI of Investment Trusts
Unleashing Victory: How Data Collection Is Revolutionizing Football Performance Analysis!

Author: Linda Rosencrance
Spotfire Blogging Team

Last week we had some fun comparing a data analyst to a superhero. But we all know every superhero has an archenemy – Batman has The Joker and Superman has Lex Luthor.

As a data analyst, you’ll have to confront your share of villains too. They may even have terrifying names like Big Data, Dirty Data or Data Chaos. OK, maybe these aren’t such villainous names but left unchecked they can cause major problems for data analysts and company executives alike.

Why?

Well, for one thing, big data poses big challenges for traditional analytics approaches, according to SearchBusinessAnalytics.com.

That’s because while your company’s focused on the volume and variety of “big data,” it doesn’t really spend enough time figuring out how to transform the massive amounts of stored, raw, structured and unstructured data into useful, real-time business intelligence to make better decisions. 

Then there’s your archenemy, dirty data, which can be a huge headache. Dirty data is data that contains numerous errors like misspellings, duplicate data, data entered in the wrong fields. Dirty data in your system can result in slower performance, reports that are incorrect, and it can cause your software to crash or freeze.

And let’s not forget data chaos. If you want to make the best business decisions, you have to be sure the data is consistent from system to system and from business unit to business unit.

Now that you know who your enemies are, like any self-respecting superhero, you have to figure out how to defeat them and turn potentially disastrous situations into opportunities to make your business more successful.

When it comes to dealing with the problems posed by big data, Jai Vijayan, a former colleague at Computerworld, points to an upcoming report from The Data Warehousing Institute (TDWI).

Vijayan says, according to the survey,  the fastest growing use case for big data analytics is advanced data visualization. Increasingly, companies are running sophisticated analytics tools on big data sets in order to build highly complex visual representations of their data.

And what about handling the problems caused by dirty data?

There are a number of ETL (extract, transform, load) tools that you can use to eliminate inaccurate information from your database(s). There are also some other things you can do to improve the quality and usability of your data including deciding who has the final authority for data hygiene and/or is able to resolve conflicts over whose information is correct, according to this Spotfire blog post.

Finally, you should deploy data governance tools to help you deal with data chaos and ensure the accurate and timely aggregation and reporting of financial results to meet your company’s needs as well as regulatory requirements, according to this article at SearchBusinessIntelligence.com.

One of the things a data governance tool should include is a rollback capability. A data governance tool should enable an application that’s running to revert to the most recent saved version by specifying the transaction name in the ROLLBACK statement.

“A well-generated data system must have rollback capability so that a system can recover to a known state in case the execution process fails,” according to the article.

Remember, as a data analyst, it’s imperative that you get to know these three archenemies and then understand the strategies and best practices needed to convert them into your allies.

 

Brett Stupakevich September 1, 2011
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

big data and IP laws
Big Data & AI In Collision Course With IP Laws – A Complete Guide
Big Data
ai in marketing
4 Ways AI Can Enhance Your Marketing Strategies
Marketing
sobm for ai-driven cybersecurity
Software Bill of Materials is Crucial for AI-Driven Cybersecurity
Security
IT budgeting for data-driven companies
IT Budgeting Practices for Data-Driven Companies
IT

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data-driven white label SEO
Analytics

Does Data Mining Really Help with White Label SEO?

7 Min Read
marketing analytics for hardware vendors
Analytics

IT Hardware Startups Turn to Data Analytics for Market Research

9 Min Read
big data and digital signage
Analytics

The Power of Big Data and Analytics in Digital Signage

5 Min Read
data analytics investing
Analytics

Data Analytics Boosts ROI of Investment Trusts

9 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?