We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Do You Know Your Data?
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Inside Companies > Do You Know Your Data?
Inside Companies

Do You Know Your Data?

MIKE20
MIKE20
4 Min Read
Do You Know Your Data?
Photo by Mike_68 on Pixabay (https://pixabay.com/photos/hard-drive-inside-macro-4618874/)
SHARE

Midway through Michael Lewis’ excellent book The Big Short, the author makes an astonishing assertion: many financial institutions didn’t understand the complex derivatives and products that they were selling. And here’s the really scary part: He was absolutely right. Lewis shows that once-storied banks such as Merrill Lynch, Morgan Stanley, and Deutsche Bank could not even answer basic questions about what specific bonds comprised their CDOs, credit default swaps (CDSs), and other opaque financial instruments.

Contents
  • Dealing with the Suboptimal
  • Feedback

While most organizations don’t deal in such complexity, the book make me wonder:

  • To what extent do organizations lack a fundamental understanding of their data?
  • What are the potential legal and financial effects caused by such ignorance?
  • How can organizations understand their data better–and mitigate risks in the process?

These are questions worth considering over the course of a number of posts.

Dealing with the Suboptimal

I often work with organizations in the midst of some type of data migration project. Unearthing data from a variety of sources typically manifests some inconsistencies, to put it mildly. For example, on my current project, I have been surprised to learn that a mid-sized bank has no fewer than nine operational systems. There are several financial systems, additional trading systems, and some old GL legacy systems that have never been properly integrated with the others. And this is just on the domestic side. On the foreign side: Don’t ask.

More Read

Technology Adoption and ERP Software References
Technology Adoption and ERP Software References
Data Collaboration: Crowdsourcing for Health Care
Tom Davenport’s Culture of Analytics
Modern eCommerce, or is that just next gen commerce?
How HP finds Sweet Spot customers in its data trove

As expected extracts from these systems often produce inconsistent results. Now, because I have only been on this project for three weeks, this is news to me. My de facto boss has been with the company for a very long time and, as a result, can spot these issues in seconds. Institutional knowledge has its benefts.

However, what if he were to leave–by his choice or otherwise? Who would be able to explain to me–or another consultant–all of the intricacies and exceptions to relatively arcane rules? I’m honestly not sure. At least there’s a comprehensive data dictionary and an ERD, right? Think again.

While my boss would agree that better documentation is necessary, it’s certainly not imperative right now. He’s being pressured to provide a consolidated look at the data and that’s why I’m there–not to pine for a idyllic state.

Not every organization or industry has the ability to stall the world credit markets and cause the worst economic crisis in 70 years. Let’s hope that we never have to experience anything like what we have seen over the last three years. While “one system” may be impossible at large organizations for one reason or another, consider the dangers with not having one version of the truth or at least a complete version–even if it needs to be derived from multiple sources. We’ve recently seen what can happen when this happens.

Feedback

What say you?

TAGGED:data management
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection
Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
Big Data Business Intelligence Exclusive Web Analytics

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

The Importance of Data Protection During the Coronavirus Pandemic
Best PracticesBig DataData ManagementITPrivacyRisk ManagementSecurity

The Importance of Data Protection During the Coronavirus Pandemic

6 Min Read
Here’s How Much Big Data Companies Make On The Internet
Big DataData ManagementExclusiveNews

Here’s How Much Big Data Companies Make On The Internet

8 Min Read
Do You Have a Love-Hate Relationship With Your Data?
Uncategorized

Do You Have a Love-Hate Relationship With Your Data?

7 Min Read
Is Cloud Computing Hurtling Towards Disaster?
Cloud ComputingCommentaryExclusiveRisk Management

Is Cloud Computing Hurtling Towards Disaster?

4 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?