We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: The Scourge of Data Silos
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Best Practices > The Scourge of Data Silos
Best PracticesData MiningData Warehousing

The Scourge of Data Silos

RickSherman
RickSherman
5 Min Read
The Scourge of Data Silos
Illustration generated with Qwen Image.
SHARE

“Those who cannot remember the past are condemned to repeat it.” [1]

Contents
  • Common Promises
  • Common Results

Over the years there have been many technology waves related to the design, development and deployment of Business Intelligence (BI).  As BI technologies evolved, they have been able to significantly expand their functionality by leveraging the incredible capacity growth of CPUs, storage, disk I/O, memory and network bandwidth. New technologies have emerged as enterprises’ data needs keep expanding in variety, volume and velocity.

Technology waves are occurring more frequently than ever. Current technology waves include Big Data, data virtualization, columnar databases, BI appliances, in-memory analytics, predictive analytics, and self-service BI.

Common Promises

Each wave brings with it the promise of faster, easier to use and cheaper BI solutions. Each wave promises to be the breakthrough that makes the “old ways” archaic, and introduces a new dawn of pervasive BI responsive to business needs. No more spreadsheets or reports needed!

More Read

The Data Curves
The Data Curves
Unlocking the Potential of ‘Big Data’ in the Market Research industry
PAW: New Challenges for Developing Predictive Analytics Solutions
Why Search Engine Rank is Important
Outsourcing, Off-shoring and Near-shoring – what works or doesn’t for BI & DWH

IT and product vendors are ever hopeful that the latest technology wave will be the magic elixir for BI, however, people seem to miss that it is not technology that is the gating factor to pervasive BI. What has held back BI has been the reluctance to address the core issues of establishing enterprise data management, information architecture and data governance. Those core issues are hard and the perpetual hope is that one of these technology waves will be the Holy Grail of BI and allow enterprises to skip the hard work of transforming and managing information. We have discussed these issues many times (and will again), but what I want to discuss is the inevitable result in the blind faith in the latest technology wave.

Common Results

Each wave typically advances BI in some way, but does not really create the breakaway promised; truly pervasive BI remains the Holy Grail. What is almost guaranteed with each new wave, however, is yet another data silo added to the many that already typically litter an enterprise landscape. As a result, many enterprises have one or more of the following: multiple data warehouses, operational data stores (ODS), independent (silo’d) data marts, spreadmarts, data shadow systems and scattered databases used for reporting. Further evidence of the tech wave spawning silos is that enterprises typically have multiple BI product implementations with six or more different BI products.

The people involved in each new wave typically assume that their predecessors (who implemented a previous tech wave) did not know what they were doing and/or just did not use the right technology. They think they know best, and the previous generation (maybe just a few years from being the latest wave) has nothing of value to teach them. Hence, the newest generation does it all from scratch, encountering the same pitfalls – pitfalls that often have nothing to do with technology and everything to do with data management, information architecture and data governance.

Sometimes, they create a new solution separate from the existing BI environment. After all, why get bogged done in the old wave, now a legacy application, when you can start from scratch. This means the next tech wave builds a new tech silo. It may produce business value in the short run, but in the long run the business group and IT have another silo to reconcile.

Enterprises need to look at their Big Data, data virtualization, columnar databases, BI appliances, in-memory analytics, predictive analytics, and self-service BI efforts and determine if they are going to be the next data silos. Unfortunately, the answer is likely to be yes.

The bottom-line is that business people need data and analytics from across the enterprise and not just from a new shiny BI silo. But for this to happen, the BI team has to stop the madness by not creating yet another silo and legacy application. Can you say “no” to the data silo?


[1] George Santayana (1905) Reason in Common Sense, volume 1 of The Life of Reason

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
Big Data Business Intelligence Exclusive Web Analytics
Flat editorial illustration: A SaaS-editorial scene showing product usage, support patterns, and renewal feedback informing a fle
Using Product Usage Analytics and Support Data to Build a B2B Product Roadmap
Business Intelligence Infographic
From Hiring To Payroll: Managing HR Data Across Business Systems -- AI-generated illustration
From Hiring To Payroll: Managing HR Data Across Business Systems
Big Data Business Intelligence Infographic
Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
Analytics Business Intelligence Exclusive Marketing

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Interview – Anne Milley, SAS,  Part 1
Data MiningPredictive Analytics

Interview – Anne Milley, SAS, Part 1

15 Min Read
Image
AnalyticsBig DataData MiningData QualityPredictive AnalyticsSocial Data

The True Vision of Big Data in Healthcare

4 Min Read
How to Improve Predictive Accuracy? (Part 1)
Business IntelligenceData MiningPredictive Analytics

How to Improve Predictive Accuracy? (Part 1)

6 Min Read
Growth in data-related jobs
Data MiningData QualityData VisualizationJobs

Growth in data-related jobs

2 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

5 Great Tips for Using Data Analytics for Website UX
5 Great Tips for Using Data Analytics for Website UX
Big Data
How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?