Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    sales and data analytics
    How Data Analytics Improves Lead Management and Sales Results
    9 Min Read
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: The Scourge of Data Silos
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Best Practices > The Scourge of Data Silos
Best PracticesData MiningData Warehousing

The Scourge of Data Silos

RickSherman
RickSherman
5 Min Read
SHARE

Silos“Those who cannot remember the past are condemned to repeat it.” [1]

Contents
Common PromisesCommon Results

Silos“Those who cannot remember the past are condemned to repeat it.” [1]

Over the years there have been many technology waves related to the design, development and deployment of Business Intelligence (BI).  As BI technologies evolved, they have been able to significantly expand their functionality by leveraging the incredible capacity growth of CPUs, storage, disk I/O, memory and network bandwidth. New technologies have emerged as enterprises’ data needs keep expanding in variety, volume and velocity.

More Read

Amazon Extends SimpleDB
Why Spam Prevention is Crucial for for Data-Driven Business
Data Management and Security Best Practices
“Good Enough” Data Analysis Will Lead to Good Data Analysis
6 Simple Steps to a Big Data Strategy

Technology waves are occurring more frequently than ever. Current technology waves include Big Data, data virtualization, columnar databases, BI appliances, in-memory analytics, predictive analytics, and self-service BI.

Common Promises

Each wave brings with it the promise of faster, easier to use and cheaper BI solutions. Each wave promises to be the breakthrough that makes the “old ways” archaic, and introduces a new dawn of pervasive BI responsive to business needs. No more spreadsheets or reports needed!

IT and product vendors are ever hopeful that the latest technology wave will be the magic elixir for BI, however, people seem to miss that it is not technology that is the gating factor to pervasive BI. What has held back BI has been the reluctance to address the core issues of establishing enterprise data management, information architecture and data governance. Those core issues are hard and the perpetual hope is that one of these technology waves will be the Holy Grail of BI and allow enterprises to skip the hard work of transforming and managing information. We have discussed these issues many times (and will again), but what I want to discuss is the inevitable result in the blind faith in the latest technology wave.

Common Results

Each wave typically advances BI in some way, but does not really create the breakaway promised; truly pervasive BI remains the Holy Grail. What is almost guaranteed with each new wave, however, is yet another data silo added to the many that already typically litter an enterprise landscape. As a result, many enterprises have one or more of the following: multiple data warehouses, operational data stores (ODS), independent (silo’d) data marts, spreadmarts, data shadow systems and scattered databases used for reporting. Further evidence of the tech wave spawning silos is that enterprises typically have multiple BI product implementations with six or more different BI products.

The people involved in each new wave typically assume that their predecessors (who implemented a previous tech wave) did not know what they were doing and/or just did not use the right technology. They think they know best, and the previous generation (maybe just a few years from being the latest wave) has nothing of value to teach them. Hence, the newest generation does it all from scratch, encountering the same pitfalls – pitfalls that often have nothing to do with technology and everything to do with data management, information architecture and data governance.

Sometimes, they create a new solution separate from the existing BI environment. After all, why get bogged done in the old wave, now a legacy application, when you can start from scratch. This means the next tech wave builds a new tech silo. It may produce business value in the short run, but in the long run the business group and IT have another silo to reconcile.

Enterprises need to look at their Big Data, data virtualization, columnar databases, BI appliances, in-memory analytics, predictive analytics, and self-service BI efforts and determine if they are going to be the next data silos. Unfortunately, the answer is likely to be yes.

The bottom-line is that business people need data and analytics from across the enterprise and not just from a new shiny BI silo. But for this to happen, the BI team has to stop the madness by not creating yet another silo and legacy application. Can you say “no” to the data silo?

 


[1] George Santayana (1905) Reason in Common Sense, volume 1 of The Life of Reason

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

sales and data analytics
How Data Analytics Improves Lead Management and Sales Results
Analytics Big Data Exclusive
ai in marketing
How AI and Smart Platforms Improve Email Marketing
Artificial Intelligence Exclusive Marketing
AI Document Verification for Legal Firms: Importance & Top Tools
AI Document Verification for Legal Firms: Importance & Top Tools
Artificial Intelligence Exclusive
AI supply chain
AI Tools Are Strengthening Global Supply Chains
Artificial Intelligence Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Healthcare Has a Problem: Big Data & The Law of Seven

6 Min Read

Business Rules to Programmers – Methink thou doest protest too much II

9 Min Read
flash storage
Data Warehousing

Reviewing the Benefits and Drawbacks of Flash Storage

6 Min Read

Fudging Data: The How, The Why and Catching it

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?