By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: The Scourge of Data Silos
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Best Practices > The Scourge of Data Silos
Best PracticesData MiningData Warehousing

The Scourge of Data Silos

RickSherman
Last updated: 2012/06/26 at 12:04 PM
RickSherman
5 Min Read
SHARE

Silos“Those who cannot remember the past are condemned to repeat it.” [1]

Contents
Common PromisesCommon Results

Silos“Those who cannot remember the past are condemned to repeat it.” [1]

Over the years there have been many technology waves related to the design, development and deployment of Business Intelligence (BI).  As BI technologies evolved, they have been able to significantly expand their functionality by leveraging the incredible capacity growth of CPUs, storage, disk I/O, memory and network bandwidth. New technologies have emerged as enterprises’ data needs keep expanding in variety, volume and velocity.

More Read

data mining

Data Mining Technology Helps Online Brands Optimize Their Branding

Four Strategies For Effective Database Compliance
What is Data Pipeline? A Detailed Explanation
How The Explosive Growth Of Data Access Affects Your Engineer’s Team Efficiency
What Are the Most Serious Privacy Concerns Regarding Big Data?

Technology waves are occurring more frequently than ever. Current technology waves include Big Data, data virtualization, columnar databases, BI appliances, in-memory analytics, predictive analytics, and self-service BI.

Common Promises

Each wave brings with it the promise of faster, easier to use and cheaper BI solutions. Each wave promises to be the breakthrough that makes the “old ways” archaic, and introduces a new dawn of pervasive BI responsive to business needs. No more spreadsheets or reports needed!

IT and product vendors are ever hopeful that the latest technology wave will be the magic elixir for BI, however, people seem to miss that it is not technology that is the gating factor to pervasive BI. What has held back BI has been the reluctance to address the core issues of establishing enterprise data management, information architecture and data governance. Those core issues are hard and the perpetual hope is that one of these technology waves will be the Holy Grail of BI and allow enterprises to skip the hard work of transforming and managing information. We have discussed these issues many times (and will again), but what I want to discuss is the inevitable result in the blind faith in the latest technology wave.

Common Results

Each wave typically advances BI in some way, but does not really create the breakaway promised; truly pervasive BI remains the Holy Grail. What is almost guaranteed with each new wave, however, is yet another data silo added to the many that already typically litter an enterprise landscape. As a result, many enterprises have one or more of the following: multiple data warehouses, operational data stores (ODS), independent (silo’d) data marts, spreadmarts, data shadow systems and scattered databases used for reporting. Further evidence of the tech wave spawning silos is that enterprises typically have multiple BI product implementations with six or more different BI products.

The people involved in each new wave typically assume that their predecessors (who implemented a previous tech wave) did not know what they were doing and/or just did not use the right technology. They think they know best, and the previous generation (maybe just a few years from being the latest wave) has nothing of value to teach them. Hence, the newest generation does it all from scratch, encountering the same pitfalls – pitfalls that often have nothing to do with technology and everything to do with data management, information architecture and data governance.

Sometimes, they create a new solution separate from the existing BI environment. After all, why get bogged done in the old wave, now a legacy application, when you can start from scratch. This means the next tech wave builds a new tech silo. It may produce business value in the short run, but in the long run the business group and IT have another silo to reconcile.

Enterprises need to look at their Big Data, data virtualization, columnar databases, BI appliances, in-memory analytics, predictive analytics, and self-service BI efforts and determine if they are going to be the next data silos. Unfortunately, the answer is likely to be yes.

The bottom-line is that business people need data and analytics from across the enterprise and not just from a new shiny BI silo. But for this to happen, the BI team has to stop the madness by not creating yet another silo and legacy application. Can you say “no” to the data silo?

 


[1] George Santayana (1905) Reason in Common Sense, volume 1 of The Life of Reason

RickSherman June 26, 2012
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data mining
Data Mining

Data Mining Technology Helps Online Brands Optimize Their Branding

7 Min Read
database compliance guide
Data Management

Four Strategies For Effective Database Compliance

8 Min Read
What is Data Pipeline A detailed explaination
Big Data

What is Data Pipeline? A Detailed Explanation

8 Min Read
data access for engineers
Big Data

How The Explosive Growth Of Data Access Affects Your Engineer’s Team Efficiency

11 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?