Peter Drucker correctly foresaw that the next business revolution would redefine the very meaning and purpose of information. And while he did not refer to “Big Data” by that name, he also clearly envisioned the power of big data variety, stating that leveraging diverse information sources would be critical to achieving new business success.
We are in the midst of the Big Data information revolution today, but how did we get here? Back in 1950, the computer was the new “miracle” that Drucker and his colleagues expected would revolutionize business strategy and decision-making for top management. “We could not have been more wrong,” Drucker later wrote. Instead, computers and information technology revolutionized operational tasks – particularly accounting – with “near-zero impact on the management of business itself.”
Managing operational tasks has remained the primary focus of IT over the last five decades since. As a result, said Drucker, modern day IT can efficiently manage a company’s worldwide manufacturing and service operations, but has had far less impact on such decisions as what markets to enter or what existing or new products to offer. Peter Drucker foresaw that this was all about to change:
For top management, information technology [since 1950] has been a producer of data [for operational tasks]… Business success is based on something totally different: the creation of value and wealth.
This requires risk-taking decisions… on business strategy, on abandoning the old and innovating the new… the balance between the short term and the long term… between immediate profitability and market share. These decisions are the true top management tasks.
And in one enterprise after another, [business leaders] have begun to ask, “What information concepts do we need for our tasks?”
Drucker went on to suggest some answers to this key question, which sounds remarkably similar to today’s growing calls to focus Big Data initiatives on enabling Big Data variety:
[The most important] task in developing an effective information system for top management: the collection and organization of outside-focused information… customers and non-customers; competitors and non-competitors; markets… demographics… the share of income that customers spend [within] their industry… The more inside information top management gets, the more it will need to balance it with outside information – and that does not exist yet. Within the next 10 to 15 years, developing this data is going to be the next information frontier.
By freely integrating and joining insights drawn from a wide variety of diverse data and text-based information, organzations are transforming silos of information into what Drucker called “a producer of new and different questions and new and different strategies.”
[We have been] working with Attivio since 2008. [Attivio’s] unstructured JOIN capability opens amazing possibilities. We are now building an information warehouse for an organization with many thousands of dedicated information researchers. This warehouse will integrate more than ten structured and unstructured systems into a single query screen that can combine any information type. This system will contain hundreds of millions of documents and structured records.
The relational SQL paradigm is so deep in our thinking, that we “see” information in terms of tables and columns. Once I stopped thinking in tables and started thinking in flexible documents and [Attivio’s ad hoc JOIN] capability, information silos [simply became] integrated.