By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    analyst,women,looking,at,kpi,data,on,computer,screen
    What to Know Before Recruiting an Analyst to Handle Company Data
    6 Min Read
    AI analytics
    AI-Based Analytics Are Changing the Future of Credit Cards
    6 Min Read
    data overload showing data analytics
    How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
    8 Min Read
    hire a marketing agency with a background in data analytics
    5 Reasons to Hire a Marketing Agency that Knows Data Analytics
    7 Min Read
    predictive analytics for amazon pricing
    Using Predictive Analytics to Get the Best Deals on Amazon
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Not Only SQL, Not Only Big Data
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Quality > Not Only SQL, Not Only Big Data
Business IntelligenceCommentaryData QualityKnowledge ManagementPolicy and Governance

Not Only SQL, Not Only Big Data

Barry Devlin
Last updated: 2012/04/25 at 11:18 AM
Barry Devlin
6 Min Read
SHARE

Big Rubbish PIle on Car.jpgAttending the Teradata Universe 2012 in Dublin, an impressive line-up of speakers from Tim Berners-Lee to customers doing

Big Rubbish PIle on Car.jpgAttending the Teradata Universe 2012 in Dublin, an impressive line-up of speakers from Tim Berners-Lee to customers doing real data warehouse implementations got me thinking beyond the normal boundaries about our assumptions about the real role and value of data – both traditional and big.  A few observations follow, but first…

As an ex-pat Irishman, I have to say that the new Convention Centre Dublin is a wonderful venue for events with up to a couple of thousand attendees.  The main auditorium is a superb space and there’s lots of room for expo and breakouts.  And the facilities and staff are first rate.  Well done!  My only regret is that the area around the Centre, especially towards the Port, remains blighted by vacant sites and unfinished blocks – the legacy of Ireland’s boom and bust – but not much can be done about that for now.

Much of the main tent focus at this year’s event was on the future of information, with big data featuring… well… large in the presentations of speakers such as Erik Brynjolfsson, Professor and Director of the MIT Center for Digital Business and Sir Tim Berners-Lee, inventor of the World Wide Web.  Michio Kaku, Professor of Theoretical Physics at City College of New York, also addressed the theme of the central role of data in every aspect of our future.  The tone of these presentations is best described as expansive and optimistic – given better and more data and technology, the future of business and humankind in general is rosy.  This is an expectation that I, personally, believe to be of somewhat low probability.

More Read

analyst,women,looking,at,kpi,data,on,computer,screen

What to Know Before Recruiting an Analyst to Handle Company Data

Tackling Bias in AI Translation: A Data Perspective
The Role of Data in Understanding Demographics for Effective Marketing
7 Ways Data Monetization is Changing the Information Technology Job Market
6 Reasons to Boost Data Security Plan in the Age of Big Data

While I am a long-time supporter of the need for and value of good and extensive information in business, my experience of the purposes for which such information is used and the extent to which decision making benefits is less sanguine.  In general business, business intelligence is used almost exclusively in support of a narrowly-focused drive for bottom-line profit.  At the risk of being labeled a Communist, I remain unconvinced that this is always a good thing.

This niggling doubt is best expressed through an example – the use of data warehousing in retail, something that has been going on for over 25 years.  BI can be very effective in optimizing the supply chain from manufacturer all the way to customer, supporting the intent of the business to reduce cost.  When that focus is pursued as a sole strategy, it can have highly undesirable effects, through driving local suppliers out of business, reducing a community’s disposable income and creating an unbreakable downward economic spiral.  As a BI community we can say that BI is not responsible, and on the level of cause and effect, that’s true.  But, at a deeper level, we cannot ignore the side effects of the tools and techniques we invent and promote, any more than cigarette manufacturers can avoid responsibility for the impact of passive smoking.

Getting back to big data, the problem is that as we focus on, and get excited about, a technique such as statistical analysis of social behavior to predict marketing trends for a brand, for example, we simultaneously narrow our focus on potentially interesting or important information that is external to that data.  Big data encourages us to somewhat obsessively analyze in ever greater depth the minutiae of life.  Why?  Often to drive profit for some business.  The optimistic view I mentioned earlier imagines that we will use this data to solve medical issues, world hunger, climate change, and more.  I don’t have data to confirm this, but I guess that the proportion of profit-driven big data analytics vs. altruistic is greater than 10 to 1.  And which of these two categories of information have the highest impact on the medium- and long-term survival of humanity?  The last speaker, Deb Roy, CEO of Bluefin Labs, showed us just how much analysis can be done to link social network activity to TV shows and advertising.  All to decide where to spend millions of advertizing dollars.  There two ways of looking at this: (1) everybody needs to do this type of processing in order to compete, or (2) we need to examine our underlying model of doing business that drives such net-non-productive activity.  I would invite you to share your views on this.

At a more mundane and practical level, speakers from current Teradata customers focused in a very different area – creating consistent and integrated enterprise data warehouses for very traditional transaction business data.  Unsurprisingly, the majority of enterprises are still struggling with the old issues that drove data warehouse development for the past 30 years.  I have no doubt that this will continue for most businesses for many more years.  

But, while this continues, we need to start thinking about the more philosophical issues that the conference brought up for me.

 

TAGGED: big data
Barry Devlin April 25, 2012
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data breaches
How Hospital Security Breaches Devastate Local Communities
Policy and Governance
analyst,women,looking,at,kpi,data,on,computer,screen
What to Know Before Recruiting an Analyst to Handle Company Data
Analytics
data perspective
Tackling Bias in AI Translation: A Data Perspective
Big Data
Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Best Practices Big Data Data Collection Data Management Privacy

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

analyst,women,looking,at,kpi,data,on,computer,screen
Analytics

What to Know Before Recruiting an Analyst to Handle Company Data

6 Min Read
data perspective
Big Data

Tackling Bias in AI Translation: A Data Perspective

9 Min Read
demographics big data in marketing
Big Data

The Role of Data in Understanding Demographics for Effective Marketing

7 Min Read
data monetization
Big Data

7 Ways Data Monetization is Changing the Information Technology Job Market

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?