By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Big Data converging Data and Content
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Business Intelligence > Big Data converging Data and Content
Business IntelligenceExclusive

Big Data converging Data and Content

Barry Devlin
Last updated: 2011/12/08 at 1:13 PM
Barry Devlin
5 Min Read
Image
SHARE

ImageWhatever about my concerns (and those of others) that the term big data defies sensible definition, there is little doubt that it has been the big news of 2011 and looks set to continue in the same role next year.  One interesting trend that I see is a convergence of interests and approach between vendors from the once separate worlds of data and content.  The thinking springs from a recent conversation with Laur

ImageWhatever about my concerns (and those of others) that the term big data defies sensible definition, there is little doubt that it has been the big news of 2011 and looks set to continue in the same role next year.  One interesting trend that I see is a convergence of interests and approach between vendors from the once separate worlds of data and content.  The thinking springs from a recent conversation with Laurent Simoneau, President and CTO of Coveo.  But first, let’s make sure we all mean the same thing by data and content.

As discussed elsewhere, I find it useful to consider big data in four separate categories: (1) machine-generated event data, (2) computer-generated log data, (3) user-generated text and (4) user-generated audio, image and video.  These categories are based largely on the level of structure within the data and the differing technologies required to store and process it, leading to category boundaries that are somewhat flexible.  For completeness, and to include what we might call small data, let me add here category (0) which includes the traditional transaction and status data that we’ve stored and manipulated by computer for more than half a century.  We seem to have a tendency as humans to categorize the world in a binary fashion—good or bad, short or tall, black or white and so on.  You are no doubt familiar with the binary classification of structured vs. unstructured information which splits the above categories somewhere around (2).  I, myself, prefer the equivalent terms hard vs. soft information, simply because “unstructured information” is an oxymoron; information, by definition, has structure. 

The other common binary classification is data vs. content, where content starts at category (3) above.  The data/content division arises from an old technological boundary between databases and content stores.  Databases distinguish between pieces of information depending on their meaning and store them in separate records and fields; access is via query.  Content stores do not see or impose lower-level structuring of information; access is via search.  This distinction is oversimplified, of course.  Databases have been adding features to support large text fields and blobs (binary large objects) for years.  Content stores do, of course, support field structures.  However, such non-core add-ons have tended to be treated as second-class citizens on both sides.

More Read

data security in big data age

6 Reasons to Boost Data Security Plan in the Age of Big Data

How Big Data Is Transforming the Maritime Industry
Utilizing Data to Discover Shortcomings Within Your Business Model
Small Businesses Use Big Data to Offset Risk During Economic Uncertainty
The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas

Recent business developments and technological advances have caused vendors on both sides of the fence to look to the other side.  My most recent white paper, sponsored by NeutrinoBI, examined how search technology could be effectively applied to corporate data.  An earlier white paper with Attivio came at the convergence from the content side, extending the use of inverted indexes from the content world to more structured data.

Coveo have always had a large number of connectors to a wide variety of content from websites, e-mails and content stores as well as ODBC connectivity to relational databases.  Version 7.0 adds Twitter as a source.  Their Enterprise Search 2.0 concept—stop moving data and start accessing knowledge—will make perfect sense to anybody following the push for data virtualization in the BI world by vendors such as Composite Software and Denodo.

From a business point of view, the important point here is to recognize that business users need integrated access to both data and content in order to understand what’s going on and predict what to do next.  The volumes and varieties of big data make it very clear that this need cannot be satisfied by trying to push everything into or through one large information store, whether that be a database or a content store.  There are, and will continue to be, optimal storage and processing technologies for different types of information and different purposes.  Providing equal access to these different stores and equal priority to different access methods will be key.

TAGGED: Attivio, big data, content, data, Denodo
Barry Devlin December 8, 2011
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data security in big data age
Big Data

6 Reasons to Boost Data Security Plan in the Age of Big Data

7 Min Read
How Big Data Is Transforming the Maritime Industry
Big Data

How Big Data Is Transforming the Maritime Industry

8 Min Read
utlizing big data for business model
Big Data

Utilizing Data to Discover Shortcomings Within Your Business Model

6 Min Read
big data use in small businesses
Big Data

Small Businesses Use Big Data to Offset Risk During Economic Uncertainty

7 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?