By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data Analytics instagram stories
    Data Analytics Helps Marketers Make the Most of Instagram Stories
    15 Min Read
    analyst,women,looking,at,kpi,data,on,computer,screen
    What to Know Before Recruiting an Analyst to Handle Company Data
    6 Min Read
    AI analytics
    AI-Based Analytics Are Changing the Future of Credit Cards
    6 Min Read
    data overload showing data analytics
    How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
    8 Min Read
    hire a marketing agency with a background in data analytics
    5 Reasons to Hire a Marketing Agency that Knows Data Analytics
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Big Data
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Business Intelligence > Big Data
Business Intelligence

Big Data

Steve Bennett
Last updated: 2010/02/07 at 1:55 AM
Steve Bennett
6 Min Read
SHARE

Several month’s ago a short video appeared on YouTube with an interview of LinkedIn’s Chief Scientist DJ Patil. In it he discusses how ‘Big Data‘ impacts the practise of analytics. I’ve only just got around to posting about it but I am doing so now because he has some insights that I agree with and would like to share as they are still relevant. 

Big data is today most often associated with the internet superstars like Google, eBay and Amazon. There are 3 other areas with lower profiles where big data is important: intelligence (spooks, the military, etc.), scientific and academic research, and the financial markets.

Big data’s future is much bigger than this because more and more areas of human activity are going to be faced with vast data sets. When you hear people talking about the growth of knowledge and statements like ‘if this data were printed then the stack would grow faster than NASA’s fastest rocket‘, you have to remember that there is a good chance that each page of new data is adding to someone’s analytic data set.

More Read

analyzing big data for its quality and value

Use this Strategic Approach to Maximize Your Data’s Value

7 Data Lineage Tool Tips For Preventing Human Error in Data Processing
Preserving Data Quality is Critical for Leveraging Analytics with Amazon PPC
Quality Control Tips for Data Collection with Drone Surveying
Scalability-focused Email Marketing Solutions that Incorporate Hadoop

    I’m not quoting the guy verbatim but here’s what I heard…

    Several month’s ago a short video appeared on YouTube with an interview of LinkedIn’s Chief Scientist DJ Patil. In it he discusses how ‘Big Data‘ impacts the practise of analytics. I’ve only just got around to posting about it but I am doing so now because he has some insights that I agree with and would like to share as they are still relevant. 

    Big data is today most often associated with the internet superstars like Google, eBay and Amazon. There are 3 other areas with lower profiles where big data is important: intelligence (spooks, the military, etc.), scientific and academic research, and the financial markets.

    Big data’s future is much bigger than this because more and more areas of human activity are going to be faced with vast data sets. When you hear people talking about the growth of knowledge and statements like ‘if this data were printed then the stack would grow faster than NASA’s fastest rocket‘, you have to remember that there is a good chance that each page of new data is adding to someone’s analytic data set.

      I’m not quoting the guy verbatim but here’s what I heard and my takeouts to his comments:

      • Open source ‘big data ready’ technologies like Hadoop (see my earlier blog or here) have come into their own now. Look to people with these skills over those only with SQL if you are facing big data challenges.
      • We have reached a tipping point in the use of open source for commercial solutions to big data problems.
      • If you want good analysts then the best place is to look is in occupations where people will already have the practical skills in manipulating big data sets: scientific fields like meteorology, oceanography and the like. I agree but this is not the only place as in my experience I also need analysts that relate well to business decision makers – i.e. those people that make commercial decisions based on the analytics. This is perhaps less important in pure tech plays like LinkedIn.
      • Open source will transform the practise of analytics in the next 3 – 5 years. I think it will take longer than this to really impact the more traditional industries. I’m not happy about this but I am realistic about the difficulty in convincing business leaders that open source is a superior solution to proprietary ones. The money behind the big vendors will keep them going for a number of years yet.

      One potential qualifier to DJ Patil’s perspective is that although he has a very impressive big data background as a mathematician, US Department of Defence analyst (‘Threat Anticipation’), and former eBay Director of Strategy and Analytics, his current employer is LinkedIn.

      The core of LinkedIn’s big data is structured and fairly static: profiles of people. So I’m not sure how similar their big data challenges would be to, say, those faced with processing, understanding and predicting large streams of real time data from financial markets or very large sensor arrays. On the other hand, the growth of LinkedIn communities and their related activities must generate large amounts of semi-structured data.

      I also have no idea what LinkedIn’s own analytic goals are beyond what DJ mentions on his own profile where he says his analytics drives product features like:

      • “People You May Know”
      • “Who Viewed My Profile”
      • “Groups You Might Like”

      Maybe somebody reading this blog knows more?

      The video is on YouTube and I embed it here for convenience:

      Or you can download ‘DJ Patil on How Big Data Impacts Analytics’ directly from this blog.

      Link to original post

      TAGGED: data quality, hadoop, open source
      Steve Bennett February 7, 2010
      Share This Article
      Facebook Twitter Pinterest LinkedIn
      Share

      Follow us on Facebook

      Latest News

      data Analytics instagram stories
      Data Analytics Helps Marketers Make the Most of Instagram Stories
      Analytics
      data breaches
      How Hospital Security Breaches Devastate Local Communities
      Policy and Governance
      analyst,women,looking,at,kpi,data,on,computer,screen
      What to Know Before Recruiting an Analyst to Handle Company Data
      Analytics
      data perspective
      Tackling Bias in AI Translation: A Data Perspective
      Big Data

      Stay Connected

      1.2k Followers Like
      33.7k Followers Follow
      222 Followers Pin

      You Might also Like

      analyzing big data for its quality and value
      Big Data

      Use this Strategic Approach to Maximize Your Data’s Value

      6 Min Read
      data lineage tool
      Big Data

      7 Data Lineage Tool Tips For Preventing Human Error in Data Processing

      6 Min Read
      data quality and role of analytics
      Data Quality

      Preserving Data Quality is Critical for Leveraging Analytics with Amazon PPC

      8 Min Read
      data collection with drone use
      Data Collection

      Quality Control Tips for Data Collection with Drone Surveying

      9 Min Read

      SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

      giveaway chatbots
      How To Get An Award Winning Giveaway Bot
      Big Data Chatbots Exclusive
      ai is improving the safety of cars
      From Bolts to Bots: How AI Is Fortifying the Automotive Industry
      Artificial Intelligence

      Quick Link

      • About
      • Contact
      • Privacy
      Follow US
      © 2008-23 SmartData Collective. All Rights Reserved.
      Go to mobile version
      Welcome Back!

      Sign in to your account

      Lost your password?