We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Yes, you need more than just R for Big Data Analytics.
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Yes, you need more than just R for Big Data Analytics.
AnalyticsR Programming LanguageStatistics

Yes, you need more than just R for Big Data Analytics.

DavidMSmith
DavidMSmith
4 Min Read
Yes, you need more than just R for Big Data Analytics.
Illustration generated with Qwen Image.
SHARE

Douglas Merrill, former CIO/VP of Engineering at Google, writes in Forbes about using the R language for data analysis:

Most folks with math-oriented graduate degrees will have written something in R, a non-commercial option for your big data analysis.  So, great graduates from great graduate schools know great tools.

His post is titled ‘R Is Not Enough For “Big Data”‘, and you might be surprised to learn that I agree that title, although for a different reason. Douglas’s point — and it’s a valid one — is that simply pumping data through any software tool, without an understanding of the problem you’re trying to solve and how statistical models apply to it, can lead to getting the wrong answers to the wrong questions:

If you ask the wrong question, you will be able to find statistics that give answers that are simply wrong (or, at best, misleading).

On net, having a degree in math, economics, AI, etc., isn’t enough. Tool expertise isn’t enough.  You need experience in solving real world problems, because there are a lot of importat limitations to the statistics that you learned in school.  Big data isn’t about bits, it’s about talent.

This is a great illustration of why the data science process is a valuable one for extracting information from Big Data, because it combines tool expertise with statistical expertise and the domain expertise required to understand the problem and the data applicable to it. He’s right that you need data science talent and software to solve problems with Big Data … and having software like R that supports the exploratory nature of the data science process is also critical.

But I also agree with the title for a different, technical reason: the R software is just one piece of software ecosystem — an analytics stack, if you will — of tools used to analyze Big Data. For one thing R isn’t a data store in its own right: you also need a data layer where R can access structured and unstructured data for analysis. (For example, see how you can use R to extract data from Hadoop in the slides from today’s webinar by Antonio Piccolboni.) At the analytics layer, you need statistical algorithms that work with Big Data, like those in Revolution R Enterprise. And at the presentation layer, you need the ability to embed the results of the analysis in reports, BI tools, or data apps.

More Read

Big Data Paves The Way For Fantastic New Social Listening Tools
Big Data Paves The Way For Fantastic New Social Listening Tools
Huge Benefits Data Scalability Can Create for Your Business
SKF: Inverse Construction and Volatility
Driving Web Sales with Big Data and Personalization
Big Data is the Answer – What was the Question?

So yes, Douglas is right: you need more than just R for Big Data. You also need a data layer, an analytics layer, and a presentation layer (all of which supports Big Data) … and you need Data Science skills to make sure you’re asking the right questions and getting appropriate answers.

Forbes: R Is Not Enough For “Big Data”

TAGGED:big datadomain expertise
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
Big Data Business Intelligence Exclusive Web Analytics
Flat editorial illustration: A SaaS-editorial scene showing product usage, support patterns, and renewal feedback informing a fle
Using Product Usage Analytics and Support Data to Build a B2B Product Roadmap
Business Intelligence Infographic
From Hiring To Payroll: Managing HR Data Across Business Systems -- AI-generated illustration
From Hiring To Payroll: Managing HR Data Across Business Systems
Big Data Business Intelligence Infographic
Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
Analytics Business Intelligence Exclusive Marketing

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Strategizing for Big Data and AI in Your Business
Artificial IntelligenceBig DataBusiness IntelligenceExclusive

Strategizing for Big Data and AI in Your Business

6 Min Read
Data-Driven KPIs Are Pillars For SME Decision Making In 2021
Big DataExclusive

Data-Driven KPIs Are Pillars For SME Decision Making In 2021

5 Min Read
big data and vpn
Big DataPrivacy

5 Incredible Ways Big Data Has Made VPNs Powerful Privacy Tools

8 Min Read
Overcoming the Big Data Skills Gap: The State of the Labor Market
Big DataData ScienceExclusiveJobsNews

Overcoming the Big Data Skills Gap: The State of the Labor Market

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?