Big Data Trees with Hadoop HDFS

December 4, 2012
3 Views

Last month’s release of Revolution R Enterprise 6.1 added the capability to fit decision and regresson trees on large data sets (using a new parallel external memory algorithm included in the RevoScaleR package). It also introduced the possibility of applying this and the other big-data statistical methods of RevoScaleR to data files distributed in in Hadoop’s HDFS file system*, using the Hadoop nodes themselves as the compute engine (with Revolution R Enterprise installed).

Last month’s release of Revolution R Enterprise 6.1 added the capability to fit decision and regresson trees on large data sets (using a new parallel external memory algorithm included in the RevoScaleR package). It also introduced the possibility of applying this and the other big-data statistical methods of RevoScaleR to data files distributed in in Hadoop’s HDFS file system*, using the Hadoop nodes themselves as the compute engine (with Revolution R Enterprise installed). Revolution Analytics’ VP of Development Sue Ranney explained how this works in a recent webinar. I’ve embedded the slides below, and you can also watch the webinar recording on YouTube.

 

[*] Or to use the department of redundancy department-approved acronym, HHFDSFS

You may be interested

3 Indispensable Ways to Reach Your Marketing Potential with Data
Business Intelligence
0 shares194 views
Business Intelligence
0 shares194 views

3 Indispensable Ways to Reach Your Marketing Potential with Data

Rohan Ayyar - May 23, 2017

Today, all marketing is done on the back of data. Marketers know their decisions and actions must have a rationale…

How Did Big Data Create a Modern Day Manufacturing Workforce?
Big Data
0 shares293 views
Big Data
0 shares293 views

How Did Big Data Create a Modern Day Manufacturing Workforce?

Megan Ray Nichols - May 23, 2017

Despite its relatively brief lifespan thus far, big data is poised to reinvigorate the U.S. manufacturing workforce. Some of the…

4 Easy Steps How to Conduct IT Security Audit of Your Own Company
IT
0 shares339 views
IT
0 shares339 views

4 Easy Steps How to Conduct IT Security Audit of Your Own Company

GoganMarcell - May 22, 2017

Businesses often view data security audit as a stressful and intrusive process. Auditor walks around distracting everybody and meddling in…