Big Data and Rise of Predictive Enterprise Solutions

Given the three Vs of Big Data, namely Volume, Variety and Velocity (read this for more), challenge before large and medium sized companies is how to unlock the potential of Big Data and productively leverage its value in running the business.

Given the three Vs of Big Data, namely Volume, Variety and Velocity (read this for more), challenge before large and medium sized companies is how to unlock the potential of Big Data and productively leverage its value in running the business.

In “traditional” Data Analytics or Business Intelligence, focus is more on analysis and reporting of “historic” or past data stored in the database. Take for example how most organizations use data from their CRM or ERP applications. Almost all the reports that are generated pertain to past or “historic” information. Running a business based on “historic” or past data is like driving a car looking in the rear view mirror and is not going to work.

Instead, companies must analyze all the available information in real time, apply statistical modeling techniques to available information in order to predict future outcomes and take action/run the business based on predicted outcome rather than analysis of historic data as is being done currently.

Since Big Data is characterized by not only Volume, but also Velocity and Variety, it is very important that Big Data is used for analysis in real-time to predict the future and take corrective action based on that analysis. How about using Causal Path analysis on Social Media data (like Twitter and Facebook) to predict Churn or Customer Attrition in Telecom industry and taking corrective action to prevent Churn/Attrition rather than analyzing “historic” attrition rate, call volumes or average response time as being done currently. The real value is in using predictive analytics and taking corrective action before it is too late, rather than just reporting historical information.

Techniques like Multiple-regression analysis coupled with Factor analysis, Cluster analysis and Causal Path analysis can be used very effectively with Big data – now that we have many variables and multiple observation for each variable at a customer level to generate statistically significant difference in analysis.

In future, no ERP or CRM system will be complete without Predictive Analytics functionality that will enable companies take preventive steps (rather than reactive) in real time. For example, rather than analyzing “historic” attrition rates, Predictive CRM application will make it possible for companies to identify critical incidents leading to customer attrition so that steps can be taken to retain the customer before he/she defects.

And thanks to Predictive Analytics, ERP or CRM applications will no longer be just a repository of “historical” information but will be transformed into a Predictive Knowledge base or Engine driving business decisions looking forward and not backwards/in the rear view mirror of “historic” information.

What do you think? Do you agree that Big Data will result in rise of Predictive Enterprise Solutions? Please do share your thoughts.