Predictive analytics panel at Business Analytics Summit

I hosted a panel last week on predictive analytics at the Business Analytics Summit. I was joined by Richard Boire of the Boire-Filler Group, Jean-Paul Isson of Monster.com and Michael Berry of Data Miners (and author of Data Mining Techniques, one of my favorite Data mining books). I asked a series of questions and we got some great answers from the experts:

How is your organization using predictive analytics and what has been the business value of doing so?
- Richard’s customers use predictive analytics for acquisition models that target not only high responding prospects but also prospects that will be of high value to that organization once they become customers, retention Models that target high value, high risk customers and upsell Models that allow organizations to target customers most likely to become higher-value type customers among others.
- Monster.com uses predictive analytics for customer intimacy, customer satisfaction, customer retention, customer up sell and wallet share growth, customer acquisition, pricing, sales coverage optimization …

How is your organization using predictive analytics and what has been the business value of doing so?
- Richard’s customers use predictive analytics for acquisition models that target not only high responding prospects but also prospects that will be of high value to that organization once they become customers, retention Models that target high value, high risk customers and upsell Models that allow organizations to target customers most likely to become higher-value type customers among others.
- Monster.com uses predictive analytics for customer intimacy, customer satisfaction, customer retention, customer up sell and wallet share growth, customer acquisition, pricing, sales coverage optimization and product development.
- Michael focused on some more general points. He made the great point, if basic, that all predictive analytics focus on the future because that’s the only place you can have an effect and also pointed out that the business definition is critical. For instance, predicting which acquisition channel has the highest trial subscription sign up likelihood is potentially much less useful that predicting which channel is most likely to acquire customers that will keep a subscription beyond a trial period.
What are the challenges you have faced implementing predictive analytics in your business?
- Michael emphasized cultural and educational challenges – that this is a new way of doing things and companies often resist things that are not “our way”. The inability to find appropriate data in the right format was another big issue.
- Richard talked about obtaining buy-in and engagement from key stakeholders, the challenges of data and the value of having the right team to effectively implement predictive analytics. The absence of numeracy, of basic understanding of the power and limitations of the models was another big challenge.
- Jean-Paul also emphasized data quality and availability, especially because different countries and systems define things differently. A lack for application systems integration and standardization and of effective change management across regions can also be a problem, though the recent recession has helped with the second by making people more receptive to anything that might help.
How did you sell predictive analytics – how do you demonstrate the value of predictive analytics to the various stakeholders within your business?
- Richard suggested conducting sensitivity and business analysis to demonstrate monetary potential of project as well as identifying stakeholders who are engaged with the data and working with them to prove your case. A project that is a quick win in terms of ROI and implementation also really helps.
- Jean-Paul emphasized taking baby steps – starting with the basics and always have something meaningful to deliver. Showing the ROI of a model on a small group of customers (a smaller country or region for instance) also really helped.
- Michael said to focus on showing how the model will help them do what they do and made the point that he often finds he is the first to look at the data, putting him solidly into discovery mode. Like Richard and Jean-Paul he emphasized the importance of linking everything to real monetary measures.
With predictive analytics being such a hot topic, what do you think holds companies back from embracing and exploiting these techniques?
- Richard felt that a lack of knowledge combined with a discomfort around mathematics and numbers was a big problem. Change management and adopting a new approach also cause problems.
- Michael emphasized a lack of executive support and the need to get enough support to overcome organizational inertia. He also had a great example where existing measures can make adopting a model hard because the model will drive better overall results while driving a critical measure in the “wrong” direction.
- Jean-Paul talked about the lack of understanding/knowledge of the real value of predictive analytics also. The attitude of old school management that they are already successful so why do they need to change and spend more money. Bad experience with IT solutions over the years and the communication skills of those proposing the idea sometimes don’t help either.
What skills set are required to achieve success with predictive analytics?
- Richard emphasized importance of learning about the business domain, both so that effective models can be developed and so that the models can be related to measures that matter to business executives. Obviously strong quantitative/mathematical background and an ability to work easily with numbers as well as good communication and interpersonal skills were also needed.
- Jean-Paul said that a wide variety of skills are required with programmers, statisticians and data miners, business analysts, and web developers needed to deliver the solution to end users.
- Michael pointed out that intuition and creativity – an ability to see what’s important – is necessary also.
We wrapped up with the question what does it take to operationalize predictive analytics, to integrate predictive analytics as a regular business discipline? What are the pitfalls?
- Richard talked about discipline, repeatability, as well as tracking and performance management. A ruthless focus on the business implementation model is also key.
- Michael reminded us that actionability is critical – if we cannot act and act effectively on a prediction then it does us little good.
- Jean-Paul said it takes a clear vision, human capital, collaboration, people/process/technology and a focus on the customer/user experience.

READ

Putting Historic Business Data To Work With Machine Learning

I really enjoyed the panel and I hope I have captured its essence here. If predictive analytics interests you, and it probably should, check out this white paper I wrote on Putting Predictive Analytics to Work and this webinar I recorded with Eric Seigel on Optimizing Business Decisions with Predictive Analytics.

Cross-posted to BeyeNetwork and ebizQ, both of whom were media sponsors of the event.