We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
    chatgpt image jul 21, 2026, 04 34 30 pm
    4 Core Benefits of Predictive Maintenance after Vibration Analysis
    10 Min Read
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results -- AI-generated illustration
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results
    11 Min Read
    chatgpt image jul 13, 2026, 04 23 45 pm
    How Data Analytics Helps Companies Improve User Engagement
    19 Min Read
    chatgpt image jul 13, 2026, 03 59 46 pm
    How Data Analytics Improves Multi-Location Search Strategies
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Discovery Analytics: It’s Not Hacking, It’s R&D
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > Discovery Analytics: It’s Not Hacking, It’s R&D
Uncategorized

Discovery Analytics: It’s Not Hacking, It’s R&D

BillFranks
BillFranks
8 Min Read
Discovery Analytics: It’s Not Hacking, It’s R&D
Illustration generated with FLUX.2 [klein 4B] via Cloudflare Workers AI.
SHARE

I spend a lot of time these days talking with companies about the need for a formal approach to enabling what is often called “discovery analytics” or “exploratory analytics.” What I find is that many people have a fundamental misunderstanding of what discovery analytics is all about. There is one analogy that I have found to be effective in getting people to better understand the concept. In this blog, I’ll walk you through that analogy.

Contents
  • IT ISN’T AIMLESS HACKING!
  • WE’RE REALLY TALKING ABOUT RESEARCH & DEVELOPMENT
  • RAMPING UP YOUR ANALYTICS R&D FUNCTION

IT ISN’T AIMLESS HACKING!

Many people get very concerned when I begin to discuss discovery analytics as being not fully defined, constantly evolving, and remaining fluid. They tell me that what I’m saying sounds a lot like a mad scientist sitting down running random experiments in the hope of finding something useful. I do not espouse such an approach, I can assure you!

On the contrary, a discovery process should always start with a specific high priority business problem in mind. There should also be at least a general idea of how to address the problem effectively through analytics after some initial brainstorming. At that point, a discovery process is started to explore how well our ideas actually do address the problem. Typically, a discovery process involves one or more big unknowns:

  • We may be addressing a totally new business problem
  • We may be utilizing one or more new and /or largely untested data sources
  • We may be making use of analytics techniques that we haven’t used in the past

In short, while we think a proposed approach has merit, we really don’t know for sure how well it will work. The only way to find out is to dig in and see what we find. As a part of that process, we may well adjust our approach across any number of dimensions. The final solution we find may be somewhat different than the path we started down, but it will be found by remaining focused on the core problem we start with.

More Read

More Questioning Minds Needed (And Don’t Forget the Analytics)
More Questioning Minds Needed (And Don’t Forget the Analytics)
Enhance Your CRM Data to Sharpen Your Sales Pitch
Signs Your Technology Is Outdated
Were the Election Polls Marred by Poor Quality Data?
How The Online Gaming Industry Uses Big Data Analytics To Grow

WE’RE REALLY TALKING ABOUT RESEARCH & DEVELOPMENT

If analytics is going to be a strategic component of your business, then you need to invest in analytics just like you do for other core products and services your company offers. Discovery analytics aren’t mindless hacking any more than traditional research and development activities are. People accept that an R&D team will have to be creative and try many paths to identify a winner. At first glance, some say that this is acceptable in a traditional product setting but not in a discovery analytics setting. I suggest that it is important to realize that the two are the same.

One of our high-tech customers takes only take a handful of new products to market in any given year. However, massive investments with many trial and error experiments happen behind the scenes to get those products ready. At the other end of the product complexity scale, quick-serve companies only bring a few new menu items to market each year. In their test kitchens, however, a never-ending stream of new recipes and ingredients are explored to arrive at the winners that make it to your local restaurant.

Discovery analytics are much the same. A variety of attempts will be made, of which only a few will turn out worthy of a full deployment. But, those that are worthy will have a high level of strategic value if efforts are focused in the correct areas of the business up front. Some ideas may not work out at all and will have to be abandoned. I’m sure there are also many computer chips or chicken sandwiches that never made it out of the R&D process either. Not every effort will turn into a winner, but working through the losers is the only way to get to the winners. In fact, if your analytics do not generate some losers, something is wrong: either they aren’t being made known, or the analytics team is not continuously pushing the limits of innovation.

RAMPING UP YOUR ANALYTICS R&D FUNCTION

It is critical to redirect discussion on discovery analytics toward the R&D parallel. People are much more comfortable with R&D because it is viewed as a rational, scientific, disciplined approach to developing new products and ideas. Discovery analytics is just that. Of course, it takes ongoing effort to ensure that any R&D function stays on the right path. With correct oversight and leadership, however, there is no reason your organization can’t reap large benefits from discovery analytics over time.

The best thing about building up an analytics R&D function is that it will self-propel itself forward. Start by getting commitment for a limited number of human and technology resources to address only a handful of critical business problems. Once you prove it works, slowly ask for more resources to attack more problems. Over time, you’ll be able to grow a stable, accepted analytics research and development function. You just have to push through the initial misunderstandings and the resistance to the unknown.

I think you’ll find, like I have, that very few people will argue against the merits of research and development as a business endeavor. The first step in the process of enabling discovery analytics at your organization is to ensure that people understand that you’re just talking about a different type of R&D effort. You’ll still have a lot of work to do, but at least people will be willing to listen to you make your case and hopefully give you a chance to show what you can do.

TAGGED:analytics
Share This Article
Facebook Pinterest LinkedIn
Share
ByBillFranks
Follow:
Bill Franks is Chief Analytics Officer for The International Institute For Analytics (IIA). Franks is also the author of Taming The Big Data Tidal Wave and The Analytics Revolution. His work has spanned clients in a variety of industries for companies ranging in size from Fortune 100 companies to small non-profit organizations. You can learn more at http://www.bill-franks.com.

Follow us on Facebook

Latest News

Flat editorial illustration: The article explains that training robots for physical interaction requires three distinct data cate
Physical AI: What Data Do You Need to Train a Robot?
Artificial Intelligence Exclusive Robotics
What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
Analytics Big Data Exclusive Software
Flat editorial illustration: The article examines AI agents that escalate from legitimate data retrieval to attempted intrusions
OpenAI’s Government Website Incidents Raise a Hard Question for AI Agents: When Should They Stop?
Artificial Intelligence News Security
Flat editorial illustration: The article's core relationship is the alignment between customer behavioral data (visit frequency,
Data-Driven Loyalty: How Restaurants Use Behavioral Analytics to Optimize Revenue
Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Who Remembers Saying “This is where we came in”?
Uncategorized

Who Remembers Saying “This is where we came in”?

6 Min Read
Big Data and the Rise of Instant Analytics: The Word
Big Data

Big Data and the Rise of Instant Analytics: The Word

5 Min Read
It's time to industrialize analytics
Business IntelligenceData MiningData WarehousingExclusivePredictive Analytics

It’s time to industrialize analytics

8 Min Read
Successful Business Intelligence Projects:  The Role of Managers and Leaders
Business IntelligenceData MiningPredictive Analytics

Successful Business Intelligence Projects: The Role of Managers and Leaders

3 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

5 Great Tips for Using Data Analytics for Website UX
5 Great Tips for Using Data Analytics for Website UX
Big Data
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?