By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    AI analytics
    AI-Based Analytics Are Changing the Future of Credit Cards
    6 Min Read
    data overload showing data analytics
    How Does Next-Gen SIEM Prevent Data Overload For Security Analysts?
    8 Min Read
    hire a marketing agency with a background in data analytics
    5 Reasons to Hire a Marketing Agency that Knows Data Analytics
    7 Min Read
    predictive analytics for amazon pricing
    Using Predictive Analytics to Get the Best Deals on Amazon
    8 Min Read
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Factual Logic: Why Numbers Count
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Business Intelligence > Business Rules > Factual Logic: Why Numbers Count
Business IntelligenceBusiness RulesDecision Management

Factual Logic: Why Numbers Count

CMatignon
Last updated: 2011/10/01 at 1:00 PM
CMatignon
7 Min Read
SHARE

Business Objectives matterThe funny thing about Decision Management technologies is that we obsess with automation but.

Business Objectives matterThe funny thing about Decision Management technologies is that we obsess with automation but. in many instances, projects lose steam before we get a chance to close the loop.  As a result, we hope that we are automating the right business logic but we don’t know for sure until much much much later.  We have often seen cases where factual feedback only came weeks after deployment!

No feedback loop?

In some cases, business rules are derived from data but we tend to call those predictive models or segmentation logic rather than business rules.  Business rules are, generally speaking, heavily judgmental.  As an expert, you want to codify how you make decisions.  Although we are used to measuring and monitoring the quality of predictive models, we tend not to do that same for business rules.  Why?  I think it has to do with:

More Read

How AI is Boosting the Customer Support Game

How AI is Boosting the Customer Support Game

AI-Based Analytics Are Changing the Future of Credit Cards
Enterprises Are Leveraging the Benefits of AI-Driven ERPs
AI In Marketing: Is It Worth the Hype?
What Is The Advantage Of Using SDK in AI Technology?
  • Tact: Why would you challenge an expert?  He/she knows better than anyone else!
  • Development context: Data tends to be absent from the environment where we develop the business rules; so data-driven testing is extra effort
  • Lack of time & resources: Getting systems wired to make those measurements is an expense that is not mandatory for the system to function; with project delays and other surprises along the way, this is the first capability to be cut

I would argue though that fact-based validation is vital to the success of many decisioning projects if not all.  It is common wisdom that Business Intelligence is vital to strategic decision-making.  Would you trust a management team to make the right decision in absence of dashboards, based only on intuition or rumors?  Of course not…  So why wouldn’t we look for the same insight for our operational decisions?

Where no feedback led this insurance company

I may have mentioned this story before, but it really stuck to my mind as I saw the chain of events invariably lead to project failure.  I will not name the Insurance company to avoid any embarrassment.  I had a chance to meet with the lead architect, a great guy, very capable.  He led the Automated Underwriting project beautifully and implemented all the business rules that came from the team of underwriters without a hiccup.  The application deployed to the first series of States on time.  The systems always deployed on Friday night to allow for a slow ramp up over the weekend.  Per company policy, the team was on-call over the weekend.  Within hours, the team was called on site to fix the mess.  The business rules, that did exactly what the underwriters wanted, did not achieve the business objectives they were looking for!  Taken in isolation, each rule made the accept / decline decision it was supposed to, but more often than not the transactions ended up in the refer pile for manual review.  There may have been a genuine lack of trust from the underwriters who did not want, consciouly or not, to release control to the automated system.  I do not intend any blame here.  It is human nature, especially for experts, to keep some oversight on the decisions.  If you do not pay attention to the numbers though, you may end up, like them, referring too many transactions and, as a result, flooding the underwriting team with applications to review manually.

The good news is that, thanks to BRMS technology, they have been able to fix the system in a matter of hours.  Had they encoded the logic into spaghetti code, they would not have been able to make the necessary changes in less than months.  The project was not the complete failure it could have been, but this first deployment was.

My take-away from this real-life experience is that we need to measure early, we need to measure often, we need to measure continuously.

Let me clarify here that Business Performance testing and monitoring is different from test case testing.  In this project, they had individual test cases that were created specifically for each captured rule.  The application did what it was supposed to.  It was the rate of automation that failed them.  One KPI was off and it had disastrous consequences for the project.

By having greater insight in the business performance of decisioning applications at the time of rules authoring, in addition to the measurements after deployment of course, the team would have been able to detect early that the application was to miss the KPI they hoped for.  They could have fixed the system way before it hit Production.  Everybody could have used a nice and peaceful weekend on deployment day.

Another side effect of having visibility into Business Performance is that you can build this trust with your business users.  If they are skeptical about decision automation and have a hard time letting go of control, they may gain reassurance along the way when they see the effect of their decisioning logic applied to historical transactions.  They might actually find some opportunities for additional improvement while diving into those performance reports.  Business Intelligence dashboards, combined with their expertise, can create a very powerful combination.  The business users I have worked with at Sparkling Logic have been seduced by the ability to explore the business impact of policy changes while they craft their decisioning logic.  To quote one of them, it is “awesome’.

So do not be afraid to show your business users what the numbers are…  Instead of fearing offending them, consider the extra power you give them!  and they want it…

 

CMatignon October 1, 2011
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Data Ethics: Safeguarding Privacy and Ensuring Responsible Data Practices
Best Practices Big Data Data Collection Data Management Privacy
data protection for SMEs
8 Crucial Tips to Help SMEs Guard Against Data Breaches
Data Management
How AI is Boosting the Customer Support Game
How AI is Boosting the Customer Support Game
Artificial Intelligence
AI analytics
AI-Based Analytics Are Changing the Future of Credit Cards
Analytics Artificial Intelligence Exclusive

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

How AI is Boosting the Customer Support Game
Artificial Intelligence

How AI is Boosting the Customer Support Game

6 Min Read
AI analytics
AnalyticsArtificial IntelligenceExclusive

AI-Based Analytics Are Changing the Future of Credit Cards

6 Min Read
ai-driven ERP software
Artificial Intelligence

Enterprises Are Leveraging the Benefits of AI-Driven ERPs

8 Min Read
AI in marketing
Artificial Intelligence

AI In Marketing: Is It Worth the Hype?

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?