By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: BI Meets Machine Learning and the Internet of Me
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > BI Meets Machine Learning and the Internet of Me
AnalyticsBig DataData Mining

BI Meets Machine Learning and the Internet of Me

Eran Levy
Last updated: 2016/09/27 at 1:12 PM
Eran Levy
10 Min Read
SHARE

The Internet of Things Gets Hyper-Personal

Contents
Business Intelligence and the IoMMachine Learning as the Great EnablerClosing

With any new technology, the hype tends to reach unbearable volumes far before anyone can point to tangible business benefits. But when it comes to the IoT, it is quickly becoming a force that affects our everyday lives – albeit we might not be completely aware of it. I am referring to a phenomenon that we are already constantly interacting with, in an almost invisible manner: the Internet of Me (following convention, let’s abbreviate this to IoM).

The Internet of Things Gets Hyper-Personal

More Read

data science anayst

Growing Demand for Data Science & Data Analyst Roles

How Big Data Is Transforming the Maritime Industry
Predictive Analytics Helps New Dropshipping Businesses Thrive
Utilizing Data to Discover Shortcomings Within Your Business Model
Small Businesses Use Big Data to Offset Risk During Economic Uncertainty

With any new technology, the hype tends to reach unbearable volumes far before anyone can point to tangible business benefits. But when it comes to the IoT, it is quickly becoming a force that affects our everyday lives – albeit we might not be completely aware of it. I am referring to a phenomenon that we are already constantly interacting with, in an almost invisible manner: the Internet of Me (following convention, let’s abbreviate this to IoM).

The IoM is internet 3.0: it surrounds us, wraps itself around us in a seamless manner through the intricate network of devices and applications that follow us everywhere we go. It knows where we are, when we got there, how, and where we’re headed next. It knows our needs, our desires, intentions, our permissions, and limitations. And it uses all this information to serve us with actionable information in a zero-click fashion.

Need an example? Think of services such as Google Now, that can recommend routes and parking spaces before you’ve even told it where you want to go; think of the way Facebook serves you exactly the content (and advertising…) you want to see. These companies use powerful hardware and algorithms to crunch the abundance of data which they collect about their users’ online and offline behavior in order to provide a hyper-personalized experience.

NB: this experience is usually not triggered by the users. The IoM doesn’t wait for the user to ask a question; it certainly doesn’t present her with a myriad of graphs and waits for her to reach her own conclusions. It gives her the bottom line – what the data people might call the actionable insight.

If you accept that the IoM, which is powered by deep analysis of both sensor and web data, is indeed a major force in our lives already, and that it will grow more dominant over time, one obvious question is in what ways this will seep into the business world. Will these automated, hyper-personalized insights drive business executives at decision-making crossroads, in the way that a traffic app might direct you to take one route or another at an actual crossroads? I believe that the answer to this is a resounding yes.

Business Intelligence and the IoM

To understand what I mean, let’s think of how business typically interacts with data today. It’s mainly through the stakeholders’ personal computers or mobile devices, they need to login to some specific business intelligence system(s), where they can look at… graphs, which they then need to interpret and translate into action.

There is nothing inherently wrong with this process, and today’s non-analyst business user is typically data-savvy and able to reach an intelligent conclusion based on these charts and graphs. Nevertheless, modern technology presents a broader range of possibilities.

Imagine you’re driving to work and can ask your personal assistant app about your sales targets for the day. Imagine smart lights changing color to reflect the current state of your business objectives – based on numbers that are crunched behind the scenes. Imagine having your questions answered far before you asked them, driving your next decisions based on automated alerts across a variety of devices and platforms.

We’re not there yet – today’s data is consumed mostly in dashboards, and this is still the foremost part of Sisense’s business intelligence solution. But the future lies beyond the dashboard – data insights that happen in your real-life environment. To reference the old cliche’, you’ll be able to “ask the fridge” about your company’s performance, and the fridge will automatically know how to give you the exact answer that’s relevant for you – rather than commissioning a new report from your BI department.

Machine Learning as the Great Enabler

So far we’ve talked about IoT. Where does machine learning fit into this? The simple answer is that everything I’ve described above is made possible, in one way or another, by machine learning.

The obvious way this is manifested is in the usage of machine learning to create these hyper-personalized, seamless experiences, which are based on the aggregated knowledge of user behavior collected in real-time and applying constantly evolving algorithms to both personal and collective data, which is then derived into the single insight or suggestion tailored to meet a specific end user’s needs.

But the other, less obvious way machine learning can facilitate the IoM in the business world, is by giving businesses the power to deliver these experiences, even for companies that don’t have the massive hardware infrastructure or troves of engineers employed by the world’s tech giants.

Sisense employs machine learning as a core element of its In-Chip™ data processing algorithms. Without getting too deep into the technical nitty-gritty (I’ll be doing that at my keynote presentation at Strata), I’d like to explain how this is done to demonstrate the way machine learning can make powerful analytics accessible on modest hardware deployments.

We call it query recycling – breaking queries into smaller blocks that are later reassembled to answer future queries: if user A asks a completely new question such as “what was our average deal size last year?” and user B later asks “what is our year-over-year growth in sales?”, the second user will receive their answer faster – because the system has already performed some of the aggregations needed to answer their question.

This is not mere caching as you would find in traditional OLAP – it is a learning algorithm that grows smarter and more efficient over time and as more unique queries accumulate. It learns to identify the reusable chunks within each query, and to use these as a knowledge base for future reference. And as the system becomes smarter, it becomes faster, allowing it to scale horizontally and serve more concurrent users – on the exact same hardware. Rather than increasing latency, the additional users and queries contribute to the knowledge graph; and so, almost paradoxically, Sisense performs better as the amount of users grows. The additional computational resources are offset by the fact that the engine has so many more queries to “recycle”.

This is part of what enables Sisense to crunch really big datasets on completely regular hardware – for example, a terabyte of data on a single node in 10 seconds, as was seen in a previous Strata conference.

Thus machine learning can be used as a back-end technology that empowers today’s businesses and gives them the ability to process massive, complex data with the speed and agility needed to power an IoM-like system – on standard hardware and with a handful of business analysts, rather than an army of clusters and data scientists.

Closing

This combination of smart devices, learning algorithms, and the ability to produce and deliver insights in a way that’s simpler and more intuitive than ever before – presents mind-boggling possibilities for tomorrow’s data-driven business. As in many other areas of tech that are being rapidly disrupted – the future is exciting, and I for one can’t wait to be a part of it.

Eran Levy September 27, 2016
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data science anayst
Data Science

Growing Demand for Data Science & Data Analyst Roles

6 Min Read
How Big Data Is Transforming the Maritime Industry
Big Data

How Big Data Is Transforming the Maritime Industry

8 Min Read
predictive analytics in dropshipping
Predictive Analytics

Predictive Analytics Helps New Dropshipping Businesses Thrive

12 Min Read
utlizing big data for business model
Big Data

Utilizing Data to Discover Shortcomings Within Your Business Model

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data
giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?