Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    image fx (60)
    Data Analytics Driving the Modern E-commerce Warehouse
    13 Min Read
    big data analytics in transporation
    Turning Data Into Decisions: How Analytics Improves Transportation Strategy
    3 Min Read
    sales and data analytics
    How Data Analytics Improves Lead Management and Sales Results
    9 Min Read
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: The Dark Matter of Data
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > The Dark Matter of Data
AnalyticsData MiningData QualityData VisualizationRisk Management

The Dark Matter of Data

Erica Driver
Erica Driver
5 Min Read
SHARE

“I think there’s a sense that many of us have that the great age of exploration on earth is over. That for the next generation they’re going to have to go to outer space or the deepest oceans to find something significant to explore. But is that really the case?” — Dr. Nathan Wolfe


“I think there’s a sense that many of us have that the great age of exploration on earth is over. That for the next generation they’re going to have to go to outer space or the deepest oceans to find something significant to explore. But is that really the case?” — Dr. Nathan Wolfe

I recently watched a TED video by Dr. Nathan Wolfe, founder and CEO of the Global Viral Forecasting Initiative. I was attracted by the title, “What’s Left to Explore?” In this video, Wolfe explains that about 20% of the genetic information in the human nose (which can be obtained through a nasal swab) doesn’t match anything that we’ve ever seen before:  no plant, animal, fungus, virus, or bacteria. This is also the case for 40% to 50% of the genetic information in the human gut.

Wolfe refers to these unknowns as “biological dark matter.” According to Wikipedia today, dark matter is “an unknown type of matter hypothesized to account for a large part of the total mass in the universe.” Biological dark matter is genetic matter that can’t be typed or matched with anything we’ve seen before. 

In biological dark matter, Wolfe sees an exciting possibility: identifying an entirely new class of life (like the concept of a virus, identified by Dutch scientist Martinus Beijerinck within the last century) that may enable us to identify the cause of a cancer or the source of an outbreak, or create a new tool in molecular biology.

The same holds true for business data. One might be tempted to think, “We’ve got data. Lots of it. We’ve got Big Data. What’s left to explore?” Sure, you’ve got data. But it’s in myriad different systems and in an endless number of formats. What might you discover if you brought seemingly unrelated data from these multiple source systems into one QlikView app, where the associations (and lack thereof) in the data would become visible, perhaps for the very first time?

A QlikView app automatically maintains all the associations in the data and calculates aggregations on the fly. The result? Through an associative experience, users can now explore the dark matter of data. They can click or tap away, or lasso sections of charts or regions of maps and at all times they can see what data is associated with their selections and what data is not.

Users make a selection in one chart and all other charts and graphs in the entire app update to reflect that selection — with no hard coding. Users think of a second question, and a third one, and make more selections, and all the charts and graphs in the app update again instantly. It’s through this associative experience that users can easily see, in a visual way, any outliers in the data or any unexpected relationships. (For more info see the QlikView White Paper, What Makes QlikView Unique.)

Dr. Nathan Wolfe offers a great lesson for would-be explorers and it applies to explorers of data as well as biology and genetics: “Don’t assume that what we currently think is out there is the full story. Go after the dark matter in whatever field you choose to explore. There are unknowns all around us and they are just waiting to be discovered.”

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

image fx (60)
How Finance & BI Teams Choose Accounting Software
Big Data Business Intelligence Exclusive
Why the AI Race Is Being Decided at the Dataset Level
Why the AI Race Is Being Decided at the Dataset Level
Artificial Intelligence Big Data Exclusive
image fx (60)
Data Analytics Driving the Modern E-commerce Warehouse
Analytics Big Data Exclusive
ai for building crypto banks
Building Your Own Crypto Bank with AI
Blockchain Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

PAW: SAS and the art and science of better

4 Min Read
Image
Predictive AnalyticsSoftware

Predictive Analytics in Software: Focusing on Automation

3 Min Read

How To Become A Data-Driven Company

4 Min Read

Big Data and the New Face of Commerce

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?