Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
    pexels pavel danilyuk 8112119
    Data Analytics Is Revolutionizing Medical Credentialing
    8 Min Read
    data and seo
    Maximize SEO Success with Powerful Data Analytics Insights
    8 Min Read
    data analytics for trademark registration
    Optimizing Trademark Registration with Data Analytics
    6 Min Read
    data analytics for finding zip codes
    Unlocking Zip Code Insights with Data Analytics
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: 5 Ways Dark Data Is Changing Data Analytics
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > IT > Security > 5 Ways Dark Data Is Changing Data Analytics
AnalyticsBig DataData ManagementExclusiveSecurity

5 Ways Dark Data Is Changing Data Analytics

Kayla Matthews
Kayla Matthews
7 Min Read
dark data and big data analytics
Shutterstock Licensed photo - By everything possible
SHARE

Dark data is the material a company collects, stores and processes during its daily operations, but typically does not use for purposes that could be beneficial. There are numerous ways dark data is impacting the ways entities analyze and use data.

Contents
1. It’s Helping Historical Data Further Current Scientific Research2. It’s Making Businesses Consider How Dark Data Fits Into GDPR Regulations3. It’s Creating More Uses for Innovative Technologies4. It’s Enabling Establishments to Know Even More About People5. It’s Increasing Data Security Risks If Left Unstructured

1. It’s Helping Historical Data Further Current Scientific Research

Data collected as part of publicly funded research occurring in the United States and some other nations must be kept in public databases. However, one research study investigated how materials collected in the 1970s and 1980s about zooplankton existed during a time when the technology was not available to publicize that data.

Scientists know this kind of dark data could give valuable information about how the ocean has changed since those past generations due to climate change. Therefore, there’s a modernized effort to tap into that dark data and use it to motivate ongoing research.

2. It’s Making Businesses Consider How Dark Data Fits Into GDPR Regulations

In May 2018, the General Data Protection Regulation (GDPR) will come into effect and have implications for all businesses in the European Union that store data or companies outside of it that collect data from or market to EU citizens.

More Read

machine learning and contract management
How Machine Learning And Contract Management Go Together
Case Studies Demonstrate Benefits Of Data Driven Email Marketing
How AI Developers Can Get Expert Help with CS Tasks
Make Sure Metrics Don’t Kill Your Business
Using AI to Build a Successful Multilingual Website in 4 Steps

One of the most interesting components of it is that consumers can exercise the so-called right to be forgotten and ask companies to delete their data under certain circumstances.  However, fulfilling such requests could become time-consuming and costly if businesses continue to ignore dark data.

Statistics collected in 2016 by IBM found 80 percent of all data was the dark, unstructured variety. Not surprisingly, analysts have pointed out that under GDPR regulations, business representatives who don’t pay attention to dark data could be at increased risks for GDPR fines if dark data gets exposed during a breach. That’s in addition to the obvious challenges of a customer requesting removal of his or her dark data.

3. It’s Creating More Uses for Innovative Technologies

Data virtualization is a process that connects all of a company’s data sources and presents them in a unified dashboard, allowing people to see the compiled material in real time, or as close to it as possible. It also brings agility to data processing, and some product representatives believe their data virtualization solutions could bring visibility to dark data.

Another technological advancement that could facilitate helping businesses start to make dark data structured and usable is artificial intelligence (AI). When companies rely on AI to shed light on dark data, the associated algorithms and natural language processing could make the task much more achievable than if humans worked on it without such technologies.

4. It’s Enabling Establishments to Know Even More About People

A report from Deloitte titled Dark Analytics: Illuminating Opportunities Hidden Within Unstructured Data Tech Trends 2017 discusses how some medical facilities could use dark data to take more all-encompassing approaches to patient care.

For example, during consultations, doctors may take handwritten notes and capture voice recordings, plus make notes in emails or cloud-based applications. Collecting it all and making it accessible could improve treatments and insights, reducing the instances of incorrect diagnoses or interventions that don’t work as well as more appropriate options.

People in the health care field are also hopeful that dark data could make it possible to analyze population groups. The previously unused data could potentially make predictions about future needs and illness trends that could ultimately affect individuals’ interactions with health professionals and help local health departments understand the situations their staff members will most likely encounter.

The Deloitte report spotlighted retailers that are investigating how dark data could help them understand more about what customers want, as well. After getting permission to do so, an online clothing subscription company called Stitch Fix carried out a customer survey to get details about attire preferences, but then looked at those respondents’ social media feeds and Pinterest boards to dig for more data.

Most companies already realize they have accessible content that helps them learn about customers. By broadening their approaches and looking at dark data too, they could develop a complete picture of an audience and learn things that would otherwise remain unknown. For example, dark data could provide content that strongly suggests a product concept wouldn’t fit market needs by highlighting a pattern not captured within the structured data.

5. It’s Increasing Data Security Risks If Left Unstructured

It’s crucial to realize companies may not know the worth of their dark data, but that doesn’t mean hackers aren’t targeting it. Cybercrime experts say there’s been a shift in hacking strategies, resulting in unstructured data getting pinpointed by cybercriminals more than ever before.

There are other security risks associated with unstructured data, too, such as the inability to know what it contains and which employees at an organization should access it. Both of those issues could leave companies liable if unexpected circumstances unfold.

Furthermore, data held by a business may include sensitive details companies are legally provided to submit for court subpoenas, but it’s not always easy to find that in-demand data if it’s classified as dark. In one situation, a company spent $6 million searching for dark data requested for a court case, illustrating how costly it can be not to prioritize figuring out ways to classify dark data in practical ways.

By making plans to investigate dark data instead of acting like it doesn’t exist, companies can adopt proactive, rather than reactive, strategies. Otherwise, they could miss opportunities and experience unnecessary complications.

TAGGED:big data analyticsdark data
Share This Article
Facebook Pinterest LinkedIn
Share
ByKayla Matthews
Follow:
Kayla Matthews has been writing about smart tech, big data and AI for five years. Her work has appeared on VICE, VentureBeat, The Week and Houzz. To read more posts from Kayla, please support her tech blog, Productivity Bytes.

Follow us on Facebook

Latest News

langgraph and genai
LangGraph Orchestrator Agents: Streamlining AI Workflow Automation
Artificial Intelligence Exclusive
ai fitness app
Will AI Replace Personal Trainers? A Data-Driven Look at the Future of Fitness Careers
Artificial Intelligence Big Data Exclusive
crypto marketing
How a Crypto Marketing Agency Can Use AI to Create Powerful Native Advertising Strategies
Blockchain Exclusive Marketing
data driven insights
How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
Analytics Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

3 free data sources for analytics and Business Intelligence
AnalyticsBest PracticesBig DataBusiness IntelligenceData ManagementDecision ManagementExclusiveNewsPredictive Analytics

3 Data Sources to Boost Analytics and Business Intelligence

6 Min Read
big data EU competition chief proposal
AnalyticsBig DataExclusive

Implications and Goals of EU Competition Chief’s Big Data Proposals

6 Min Read
data analytics use in marketing
Analytics

5 Ways Data Analytics Sets a New Standard for Revenue Marketing

6 Min Read
big data analytics of oil market and shell company
Big Data

Big Data in Big Oil: The Amazing Ways Shell Uses Analytics to Drive Business Success

10 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?