By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data-driven white label SEO
    Does Data Mining Really Help with White Label SEO?
    7 Min Read
    marketing analytics for hardware vendors
    IT Hardware Startups Turn to Data Analytics for Market Research
    9 Min Read
    big data and digital signage
    The Power of Big Data and Analytics in Digital Signage
    5 Min Read
    data analytics investing
    Data Analytics Boosts ROI of Investment Trusts
    9 Min Read
    football data collection and analytics
    Unleashing Victory: How Data Collection Is Revolutionizing Football Performance Analysis!
    4 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Using ‘Faked’ Data is Key to Allaying Big Data Privacy Concerns
Share
Notification Show More
Aa
SmartData CollectiveSmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Using ‘Faked’ Data is Key to Allaying Big Data Privacy Concerns
AnalyticsBig Data

Using ‘Faked’ Data is Key to Allaying Big Data Privacy Concerns

Steve Jones
Last updated: 2017/05/20 at 8:48 PM
Steve Jones
5 Min Read
Big Data Privacy Concerns
SHARE

MIT is out of the blocks first once again with a technological development designed to fix some of the privacy issues associated with big data.

Contents
How it works The solution we’ve been looking for?

In a world where data analytics and machine learning are at the forefront of technological advancement, big data is becoming a necessary lynchpin of that process. However, most organisations do not have the internal expertise to deal with algorithm development and thus have to outsource their data analytics. This raises many concerns regarding the dissemination of sensitive information to outsiders

The researchers at MIT have come up with a novel solution to these privacy issues. Their machine learning system can create “synthetic data” modelled on the data set which contains no real data and can be distributed safely to outsiders for development and education purposes.

The synthetic data is a structural and statistical analogue of the original data set but does not contain any real information regarding the organisation. However, it performs similarly in data analytical and stress testing and thus renders it the ideal substrate for developing algorithms and design testing in the data science milieu.

More Read

data security

NIST 800-171 Safeguards Help Non-Federal Networks Handling CUI

What Your Phone Number’s Metadata Means for Data Privacy
8 Crucial Tips to Help SMEs Guard Against Data Breaches
Tips to Protect Office 365 Systems from Data Breaches
Cloud Advances Make Record Keeping Compliance Easier Than Ever

How it works

The MIT researchers, led by Kalyan Veeramachaneni, proposed a concept they call the Synthetic Data Vault (SDV). This describes a machine learning system that creates artificial data from an original data set. The goal is to be able to use the data to test algorithms and analytical models without any association to the organisation involved. He succinctly states that, “In a way, we are using machine learning to enable machine learning,”

The SDV achieves this using a machine learning algorithm called “recursive conditional parameter aggregation” which exploits the hierarchical organisation of the data and captures the correlations between multiple fields to produce a multivariate model of the data. The system learns the model and subsequently produces an entire database of synthetic data.

To test the SDV, synthetic data generation for five different public datasets was performed using anti debugging techniques. Thirty-nine freelance data scientists were hired to develop predictive models on the data to ascertain if a significant difference between the synthesized data and the real data exists. The result was a conclusive no. Eleven out of the 15 tests displayed no significant difference in the predictive modelling solutions of the real and synthetic data.

The beauty of the SDV is that it can replicate the “noise” within the dataset, as well as any missing data, so that the synthetic data set model is statistically the same. Furthermore, the artificial data can be easily scaled as required, making it versatile.

The solution we’ve been looking for?

The inferences drawn from the analysis are that real data can be successfully replaced by synthetic data in software testing without the security ramifications and that the SDV is a viable solution for synthetic data generation.

Recognised as the next big thing by Tableau’s 2017 whitepaper, big data is front and centre in the hi-tech game. Accordingly, the need to be able to work safely and securely with the data is becoming increasingly important. MIT seems to have sidestepped these privacy issues quite neatly with the SDV, ensuring that data scientists can design and test approaches without invading the privacy of real people.

This prototype has the potential to become a valuable educational tool, with no concern about student exposure to sensitive information. With this generative modelling method, the stage is set to teach the next generation of data scientists in an effective way, by facilitating learning by doing.

MIT’s model seems to have everything going for it, especially considering the success of the paradigm testing and in theory it makes perfect sense. Researchers claim that it will speed up the rate of innovation by negating the “privacy bottleneck”. In practice, that remains to be seen.

TAGGED: data privacy, data protection
Steve Jones May 20, 2017 May 13, 2017
Share This Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

RN coders for hosptial data
RN Coders Can Improve Hospital Data Strategies
Big Data
cloud technology in education
How Cloud Technology Can Be Integrating in Schools
IT
big data and IP laws
Big Data & AI In Collision Course With IP Laws – A Complete Guide
Big Data
ai in marketing
4 Ways AI Can Enhance Your Marketing Strategies
Marketing

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data security
Data Management

NIST 800-171 Safeguards Help Non-Federal Networks Handling CUI

5 Min Read
data privacy phone metadata
News

What Your Phone Number’s Metadata Means for Data Privacy

7 Min Read
data protection for SMEs
Data Management

8 Crucial Tips to Help SMEs Guard Against Data Breaches

10 Min Read
office 365 data protection
Risk Management

Tips to Protect Office 365 Systems from Data Breaches

9 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive
ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?