Sign up | Login with →

Policy and Governance

exclusive

The Data Lake Debate: Conclusion (With Apologies to the Rolling Stones)

April 30, 2015 by Jill Dyché

The Data Lake Debate.

In an homage to the Rolling Stones, I blithely suggested that if you try sometimes, you get what you need—be it more funding, access to third-party data, a more effective executive sponsor, or a Hadoop distribution provider. It’s not an easy decision, but I’d call the data lake debate a draw. After all, when it comes to the verdict on whether or not a data lake is a worthwhile investment, the success stories will start to emerge. In the meantime, I’m happy to watch those stories unfold. Time, after all, is on my side. Yes it is.[read more]

exclusive

The Data Lake Debate: The Final Word from Negative

April 22, 2015 by Anne Buff
1

The Data Lake Debate.

Well, it seems you took the gloves off this time, Tamara. I appreciate the valiant effort and your passionate belief in the Hadoop ecosystem. However, given your revisit to the definition of the data lake and clarifications about Hadoop, I find it important to repeat the resolution we are debating: “a data lake is essential for any organization to take full advantage of its data”. We are not debating whether a data ecosystem is essential – just the data lake.[read more]

exclusive

The Data Lake Debate: Pro Delivers First Rebuttal

April 10, 2015 by Tamara Dull

Data Lake Debate.

In my opening argument, I defined the data lake as a storage repository that holds a vast amount of raw data in its native format, including structured, semi-structured, and unstructured data. I also mentioned that a data lake can take on different shapes and sizes, and provided these examples: A single data lake; or a data lake with multiple data ponds—similar in concept to a data warehouse/data mart model; or multiple, decentralized data lakes; or a virtual data lake to reduce data movement.[read more]

A Lot of Private-Sector Data Is Also Used for Public Good

April 3, 2015 by Joshua New

Private data.

These beneficial uses of private-sector data are not just one-off, isolated occurrences — just this past month two major tech companies have offered to put valuable and even potentially life-saving data to good use for the public. Facebook will now start matching users’ location data to Amber Alerts to rapidly spread awareness about missing children, and Uber will be donating its anonymized transportation data to city governments to help reduce congestion and enable better city planning.[read more]

exclusive

The Data Lake Debate: Negative Puts a Stake in the Ground

April 1, 2015 by Anne Buff
4

The Data Lake Debate.

While the idea of a data lake sounds like fun, don’t go jumping in just yet. There are critical factors to consider before taking the plunge and saying that A data lake is essential for any organization to take full advantage of its data. Not only is a data lake not essential for any organization, a data lake may in fact be detrimental for those who do so prematurely.[read more]

exclusive

The Data Lake Debate: Questioning the Pro

March 27, 2015 by Anne Buff

The Data Lake Debate.

Technology is not the answer for every big data issue (well any data for that matter). I get it - Hadoop and the concept of data lakes are hot topics. However, just because they are trending in the world of technology does not mean that they will solve critical business issues such as taking full advantage of an organization’s data. I stand firm that data storage, data lake or any other type, is not the essential element for an organization to take full advantage of its data.[read more]

exclusive

Hygienic Hadoop Data Lakes Not Just Happenstance

February 23, 2015 by Paul Barsch

Risky Business column.

If you work with Hadoop on a daily basis you already know that data cannot simply be dumped into Hadoop’s file system and be of high value to rank and file business users. To be sure, data management is crucial if you’re planning on Hadoop serving as a true lake or “hub” for all your organization’s data.[read more]

exclusive

Big Data and the Internet of Things: Two Sides of the Same Coin?

December 11, 2014 by Tamara Dull
3

The Big Data MOPS Series.

What is the relationship between big data and the Internet of Things? There is clearly a relationship between big data and IoT. The Mauritius conference helps confirm that. In fact, I would propose that big data is a subset of the IoT discussion.[read more]

Data Innovation in Africa

December 6, 2014 by Travis Korte

Africa.

While many commentators have focused on data-driven innovation in the United States and Western Europe, developing regions, such as Africa, also offer important opportunities to use data to improve economic conditions and quality of life. Three major areas where data can help are improving health care, protecting the environment, and reducing crime and corruption.[read more]

Healthcare Insurance Regs Must Keep Up with Tech Advances

November 26, 2014 by Joshua New

health tech / shutterstock

The promise of Apple's HealthKit: as adoption of wearables increases and health insurers rely more heavily on biometric data, consumers and industry alike will benefit from better healthcare outcomes and lower costs. However, this healthcare advance won’t happen unless insurance regulations keep up with the technology.[read more]

Three Challenges Europe Faces in Becoming a Competitive Big Data Market

November 21, 2014 by Mark van Rijmenam

Europe / shutterstock

The European Commission is working hard on developing a competitive European Big Data market. Last week, as a result of this, the European Digital Forum convened the High-Level Roundtable on Europe’s Digital Future. Here's my vision of how Europe can enable forward-looking, data-driven startups to unleash the vast potential of data.[read more]

Why Algorithmic Accountability Is Needed Now

November 21, 2014 by Rishi Shah

Algorithmic black boxes / shutterstock

Facebook and Google operate in black boxes, shrouded by advanced algorithms that encourage us to gradually consume more information and generate higher ad revenues. But they should not be allowed to hide behind the language of technology, using algorithms as an excuse for lack of transparency.[read more]

China's "Great Firewall" Targets Cloud Services

November 19, 2014 by Natalie Lehrer

A plethora of websites including a popular content distribution network is currently inaccessible inside of China. GreatFire.org reports that EdgeCast's Content Delivery Network has been blocked from China for the past day. EdgeCast officially recognized the Chinese ban by releasing a statement on its website.[read more]

Will Obama Be the Last Open Data President?

November 17, 2014 by Joshua New

President Barack Obama

Barack Obama has taken a series of executive actions to further the ideal of open government through data, and there is still much to be done. It remains to be seen if the progress made over the past few years will continue in future administrations, or if President Obama will be the last open data president.[read more]

Police Body Cams to Use Government Cloud to Store Data

November 15, 2014 by Natalie Lehrer

Police body cams

Vievu, an innovator of police body cams, has announced that they have plans to begin selling cloud connected body cams that is fully compliant with government cloud regulations. The cloud body cams allow police officers to avoid the hassle of dealing with traditional storage means.[read more]