By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data science anayst
    Growing Demand for Data Science & Data Analyst Roles
    6 Min Read
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Open Data: What’s It Hiding?
Share
Notification Show More
Latest News
ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Culture/Leadership > Open Data: What’s It Hiding?
AnalyticsCulture/LeadershipExclusivePolicy and GovernancePrivacyStatistics

Open Data: What’s It Hiding?

metabrown
Last updated: 2012/09/04 at 3:04 AM
metabrown
8 Min Read
SHARE

Let’s get this straight – I’m all for open data. Yet the fanfare about open data is taking up so much of our attention in the analytics community that many are unaware of looming threats to public data resources.

Let’s get this straight – I’m all for open data. Yet the fanfare about open data is taking up so much of our attention in the analytics community that many are unaware of looming threats to public data resources.

If you follow tech industry news, chances are you’ve heard some talk about open data, which refers to governments opening up access to information about government activity. Open data is public data, but not all public data is in that category. Public data also includes information that government agencies actively collect about people and businesses. Data collected in the census, for example, is public data.

Open data isn’t about exposing anything which was formerly secret; this information has long been available through the Freedom of Information Act and other means. What’s new is the way the information is exposed, using application programming interfaces (API) which facilitate the development of software applications which use the information. If you are a Joe Average, this means nothing to you directly. But to Jane Geekgal, a programmer and aspiring technology giant, open data is the raw material of new applications. If Jane creates a really useful application, Joe Average may benefit, either because he can use the application, or because Jane’s business will grow and bolster the general economy.

More Read

ai in automotive industry

AI Is Changing the Automotive Industry Forever

SMEs Use AI-Driven Financial Software for Greater Efficiency
6 Reasons to Boost Data Security Plan in the Age of Big Data
Growing Demand for Data Science & Data Analyst Roles
Key Strategies to Develop AI Software Cost-Effectively

Public data has been available to all since the early days of the nation. We’re all aware of the census conducted every ten years, yet this is only one of many public data resources. The Census Bureau conducts research that provides a wide variety of information on businesses as well as people, including import and export statistics, tax collections, construction and many other activities. The Bureau of Labor Statistics provides information on compensation and employment, prices and productivity. These are the agencies best known as sources of public data, yet many others develop and distribute data which enriches our understanding of the people and businesses in our country. For example, the National Center for Education Statistics conducts a variety of surveys specifically focused on education.

Open data can be a terrific thing, but the hype surrounding it is diverting attention away from the threat to public data resources.

Today, the Census Bureau collects a lot of other information besides just how many people live in a dwelling. Through its American Community Survey, the United States Census Bureau collects information about the ages of the people, their race, income and many other factors that enable us to understand the nature of our people, information which is vital for businesses as well as government decision-making. It uses statistical methods to account for flaws in the data collection process and provide accurate information. Here’s what the Census Bureau has to say about the American Community Survey and how it is used:

What is the American Community Survey?

The American Community Survey (ACS) is an ongoing survey that provides data every year — giving communities the current information they need to plan investments and services. Information from the survey generates data that help determine how more than $400 billion in federal and state funds are distributed each year.

To help communities, state governments, and federal programs, we ask about:

 

    age

    sex

    race

    family and relationships

    income and benefits

    health insurance

    education

    veteran status

    disabilities

    where you work and how you get there

    where you live and how much you pay for some essentials

All this detail is combined into statistics that are used to help decide everything from school lunch programs to new hospitals.

So the American Community Survey provides governments with information needed to make informed decisions about serving the American public. The same data is also widely used by businesses and nonprofit organizations, for purposes such as selecting appropriate locations for stores and charitable service centers. Indeed the American Community Survey is vitally important to businesses, a fact reflected in this article by Michael Phillips in Bloomberg Businessweek: Killing the American Community Survey Blinds Business. Yet there’s an active political movement against it.

Sounds like a crazy conspiracy theory, you say? Have a look at this quote from one political organization: “We oppose the Census Bureau’s obtaining data beyond the number of people residing in a dwelling, and we oppose statistical sampling adjustments.” This position goes directly against the American Community Survey, and arguably against many other public data programs.

Who’s opposed to the census American Community Survey and why? Where did that quote come from? Here’s a hint. The same document also states, “We urge that the Voter Rights Act of 1965 codified and updated in 1973 be repealed and not reauthorized.” Still not sure? Here’s one more: ” Since education is not an enumerated power of the federal government, we believe the Department of Education (DOE) should be abolished.”

OK, I’ll tell you. These quotes do not come from any fringe organization. In fact, they are the words of a large and popular political organization whose views impact us all, the Republican Party of Texas. All of those quotes came directly from the Texas Republican platform.

What happens in Texas does not stay in Texas; its political influence is felt across our country. Indeed, just a few months ago, the US House of Representatives supported a bill to axe the American Community Survey. People who depend on data must sit up and take notice now.

You need to know about the importance of public data to your work and your life. Toward that end, we’ll be posting a series of articles about public data and its significance. We’ve planned these articles in the spirit of the upcoming conference “The Future of the Federal Statistical System in an Era of Open Government Data.” to be held on September 12 and 13 by the Association of Public Data Users. If you’d like to do more than read, please join us there.

Be on the lookout for these topics in the days to come:

September 6: Why Business Needs Public Data by Joan Naymark

September 11: Ending the American Community Survey: Privacy is Not the Issue by Virginia Carlson

September 13: Protecting Public Data by Meta Brown

metabrown September 4, 2012
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai in automotive industry
AI Is Changing the Automotive Industry Forever
Artificial Intelligence
SMEs Use AI-Driven Financial Software for Greater Efficiency
Artificial Intelligence
data security in big data age
6 Reasons to Boost Data Security Plan in the Age of Big Data
Big Data
data science anayst
Growing Demand for Data Science & Data Analyst Roles
Data Science

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

ai in automotive industry
Artificial Intelligence

AI Is Changing the Automotive Industry Forever

5 Min Read
Artificial Intelligence

SMEs Use AI-Driven Financial Software for Greater Efficiency

10 Min Read
data security in big data age
Big Data

6 Reasons to Boost Data Security Plan in the Age of Big Data

7 Min Read
data science anayst
Data Science

Growing Demand for Data Science & Data Analyst Roles

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai is improving the safety of cars
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?