Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
    pexels pavel danilyuk 8112119
    Data Analytics Is Revolutionizing Medical Credentialing
    8 Min Read
    data and seo
    Maximize SEO Success with Powerful Data Analytics Insights
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: CERN: A Case Study in “Big Science” Data Management
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Culture/Leadership > CERN: A Case Study in “Big Science” Data Management
Big DataCulture/LeadershipData ManagementPolicy and Governance

CERN: A Case Study in “Big Science” Data Management

tkorte
tkorte
6 Min Read
Image
SHARE

ImageThe European Organization for Nuclear Research (CERN) became a poster-child for organizing and processing enormous quantities of data during its search for the Higgs boson and other physics investigations, but scaling up is not the only data hurdle the organization has had to jump.

ImageThe European Organization for Nuclear Research (CERN) became a poster-child for organizing and processing enormous quantities of data during its search for the Higgs boson and other physics investigations, but scaling up is not the only data hurdle the organization has had to jump. In its efforts to maximize the long-tail value of its data, it has had to create roadmaps for preserving and releasing public data. In the same way that CERN’s scalable processing and storage innovations can be applied in industry, its data preservation and dissemination efforts can serve as examples for other “big science” projects.

Data Preservation

CERN’s data preservation imperative arises from two factors. First, data re-use is a crucial component of particle physics. A 2012 special report from the Data Preservation in High Energy Physics (DPHEP) study group notes that important research can arise from data sets over a decade after their collection (see “Other examples of long-term data re-use”). The same report notes that long-term analysis accounts for 5-10% of total scientific output of high energy physics collaborations and a survey of over a thousand high energy physicists showed that 70% regarded data preservation as “very important” or “crucial” to their work.

More Read

big data EU competition chief proposal
Implications and Goals of EU Competition Chief’s Big Data Proposals
Forrester: Companies That Don’t Integrate Social Data Fail in the Age of the Customer
How Big Data Can Help Forex Traders And Brokers Build A Better Future
Using Data to Build Energy Efficient Cities
What Do I Do With All This Data?

The second factor is that in general, particle collision data is only collected once. As accelerators grow more powerful, they tend to collect data at energy levels never before achievable, so data from older accelerators risks being lost forever if it is not adequately preserved. Scientists cannot hope to reap the benefits of running new analysis on old data if this one-of-a-kind data disappears.

In light of these two factors, CERN has been proactive about preserving data for future re-use, even as it remains plagued by non-standardized, ad-hoc formats, and highly complex data models. CERN was a co-founding organization in the Alliance for Permanent Access, a European data preservation working group. Internal efforts are underway as well, although these have not yet been implemented completely. In a 2011 presentation, the computing coordinator of the Toroidal Large Hadron Collider Apparatus (ATLAS) experiment at CERN (one of the detectors that contributed measurements to the Higgs boson finding) stated that he was confident that technological progress would enable preservation of large quantities of data in the medium term. The collider’s Compact Muon Solenoid(CMS) experiment (the other detector involved in the Higgs finding), has made progress as well, announcing that it would begin implementing a new metadata collection tool this month and mentioning an emerging initiative to guarantee “bit-level data preservation” in the future.

These efforts may benefit from government nudging, including writing data preservation rules into grants and providing funding for data management staff. The DPHEP report found that a staffing increase of 2-3 full time employees leads to a significant improvement in the ability to implement long-term data preservation systems. This might seem like a drop in the bucket for a large, multinational effort such as CERN, but individual experiment teams might be more inclined to spend general allocations on detector systems than on practices such as data preservation that benefit the greater community.

Open Data

At present, CERN only gives a select few unaffiliated scientists access to raw data from the Large Hadron Collider, but the organization has expressed commitment to open data access in the longer term. The CMS experiment leads current open data efforts, having approved a data preservation, re-use and open access policy in 2012, and issued guidance on implementing the policy earlier this month. Public data releases will take place yearly, during Large Hadron Collider machine shut-downs, and data will be released 3 years after collection, to ensure that CERN and affiliated physicists have access to the data before it goes public. In addition, where special software is required to read the data, it will be made publicly available in open-source.

The ATLAS experiment has also issued preliminary guidelines, although these are much less comprehensive, providing data access for unaffiliated physicists only insofar as they are involved with a particular research project.

To the extent that CERN’s physics data is produced from publicly-funded experiments, the organization should strive to make it available and accessible to the public. In the future, member governments could mandate open releases; by encouraging the open availability of taxpayer-funded physics data, governments can maximize the data’s re-use value and encourage more meaningful collaboration throughout the scientific community.

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

AI and data mining
What the Rise of AI Web Scrapers Means for Data Teams
Artificial Intelligence Big Data Exclusive
power supplies for ATX for data scientists
Why Data Scientists Should Care About SFX Power Supplies
Big Data Exclusive
AI for website optimization
Free Tools to Test Website Accessibility
Artificial Intelligence Exclusive
Generative AI models
Thinking Machines At Work: How Generative AI Models Are Redefining Business Intelligence
Artificial Intelligence Business Intelligence Exclusive Infographic Machine Learning

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Google’s Year in Local Search

3 Min Read
Image
AnalyticsBig DataMarketing

Uses for Analytics and Big Data in Marketing

4 Min Read
data integrity
Big Data

Going Global: 6 Fool-Proof Ways for Retailers to Use Big Data to Expand Internationally

13 Min Read
ways to use big data in business
Big Data

Data-Driven Business Applications Businesses Can’t Live Without in 2022

9 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data
ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?