Ed Kearns National Climatic Data Center Asheville, NC.

Slides:

Advertisements

Similar presentations

NOAAs Comprehensive Large-data Array Stewardship System (CLASS) Robert Rank NOAA CLASS Program Chris Elvidge – NOAA-NGDC January 22, 2006.

Advertisements

Performance Assessment

An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.

DSpace: the MIT Libraries Institutional Repository MacKenzie Smith, MIT EDUCAUSE 2003, November 5 th Copyright MacKenzie Smith, This work is the.

Providing access to your data: Determining your audience Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.

The Changing Research Data Paradigm One agency’s response Changes to Implementation of NSF’s Data Sharing Policy NOAA’s second annual Environmental Data.

Visibility Information Exchange Web System. Source Data Import Source Data Validation Database Rules Program Logic Storage RetrievalPresentation AnalysisInterpretation.

Symposium on Digital Curation in the Era of Big Data: Career Opportunities and Educational Requirements Workforce Demand and Career Opportunities From.

Lifecycle perspectives A “big picture” of research data today Monday, August 9,

Preservation Strategies: What do long-term archives do with my data? Jeff Arnfield NOAA’s National Climatic Data Center Version 1.0 Review Date.

In just a few short years, the I&M networks have become known as a key source and supplier of reliable, organized, and retrievable information about parks.

PV2013 Summary Results Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.

Coming revolutions in mass storage: implications for image archives Christopher D. Elvidge, Ph.D. NOAA-NESDIS National Geophysical Data Center E/GC2 325.

Understanding Data Warehousing

Update: NPOESS and CDRs Florence Fetterer, Program Manager, NOAA at NSIDC PoDAG XXIII February 2005.

The Case for Data Stewardship: Preserving the Scientific Record Matthew Mayernik National Center for Atmospheric Research Version 2.0 [Review Date]

1 Robert S. Webb and Roger S. Pulwarty NOAA Climate Service.

Developing Climate Data Records (CDRs) from NPOESS Data Jeffrey L. Privette, John Bates, Tom Karl, Ed Kearns National Climatic Data Center (NCDC) NOAA.

Recordkeeping for Good Governance Toolkit Digital Recordkeeping Guidance Funafuti, Tuvalu – June 2013.

1 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview.

Elements of a Data Management Plan Bill Michener University Libraries University of New Mexico Data Management Practices for.

Preserving the Scientific Record: Preserving a Record of Environmental Change Matthew Mayernik National Center for Atmospheric Research Version 1.0 [Review.

The Data Center of the 21 st Century John Bates NOAA National Climatic Data Center.

Chapter 4 Realtime Widely Distributed Instrumention System.

Libraries, Archives, and Digital Preservation: The Reality of What We Must Do Leslie Johnston Acting Director, National Digital Information Infrastructure.

Elements of a Data Management Plan: Roles and Responsibilities Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date.

1 Designing Storage Architecture for Digital Collections 2012.

Preservation Strategies: Framing The Approach Nancy Hoebelheinrich Knowledge Motifs LLC Data Management Workshop American Geophysical.

GOES Users’ Conference III May 10-13, 2004 Broomfield, CO Prepared by Integrated Work Strategies, LLC GOES USERS’ CONFERENCE III: Discussion Highlights.

1 NOAA Use of the Open Archival Information System Reference Model (OAIS-RM) Ken McDonald NOAA NESDIS ESIP Federation Meeting July 9, 2009.

November 10, 2006AppliedVis 2006 AppliedVis 2006: Projecting a Brighter Future for Western North Carolina Communicating Climate Change Frank Niepold, NOAA.

 Dramatic technological revolution  Increasingly diverse, globalized and complex media- saturated society.  Greater impact on society than from oral.

Teaching to the Standard in Science Education By: Jennifer Grzelak & Bonnie Middleton.

High Data Volume Transfer Issues at NOAA Christopher D. Elvidge Earth Observation Group National Oceanic and Atmospheric Administration National Geophysical.

NIST Data Science SymposiumMarch 4, 2014 NIST Data Science SymposiumMarch 4, Climate Archives in NOAA: Challenges and Opportunities March 4, 2014.

CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)

AL-MAAREFA COLLEGE FOR SCIENCE AND TECHNOLOGY INFO 232: DATABASE SYSTEMS CHAPTER 1 DATABASE SYSTEMS Instructor Ms. Arwa Binsaleh.

1 NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION NCEI-IOOS Project Updates Mathew Biddle May 28th, 2015 IOOS DMAC Meeting, IOOS.

National Monitoring Network Report Methods and Data Comparability Chapter 5 Outline National Monitoring Council Meeting April 12-14, 2005.

DRAFT EDMC Procedural Directives NOAA Environmental Data Management Committee 12/3/2015 1

Implementation into Child Nutrition Programs

WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.

Data Integrity Issues: How to Proceed? Engineering Node Elizabeth Rye August 3, 2006

NOAA Data Citation Procedural Directive 8 November 2012 DAARWG.

Science Data in the Science Mission Directorate (SMD) Jeffrey J.E. Hayes Program Executive for MO & DA, Heliophysics Division August 17, 2011.

Challenges of Coping with Funding and Data Management in a Changing World Rick Lyons Director Infectious Disease Research Center.

Meteorological Observatory Lindenberg – Richard Assmann Observatory (2010) GCOS Reference Upper Air Network Holger Vömel Meteorological Observatory Lindenberg.

A Proposed Short Course on Data Stewardship Scott Hausman Deputy Director NOAA’s National Climatic Data Center Preparing Scientists to Steward Their Data.

M-1 INGEST OVERVIEW Don Sawyer National Space Science Data Center NASA/GSFC October 13, 1999.

ARL Workshop on New Collaborative Relationships: The Role of Academic Libraries in the Digital Data Universe September 26-27, 2006 ARL Prue.

Foundations of Information Systems in Business. System ® System  A system is an interrelated set of business procedures used within one business unit.

Institutional Repositories: the DSpace Experience Ann J. Wolpert Director of Libraries Massachusetts Institute of Technology.

DISCUSSION DRAFT ONLY Data Management METRICS for NNDC and CLASS David Hermreck.

Providing access to your data: Determining your audience Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.

Interagency Forum on Earth Data Preservation/LifeCycle /Stewardship January 8, 2009 Rob Raskin NASA/Jet Propulsion Lab.

October 2, 2002National Climatic Data Center GOES USERS CONFERENCE October 2,

Managing the National Communications Process UNFCCC Workshop on Exchange of Experiences and Good Practices among NAI Countries in Preparing NCs September.

Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.

Leveraging the Expertise of our Staff and the Information Resources We Manage MIT Libraries Visiting Committee April 13, 2005.

1. 2 NOAA’s Mission To describe and predict changes in the Earth’s environment. To conserve and manage the Nation’s coastal and marine resources to ensure.

EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Public access.

SIMULATION AND MODELING WORKING GROUP REPORT PDS MANAGEMENT MEETING – 2016 FEB 4-5.

OAIS (archive) OAIS (archive) Producer Management Consumer.

R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.

Technical Workshop for Climate Services Portal Development: Setting the Stage National Climatic Data Center Asheville, NC August 13-15, 2008.

NASA Earth Science Data Stewardship

Criteria for Assessing Repository Trustworthiness: An Assessment

World Conference on Climate Change October 24-26, 2016 Valencia, Spain

African Space Policy & Strategy

Metadata The metadata contains

Presentation transcript:

Ed Kearns National Climatic Data Center Asheville, NC

Archive and Access Archives preserve data, make them accessible in meaningful ways, and ensure their information remains available for future generations. What changes in technology and observing systems are anticipated? What kinds of data and information should be archived in the future? What can the Data Centers do to prepare?

Archive Responsibilities Accept information from Data Producers Exercise sufficient control to ensure long-term preservation and access (stewardship) Ensures the information to be preserved is independently understandable and accessible now and in the future Follow policies and procedures that ensure the information is preserved against all reasonable contingencies

IT Issues Physical Storage: Paper, Tapes, Spinning Disk Future: solid state? All ultimately fragile Security though redundancy Multiple copies, distributed systems Access : high speed internet, physical media delivery Distributed systems, multiple access points Data formats: facilitate access, self describing, metadata stds Access tools that serve data to a variety of audiences The data can be expected to be well-cared for….but what about the information?

What to archive? NOAA Observing Systems Council _document_final_ pdf _document_final_ pdf Volume of Observations : NCDC stores 3.5 PB today NPOESS, next-gen NEXRAD : several PB per year increase Model outputs : archive them if not easily reproducible But for how long? Shelf life of synthetic data? Derived products : process raw records to higher levels Example Climate Data Records (CDR) Climate Information Records (CIR)

CDR and CIR Climate Data Records (CDRs) are the essential long term records for climate studies and assessments CDRs require updates as our knowledge of the observing systems and science improves Archived data must be revisited, reprocessed Climate Information Records (CIRs) are derived from and directly dependent upon CDRs Higher level CIRs will be found more useful by a larger number of user communities Water managers, energy industry, ecosystem managers CIRs place more emphasis on access and delivery

Current challenges Fully track associations between the archived information and its users and applications Provides an aggregate value of the info for our society Establish a 2-way relationship between info and users Provides a context for the information for future users Deliver more information to broader communities Less reliance on hierarchal systems and more on networked systems – ideally a blend of the two Faster transitions from research to operations

Thoughts and questions Throughout history, significant information breakthroughs have brought about social and/or technological revolutions Scientific literacy? The survival of archives across generations has been a political issue, not a technical or physical issue. Archives must serve society to stay relevant – so what does society want from our archives?