1

2 NOAA’s Data Centers (National Oceanographic Data Center, National Climatic Data Center, and National Geophysical Data Center) are the stewards of the nation’s environmental data –collectively they preserve and provide access to scientific quality ocean, climate, and geophysical data and information for current and future generations. Preservation of data is critical, as data are irreplaceable! Data Center holdings: –provide a history of the ocean, atmosphere, and our geophysical environment, –are used to determine the state (and changing state) of the climate, –are used to evaluate earth system models, –are used in operations and planning for every sector of society, and –are used to understand how both natural and human-made systems work and affect each other NOAA’s Data Centers are equipped for handling the 20 th century data but will be challenged to handle 21 st century data (complex, high volume satellite data, high resolution ship and buoy data, autonomous vehicles, model output). NOAA’s Data Centers are working to integrate data in a seamless manner for easy access to a variety of users NOAA Data Centers Who are we?

3 NODC CORE FUNCTIONS Archive Access Stewardship

4 End-to-End Data Management (NRC, 2007) Archiving: preserve information for access and use by a Designated Community –Ingest –Archival Storage –Data Management –Preservation Planning Access: supports Consumers in determining the existence, description, location and availability of information stored in the OAIS and allows Consumers to request and receive Dissemination Information Packages (DIPs) –Discovery –Integration with other data to create products –Dissemination to users Stewardship: spans access and archiving and includes all “activities that preserve and improve the information content, accessibility, and usability of data and metadata” –Long term access and preservation –Preserving data access and archive integrity during media migration and software evolution –Providing effective data support services and tools for users –Enhancing metadata by adding information established throughout the data life cycle.

5 NODC CORE FUNCTIONS Archive

6 Traditional “Archive” activities just one part of the picture… Monitoring and understanding user communities Monitoring and understanding technology changes Encouraging adoption of standards Submission Agreements Working with providers to create “archive ready” datasets Environmental Data should be Archived What do we mean? In other words, an Archive is a whole lot more than a set of computers

7 Objectives: Identify and acquire coastal and ocean data and information; Automate the ingest of data received on a regular basis; Leverage national and international data management efforts by using standard protocols; Leverage the data management efforts of federal agencies and educational institutes that fund ocean projects; Implement archive activities following the principles of the OAIS. A comprehensive ocean archive recognized by users and providers Successful data management is determined by its usefulness to current and future users

8 NODC CORE FUNCTIONS Access

9 An effective data archive should provide for discovery, access, and integration NODC data used for a multitude of purposes Objectives: Provide data discovery protocols for coastal and ocean data; Develop tools that support NOAA’s requirements for data integration; Engage with the data providers to ensure appropriate metadata are submitted; Train and educate data producers and consumers in metadata production.

10 NODC CORE FUNCTIONS Stewardship

11 Archive and Access require expert stewardship NODC products recognized as authoritative ocean data records Objectives Work with the ocean science community to develop products based on user requirements; Develop ocean climatologies of key ocean variables with increasingly higher spatial and temporal resolution; Develop coastal climatologies for key climate, ecosystems, commerce, transportation, and weather applications; Leverage expertise in the ocean and coastal communities, particularly the academic community, to build quality products.

12 Generation of Authoritative Long Term Records –Putting all data sources together, to understand today’s environment in the context of the past Data Quality Monitoring for Long Term Applications –Critically examining data quality from a unique, integrated, and long-term perspective Long Term Preservation of Data and Information –Ensuring information survives and remains understandable for the present and the future Data Archaeology and Rescue –Finding, saving, ingesting, and restoring data from all over the world Data and Information Access –Providing information to users and ensuring the feedback loop contributes to its continual improvement Increasing Level of Stewardship Scientific Ocean Data Stewardship

13 Global Ocean Observations In Situ and Satellite World Ocean Database –Data from global sources with consistent QC, unified format, integrated access –Includes Ocean ECVs: Temperature, Salinity, Nutrients, Carbon, Ocean tracers, Chlorophyll (phytoplankton) Global Temperature and Salinity Profile Program –Near-real time quality assurance for profile data Global Argo Data Repository –To provide high quality Argo data to a wide variety of users in a timely and useful manner Joint Archive for Sea Level –Collecting and providing research-quality sea level data Jason-2/OSTM –Ensure the quality of the data and its connection with data from the other altimeter missions, including Geosat Geosat Tape Recovery –Unique collection of Geosat Exact Repeat Mission (ERM) data - Geodetic Mission (GM) –Ocean ECVs: Sea State and Sea Level plus Wind Speed over oceans –Linking with latest altimeter, Jason-2/OSTM, for which NODC is the official archive

14 NODC Products recognized as Authoritative Records NODC Scientific Data Stewardship Value-added Products Ocean Heat Content – how oceans are warming or cooling in a changing planet Ocean Variability Studies – how are the ocean’s physical and biogeochemical characteristics changing; High Resolution Sea Surface Temperature - study of climate variability, operational weather and ocean forecasting, military operations, validation and forcing of ocean and atmospheric models, ecosystem assessment, tourism and, fisheries research, amongst many others NOAA’s Coral Reef Information System (CoRIS): Users can search for Coral metadata records in a Google map application NCDDC Regional Ecosystem Data Management Portal Putting all our data sources together, to understand today’s environment in the context of the past

15 Climate Information Example: Ocean Storage of Heat Warming ocean water expands, leading to Sea Level Rise Measuring Ocean Temperature with buoys, ships, Argo profiling floats, and satellites Deploying an Argo Float Ocean Climate Reference Station How Argo Floats work One month of Subsurface Temperature observations from the Global Ocean Observing System. NOAA provides 48% of the platforms in this international system. World Ocean Heat Content Over the past 50 years, 80% of Earth’s warming has occurred in the Ocean. NODC: Preserving the ocean’s history from buoys, ships, Argo profiling floats and satellites Global Sea Level Index

16 Using GHRSST data demonstrated a 12-67% decrease in forecast errors for Hurricane Genevieve (Gentemann et al. (2003). GHRSST SST Analysis The US Naval Oceanographic Office achieved both track and intensity forecast improvements using GHRSST SST in Katrina simulations. Transformation of Observations to User Applications and Societal Benefits Operational NCEP SSTReynolds OI SST Difference

Integrating Data Access to Address an Ecological Disaster Joint Analysis Group All Source Observing Systems Data Centers & Centers of Data Protecting Living Marine Resources Archive & Stewardship NOAA Observing Systems Collection & Process Verified Data Streams Calibration Validation QA/QC Data Assembly Center (e.g. NODC) Data Assembly Center (e.g. NODC) Research Community Interagency Management Assimilation, Integration & Visualization OR&R ICC Decision Support Tools NIC

18 NODC Goal: NOAA staff using the Central and Regional libraries as sources for information and research support Objectives Meet the expanding needs for information services; Maintain, preserve and protect library collections; Build a NOAA-wide institutional repository to provide access to, and archive NOAA’s electronic publications; Expand desktop access to journals, databases, e-books, and other online services across NOAA.

19 Communications and Outreach Priorities for what to archive driven by user requirements Raise awareness about ocean data stewardship Maximize public outreach through widespread collaboration with the ocean community

20 International Data Exchange –World Data Center for Oceanography, Silver Spring –Bilateral Oceanographic Data Exchange Agreements Republic of China, Republic of Korea, and France –International Ocean Atlas and Information Series International Partnership –Intergovernmental Oceanographic Commission (IOC) International Oceanographic Data and Information Exchange (IODE); World Ocean Database Project (WOD); Global Oceanographic Data Archaeology and Rescue Project (GODAR); Marine Data and Information Management Train and host staff from foreign Oceanographic Data Centers (17 visitors from 5 countries) International Council for the Exploration of the Sea (ICES) Other Programs and Projects –Global Temperature Salinity Profile Program (GTSPP); Argo; –Global Ocean Data Assimilation Experiment (GODAE) –Global Ocean Surface Underway Data Pilot Project (GOSUD) –Joint Archive for Sea Level (JASL); Coral Reef Information System (CoRIS); SeaDataNet; North Pacific Marine Science Organization (PICES) Bilateral agreement with Republic of Korea - June 2008 New! International Ocean Atlas and Information Series, Vol. 11 Success will rely on national and international partnerships Effective interagency and international partnerships are essential

21 Provide information technology services NODC Archive Doubles Between FY07 and FY08 and continues to increase exponentially: The size of the NODC archive doubled from 31TB in FY07 to 60 TB in FY08 to 85.7 TB in September This increase is due to expanding the archive to include satellite and model data. In contrast, back in 1968, the size of the archive was 1GB. NODC Increased the Complexity of its Archive In situ data Satellite data Video data Model data Ecosystem data

22 NODC Staff (as of June 2010) About 2/3 of the NODC staff are scientists or librarian/information specialists. About 1/3 of the NODC staff are administrative and IT infrastructure support

23 NODC and FY11 NOAA is facing new priorities and challenges How does NODC support these priorities? –For example, NODC’s role in Climate Services, Marine Spatial Planning Focus on easy access to NODC’s products and services Focus on strengthening our partnerships across NOAA and the ocean community –Build our constituency –Meeting the needs of our customers and partners Vision: shared stewardship of the data –Science/data experts work with the science/archive experts to ensure the highest quality of data is documented and preserved for use of current and future generations and for a wide variety of applications

24 Potential Areas of Collaboration with CICS Expand capabilities to provide scientific data stewardship –Base funding for engaging ocean experts in providing NODC guidance on stewarding ocean variables (acquisition, quality control, products, metadata) NODC working on proposals – opportunities for students, post-doctorates and visiting scientists –Ocean Heat Content –XBT Bias correction –Sea Surface Salinity –Others (biological, chemical, currents)