1. Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, 2010-12-09 Integrated Ocean Observing System (IOOS) Data Management Activities

2. Interagency effort –Recent legislation: ICOOS Act –NOAA lead - program office –NSF, USACE, Navy collaborations most active 11 Regional Associations (RAs), 1 sensor V&V partner –US non-federal partners –Funding from NOAA 2 IOOS Program Overview

3. IOOS Data Types (available or in progress as of 2010) Buoys Shore Stations Coastal HF Radar Gliders Model Outputs Diver Surveys Satellite Ocean Color

4. IOOS Data Providers (available or in progress as of 2010) MODIS CoastWatch NOAA Natl. Satellite Data & Info. Svc. NWLONPORTS CO-OPS NOAA Ctr. for Oper. Oceanographic. Prods & Svcs Wx TAO DARTHF Radar NDBC NOAA/NWS Natl. Data Buoy Ctr. 8 5 6 11 2 4 10 3 7 9 1 12 IOOS RAs Regional Associations Water Levels USACE Army Corps - Mobile District Water Quality FIU Florida Intl. U.

5. model outputs Coastal radar satellite observations Goal: Enable Integration via Standards

6. established 2008-2010 as part of Data Integration Framework pilot OGC SOS (Sensor Observation Service)‏ satellite gridded model outputs HF radar In situ Observations + Metadata Points, Profiles, Collections, Trajectories Structured Grids (+ unstructured grids)‏ DAP (Data Access Protocol) and OGC WCS (Web Coverage Service)‏ OGC WMS (Web Map Service)‏ Map Images (of all data types)‏ *OGC = Open Geospatial Consortium Formats: PNG, GeoTIFF, JPEG,... Formats: XML, ASCII, KML, + CF/NetCDF Format: CF/NetCDF IOOS Data Request Services Metadata: SensorML

7. 7 DIF* Pilot Project & Beyond NDBC SOSDAPWMS Harmful Algal BloomsHurricane Intensity CO-OPS SOS IOOS RAs SOSDAPWMS CoastWatch DAP Public Internet Future Providers: USACE (WL), PacIOOS (Bio), Florida Intl U (WQ),... Google Oceans SOS Coastal Inundation SOS Tsunami Event DB SOS Future Customers: Espresso ROMS, CO-OPS, Ocean Acidification?, Ocean Energy? Integrated Ecosystem Assessments DAP SOS *DIF = Data Integration Framework DAP Public Internet

8. SOSDAPWMSSOSDAPWMSSOSDAPWMS Public Internet 8 IOOS Catalog Metadata Harvester Service Registry Web Interface SOSDAPWMS SOSDAPWMS Format Conversion Visualization Data Integration Additional Services Archive

9. 9 Federated, Service-Oriented Architecture IOOS Catalog Regional Catalog data access service Regional Obs Syst. or Model Harvester Service Registry Web Interface Obs Syst. or Model DAC* Obs Syst. or Model data provider Other Services RegistryHarvester Archive DAC data access service DAC data access service DAC data access service *DAC = Data Assembly Center data access service

10. IOOS Catalog – v1.0 ORRAP Ocean Observing Sub-Panel – Washington, DC – December 7, 2010 10

11. 11 Service Registry List of servers, summary metadata Register (+verify compliance)‏ Data Catalog Detailed spatial & temporal extents US geodata.gov, GEOSS CSR Service Metadata (ISO 19119) PostgreSQL/PostGIS GeoNetwork Harvest (+verify continued operation)‏ IOOS Data Servers NOAA/NOS CO-OPS SOS NOAA/NESDIS CoastWatch DAP IOOS RA SOSDAPWMS NOAA/NWS NDBC SOSDAPWMS IOOS RA SOSDAPWMS Dataset Metadata (ISO 19115) IOOS Catalog Concept of Operations

12. DMAC Data Management and Communications Data Management Modeling & Analysis Web Portal Client Libraries Analysis Tools System Monitor Models Observing Systems Moored Buoys Fixed Stations Samples Moving Platforms RadarSatellite Data Assembly Centers Physical Obs Biological Obs Archives Model Outputs Utility Services Visualization Conversion Data Integration Catalog Registry Computational Viewpoint from Reference Model for Open Distributed Processing (RM-ODP) Component Types Needed for IOOS Data Access Services Subscription Pull Individual Features Structured Grids Unstructured Grids Undersea Imagery … … … … … Service Gateway Maps & Images Workflows Notification Surveys GIS Framework Data StartingWorking ExamplesNot Started w/NSF OOI-CI Legend:

13. IOOS Catalog 13 IOOS/NSF OOI-CI Collaboration NDBC Wx NDBC HFR CO-OPS WL IOOS Data Sources Non-IOOS Sources SOSTDSSOS Espresso ROMS other models IOOS RAs SOS IOOS as data source for OOI-CI & models OOI-CI Service Translation Format Conversion Notification Feeds/ Subscriptions External Observatory Integration (EOI)

14. Lack of complete metadata – IOOS helping fund improvements General standards that are too broad – IOOS is coordinating, implementing, documenting Needs of local RA stakeholders vs. greater good – IOOS published Guidance paper for FFO Getting all data archived – IOOS helping with Wx, HFR, RA, glider Long-term support for observing assets – ? Challenges