1. The Observing System Monitoring Center (OSMC) … steps towards climate data integration … steps towards climate data integration Steve Hankin, NOAA/PMEL

2. Sept '08 OCO Annual Review 2 Observing System Monitoring Center Background: The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system. The heart of the OSMC is a database of the times, locations, platform information, and parameter values. Background: The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system. The heart of the OSMC is a database of the times, locations, platform information, and parameter values. A partnership: PMEL Steve Hankin PI NGDC Ted Habermann PI NDBC Kevin Kern PI OCO Derrick Snowdenx

3. Sept '08 OCO Annual Review 3 3 areas of integration under OSMC 1.Climate platforms via realtime input from GTS 2.Climate archives (‘DACs’ and ‘GDACs’) 3.Climate products and data

4. Sept '08 OCO Annual Review 4 1. Integration of … platform management info. from GTS Aug. 22

5. Sept '08 OCO Annual Review 5 1. Integration of … platform management info. from GTS

6. Sept '08 OCO Annual Review 6 1. Integration of … platform management info. from GTS Colored by platform type

7. Sept '08 OCO Annual Review 7 1. Integration of … platform management info. from GTS Colored by country

8. Sept '08 OCO Annual Review 8 1. Integration of … platform management info. from GTS Colored by age of observation

9. Sept '08 OCO Annual Review 9 1. Integration of … platform management info. from GTS

10. Sept '08 OCO Annual Review 10 1. Integration of … platform management info. from GTS Observing system for SST

11. Sept '08 OCO Annual Review 11 1. Integration of … platform management info. from GTS Colored by parameter value

12. Sept '08 OCO Annual Review 12 1. Integration of … platform management info. from GTS

13. Sept '08 OCO Annual Review 13 1. Integration of … platform management info. from GTS Moorings observing SST

14. Sept '08 OCO Annual Review 14 1. Integration of … platform management info. from GTS The geospatial analysis capabilities of the OSMC data base are being developed to track progress on XBT lines. XBT casts in 1 week (Aug. 16-22)

15. Sept '08 OCO Annual Review 15 1. Integration of … platform management info. from GTS Platform information

16. Sept '08 OCO Annual Review 16 1. Integration of … platform management info. from GTS

17. Sept '08 OCO Annual Review 17 1. Integration of … platform management info. from GTS

18. Sept '08 OCO Annual Review 18 1. Integration of … platform management info. from GTS

19. Sept '08 OCO Annual Review 19 1. Integration of … platform management info. from GTS

20. Sept '08 OCO Annual Review 20 1. Integration of … platform management info. from GTS

21. Sept '08 OCO Annual Review 21 1. Integration of … platform management info. from GTS

22. Sept '08 OCO Annual Review 22 GTS data provides just a starting point – incomplete, minimal QC – incomplete, minimal QC OSMC needs to monitor our stewardship of the “ocean climate data record” Since we’re integrating anyway, lets do it in a manner that serves the broadest needs of the science community 2. Integration of … climate ‘DACs’ and ‘GDACs’

23. Sept '08 OCO Annual Review 23 Example #1: U. Hawaii Sea Level Center 2. Integration of … climate ‘DACs’ and ‘GDACs’

24. Sept '08 OCO Annual Review 24 Example: U. Hawaii Sea Level Center – today 2. Integration of … climate ‘DACs’ and ‘GDACs’ CF Metadata Climate and Forecast Conventions A subset were in a community standard format

25. Sept '08 OCO Annual Review 25 incoming data Example: U. Hawaii Sea Level Center – standards-based architecture (Jan. ‘09) 2. Integration of … climate ‘DACs’ and ‘GDACs’ Relational data base Sea level time series OPeNDAP server w/ THREDDS catalog available thru a standard web service Research Quality Pacific Ocean Lat34N, Long120W Lat36N.Long: 121W … Atlantic Ocean … Fast Delivery Pacific Ocean …... … all in standard format: netCDF+CF What do we gain through this standards-based approach?

26. Sept '08 OCO Annual Review 26 2. Integration of … climate ‘DACs’ and ‘GDACs’ Jan. ’09 milestone: 1. Through THREDDS human-readable platform info at U. Hawaii becomes machine readable … in the OSMC Jan. ’09 milestone: 1. Through THREDDS human-readable platform info at U. Hawaii becomes machine readable … in the OSMC

27. Sept '08 OCO Annual Review 27 2. Integration of … climate ‘DACs’ and ‘GDACs’ Jan. ’09 milestone: 2. “Drilling down” on a U. Hawaii Sea Level station will access the research-quality archives via OPeNDAP Jan. ’09 milestone: 2. “Drilling down” on a U. Hawaii Sea Level station will access the research-quality archives via OPeNDAP

28. Sept '08 OCO Annual Review 28 2. Integration of … climate ‘DACs’ and ‘GDACs’ Jan. ’09 milestone: 3. Scientists will get desktop access to these data in their familiar desktop science tools Jan. ’09 milestone: 3. Scientists will get desktop access to these data in their familiar desktop science tools … a Ferret session … a Matlab session

29. Sept '08 OCO Annual Review 29 2. Integration of … climate ‘DACs’ and ‘GDACs’ Jan. ’09 milestone: 4. Software solutions can be shared. OSMC-developed tools are planned for use in the U.Hawaii system. Jan. ’09 milestone: 4. Software solutions can be shared. OSMC-developed tools are planned for use in the U.Hawaii system. This example shows OSMC tools automatically connecting to a 3 rd party site that follows these standards Menus inferred from THREDDS catalog (XML) Access to observations via OPeNDAP

30. Sept '08 OCO Annual Review 30 Example #2: Underway ocean carbon obs Surface Ocean CO 2 Atlas (SOCAT) 2. Integration of … climate ‘DACs’ and ‘GDACs’ Relational data base ASCII file Summary in CSML (*) * Climate Systems Markup Language (XML) CO 2 data viewer

31. Sept '08 OCO Annual Review 31 2. Integration of … climate ‘DACs’ and ‘GDACs’ Example: Underway ocean carbon obs – Takahashi collection today … SOCAT Jan. ‘09 Improved metadata in SOCAT will allow OSMC to differentiate cruises

32. Sept '08 OCO Annual Review 32 2. Integration of … climate ‘DACs’ and ‘GDACs’ netCDF cruise plot cruise log (metadata) ASCII data “drill down” will become available Jan. ‘09

33. Sept '08 OCO Annual Review 33 Example #3: IOOS coastal observations (not “climate ‘DACs’ and ‘GDACs’” yet, but …) 2. Integration of … climate ‘DACs’ and ‘GDACs’ Relational data bases SOS and O&M (*) “Regional” observations * Open Geospatial Consortium (OGC) standards: Sensor Observation Services, Observations & Measurements model

34. SOS, O&M OSMC HABs forecasts Hurricane Intensity Coastal Innundation Integrated Ecosystem Analysis NDBC US coastal ocean obs region A region B Global ocean obs Global met obs All global real- time users Climate GTS Sea Level Underway Time series Climate “DAC’s” … IOOS - OSMC collaboration GTS Several (by datatype) NDBC custom familiar science tools COOPS SOS, O&M GTS protocols

35. Sept '08 OCO Annual Review 35 Example #3: IOOS coastal observations 2. Integration of … climate ‘DACs’ and ‘GDACs’ IOOS regional platforms (conceptual plot: feature available November)

36. Sept '08 OCO Annual Review 36 2. Integration of … climate ‘DACs’ and ‘GDACs’ Roll-out plan by platform  OSMC-DAC partnerships Roll-out plan by platform  OSMC-DAC partnerships  U. Hawaii sea level time series -- Jan. '09  U. Hawaii sea level time series -- Jan. '09  OceanSites -- use same techniques (thru GDAC at NDBC)  Carbon underway -- Takahashi collection now. SOCAT Dec. '08  SAMOS underway -- anticipate June '09  IOOS – taking shape in the coming months  other platform programs (unscheduled, details tbd) Argo -- via FNMOC/NRL GDAC (w/ NOAA funding) VOS -- at NDBC Surface drifters - at AOML SOOP XBTs -- U.S. XBTs only at AOML (International tbd) Repeat hydrography data GOSUD -- tbd on completion of SAMOS NOAA CO-OPS tide gauges (those not on GTS)

37. Sept '08 OCO Annual Review 37 3. Integration of … climate products and data IPCC AR4 model outputs: “Graphics such as this from Held and Soden (2006) are so routinely produced from the IPCC AR4 database that we’ve ceased to marvel at it. This is a composite of output from 20 models worldwide….” V. Balaji, GFDL

38. Sept '08 OCO Annual Review 38 3. Integration of … climate products and data Tony Barnston -- http://iri.columbia.edu/climate/ENSO/ “Often, the anomalies are provided directly in a graph or a table by the respective forecasting centers for the Nino 3.4 region. In some cases, however, they are given for 1-month periods, for 3-month periods that skip some of the periods in the above table, and/or only for a region (or regions) other than Nino 3.4”

39. Sept '08 OCO Annual Review 39 3. Integration of … climate products and data Publishing images and analyses of data products on Web sites is worthwhile … … but it is no longer sufficient. Nor is FTP access to files.  Making data available through Web services like OPeNDAP and SOS will significantly advance climate science It can be done at low effort. Many groups are already doing it.

40. Sept '08 OCO Annual Review 40 3. Integration of … climate products and data Surface Temperature Salinity at 105m Zonal current at 160W 3-month average meridional current in Atlantic at 24N Sea Level Surface Salinity GODAS Zonal current averaged 130E to 80W Salinity Profile Current Vectors Meridional Current SODA Sea Level Height Meridional velocity Pacific Salinity Time vs longitude OSCAR Sea Surface Height AVISO ECCO-JPL GHRSST-JPL SODA minus COADS COADS minus ECCO-JPL ECCO-JPL minus SODA ECCO-JPL minus World Ocean Atlas

41. Sept '08 OCO Annual Review 41 3. Integration of … climate products and data Many climate products are already available via OPeNDAP (though not all are kept up to date). Why not all of them ? (GRIB is supported as well as netCDF-CF) OSMC can offer tools to compare and evaluate products Reynolds bias error with ocean obs

42. Sept '08 OCO Annual Review 42 3. Integration of … climate products and data The OSMC ‘Climate Services’ tab is a work in progress. Help us succeed by telling us what would be most useful to you. IT projects are most successful when they get strong input from users. Adequacy of sampling for SST

43. Sept '08 OCO Annual Review 43 Data needs metadata (standard-format documentation) -- both to be "discoverable" and to provide essential background information NOAA’s Climate Services plan (short-term goal): a web site (“portal”) where users can locate web sites for NOAA data (This is not “data integration” as we’ve been discussing it.) The ocean-climate community needs to submit metadata to this portal. For now a single metadata record for each ocean data activity: drifter program, XBT/SOOP program, Argo program, TAO, etc. Starting point: Many programs have submitted such metadata to NASA GCMD. But much is out of date, incomplete or misleading. ACTION ITEM: To meet NOAA's short term goals, Derrick Snowden will be contacting the OCO-funded programs. He’ll try to guess the right contact person …but better if you contact him first. 3. One final topic: metadata (Thank you Derrick!)

44. Sept '08 OCO Annual Review 44 With relatively small amounts of effort we can make “quantum” improvements in access to data from climate DACs The OSMC project hopes to work in partnership with the DACs 1 by 1 to make this happen Significant data problems have not been addressed here: QC standards, metadata quality, and data discovery to name a few Those will be tackled too. Don’t let perfect be the enemy of good. Author’s message:

45. Sept '08 OCO Annual Review 45 Discussion (Thank you)

46. An Evolving Partnership with the International Community JCOMMOPSOSMC Definitive source for platform level metadata Resource for observing system partners How do I … Periodic assessments of international contributions to GOOS/GCOS Deployment opportunities Capacity building Real time display of observing system assets Data visualization tools Data integration and a foundation for distribution Evaluation of observing system through variable based metrics Provides a focal point for coordinating climate obs data and IOOS Reconciling international data standards development with national efforts. E.g. GEO-IDE, oceandatastandards.org, IOOS, OGC