1. The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl – Univ. of Colorado-Boulder/NOAA-CIRES Doug Schuster & Steven Worley - NCAR, Boulder, CO 7th ACRE Workshop, Toronto, 25-27 Aug 2014

2. Topics ● RDA overview ● ISPD and 20CR overview ● RDA services o Data discovery & access o Custom services o Data citation

3. Research Data Archive (RDA) at NCAR rda.ucar.edu ●600+ distinct datasets for climate and weather research ●Free and open access ●10,000+ unique users in FY2013 ●Collections: ocean & atmosphere observations, analyses, reanalyses, operational NWP outputs ●Each collection managed by a RDA data specialist

4. RDA data collections ● Historical observations (ISPD, ICOADS, NCDC ISD, Upper Air Database) ● Reanalyses (20CR, ECMWF ERA, JRA-25, JRA-55, NCEP CSFR, BPRC ASR, … ) ● Operational (NCEP observations, analyses, & forecasts) ● Climate/regional models (CMIP5, NRCM, … ) ● Remote sensing ● Ancillary datasets--topography/bathymetry, vegetation, land use

5. ISPD (version 2) ● World’s largest collection of surface & sea level pressure observations o Land station o Marine observations (ICOADS) o Tropical cyclone best track (IBTrACS) ● Period: 1768 – 2012 ● Volume: 562 GB ● 60+ contributors ● doi: 10.5065/D6SQ8XDW ● Data access: rda.ucar.edu/datasets/ds132.0

6. Twentieth Century Reanalysis (20CR) ● Global reanalysis ● Observational inputs o Surface pressure (ISPD) o Sea surface temperature o Sea ice distribution ● Period: 1871 - near present (currently through 2012) ● Volume: 13.6 TB ● Ensemble mean & spread analysis: 2 x 2 deg grid ● Ensemble mean & spread forecast fields: T62 Gaussian grid ● doi: 10.5065/D6QR4V37 ● Data access: rda.ucar.edu/datasets/ds131.1

7. Data discovery ● Detailed metadata collection o Dataset-, group-, and file-level metadata o Drive interfaces for file grouping and sub-setting tools o Support efficient back-end processing o Improve scalability o Provide “quick look” at data samples

9. ISPD Metadata: Dataset level Comprehensive view of dataset-level metadata ●Observing platform ●Data types ●Data frequency ●Temporal & geographical coverage

10. ISPD Metadata discovery: File level ● Hourly files grouped into yearly tarballs ● Looking glass icon loads discovery tool

12. ISPD Metadata discovery: File level ● Interactive map ● Browse and inspect observations

13. 20CR Metadata discovery ●Gridded data ●Metadata classified by parameter

14. ISPD data access page

15. Data access features ● Direct file download ● Customized subsetting ● Data format conversion o ISPD: HDF5 → ASCII, NetCDF o 20CR: GRIB → NetCDF ● THREDDS services (OPeNDAP, WMS, WCS, etc.) -- currently 20CR only ● RDA API web service (Python) ● Supporting software

16. 20CR data subsetting Temporal Selection Parameter selection Format conversion Spatial selection

17. ISPD data subsetting Temporal selection Spatial Selection (Lat/Lon region or Station ID) Observation type Output format (ASCII or NetCDF)

18. 2014 online data downloads ● Direct file downloads o ISPD: 869 GB o 20CR: 3.23 TB ● Subset requests o ISPD: 3.14 TB accessed -> 694 GB served o 20CR: 2.65 TB accessed -> 1.27 TB served

19. Dataset citation service ● Citation design – ESIP Guidelines Compo, G. P., et al. 2010. International Surface Pressure Databank (ISPDv2). Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory. http://dx.doi.org/10.5065/D6SQ8XDW. Accessed dd mmm yyyy. http://dx.doi.org/10.5065/D6SQ8XDW ● Citation styles o ESIP o AMS o AGU o DataCite

20. Upcoming ISPD ● ISPD version 3 (1755-2010) ● Geoscience Data Journal article (in review) ● THREDDS services? General ● Globus data transfer service (GridFTP protocol) -- https://www.globus.org/ https://www.globus.org/ 20CR Version 2c (1850-2013) Version 3 (~1 deg resolution)

22. ISPD rda.ucar.edu/datasets/ds132.0 20CR rda.ucar.edu/datasets/ds131.1