Presentation is loading. Please wait.

Presentation is loading. Please wait.

Research Data Archives at NCAR

Published by Modified over 5 years ago

Similar presentations

Presentation on theme: "Research Data Archives at NCAR"— Presentation transcript:

1 Research Data Archives at NCAR
RDA, a continually evolving data resource Content is improved and extended Metadata is developed to improve discovery Access methods are many and expanding Now; Web, FTP, NCAR MSS, writable media Future; via CDP and network servers (e.g. GDS, OPeNDAP, etc) 5 February 2019 Steven Worley, NSF/NCAR/SCD

2 Steven Worley, NSF/NCAR/SCD
RDA definition Collection of reference datasets used in atmospheric and related sciences Over 600 datasets currently archived 10-20 new datasets added annually The RDA is maintained by 9 staff First established about 40 years All data on the MSS 548K files 100.5 TB 5 February 2019 Steven Worley, NSF/NCAR/SCD

3 Steven Worley, NSF/NCAR/SCD
RDA Content Many categories of data Observations Model Output NWP Reanalyses Climatology Data Long-term SST analyses Monthly summary of the day station data Satellite derived datasets Global topography and ocean depth Station Libraries Much more …. 5 February 2019 Steven Worley, NSF/NCAR/SCD

4 Steven Worley, NSF/NCAR/SCD
RDA Observations Observations Conventional meteorology and oceanography Surface Global ocean from ships and buoys (ICOADS) Global meteorology stations Gridded ocean and station obs Profiles Global ocean hydrography Global upper air measurements 5 February 2019 Steven Worley, NSF/NCAR/SCD

5 Steven Worley, NSF/NCAR/SCD
RDA Model Output Model Output Operational Model Output NCEP Global NCEP Regional North American ECMWF Global Reanalysis Projects NCEP Global Reanalysis I & II ECMWF Global ERA-40 5 February 2019 Steven Worley, NSF/NCAR/SCD

6 Steven Worley, NSF/NCAR/SCD
Eta and NARR domains 5 February 2019 Steven Worley, NSF/NCAR/SCD

7 Steven Worley, NSF/NCAR/SCD
Arctic Specific data Univ Wash. PSC ARGOS Buoy Observations, Polar Science Center Hydrographic Climatology (PHC) U. Wisconsin Greenland Surface Observations, AARI Russian North Polar Drifting Station Data, 1937- Arctic and Antarctic Sea Ice Concentration, Walsh Arctic Sea Ice Thickness Climatology Western Arctic Ice Drift Stations, + ships Maud and Fram Hadley Centre Global Sea Ice and Sea Surface Temperature Analyses USSR. Arctic Ice Island Radiosonde Observations, NMC Nimbus-5 Sea Ice (ESMR) Data for February 1975 Climatic Boundary Conditions for 18,000 years before present Ptarmigan Dropsondes (Arctic reconnaissance) for Norwegian Marine Surface Data, 5 February 2019 Steven Worley, NSF/NCAR/SCD

8 Steven Worley, NSF/NCAR/SCD
RDA Metadata All datasets Described with individual web pages Assigned data consultant Catalogued in UCAR Community Data Portal (CDP) 5 February 2019 Steven Worley, NSF/NCAR/SCD

9 Steven Worley, NSF/NCAR/SCD
5 February 2019 Steven Worley, NSF/NCAR/SCD

10 MSS All RDA data RDA Server CDP NCAR User Internet User
Data User’s Functional Diagram for RDA Access MSS All RDA data RDA Server Some data All Metadata CDP Standardized Metadata NCAR User Internet User 5 February 2019 Steven Worley, NSF/NCAR/SCD

11 MSS All RDA data RDA Server CDP NCAR User Internet User
Data User’s Functional Diagram for RDA Access MSS All RDA data RDA Server Some data All Metadata CDP Standardized Metadata NCAR User Internet User metadata 5 February 2019 Steven Worley, NSF/NCAR/SCD

12 MSS All RDA data RDA Server CDP NCAR User Internet User
Data User’s Functional Diagram for RDA Access MSS All RDA data RDA Server Some data All Metadata CDP Standardized Metadata NCAR User Internet User metadata data 5 February 2019 Steven Worley, NSF/NCAR/SCD

13 MSS All RDA data RDA Server CDP NCAR User Internet User
Data User’s Functional Diagram for RDA Access MSS All RDA data RDA Server Some data All Metadata CDP Standardized Metadata NCAR User Internet User metadata data future data 5 February 2019 Steven Worley, NSF/NCAR/SCD

14 RDA MSS Server All RDA data CDP Operational Function Diagram for RDA
RDA Database RDA Server Some data All Metadata MSS All RDA data SAN CDP Standardized Metadata Data Ingest 5 February 2019 Steven Worley, NSF/NCAR/SCD

15 RDA MSS Server All RDA data CDP Operational Function Diagram for RDA
RDA Database Integrity Monitor RDA Server Some data All Metadata MSS All RDA data SAN Top Collections CDP Standardized Metadata Data Ingest Network Media 5 February 2019 Metadata Steven Worley, NSF/NCAR/SCD

16 RDA MSS Server All RDA data CDP Operational Function Diagram for RDA
RDA Database Integrity Monitor RDA Server Some data All Metadata MSS All RDA data SAN Top Collections CDP Standardized Metadata Data Ingest Network Media 5 February 2019 Metadata Data Steven Worley, NSF/NCAR/SCD

17 RDA MSS Server All RDA data CDP Operational Function Diagram for RDA
RDA Database Integrity Monitor RDA Server Some data Metadata MSS All RDA data SAN Top Collections CDP Metadata Data Data Ingest Network Media 5 February 2019 Metadata Data Steven Worley, NSF/NCAR/SCD Future Data

18 Steven Worley, NSF/NCAR/SCD
Key Case – ERA-40 35 TB collection, 30 distinct product lines Added about 10 products (computed in SCD) Support Climate Modeling – T85 Guassian grids to match NCAR CCSM Metrics for 2004 Web & FTP = MSS in Data Amount Over 20 TB delivered 28K versus 13K files, RDA Server - MSS 5 February 2019 Steven Worley, NSF/NCAR/SCD

19 Questions / Discussion
5 February 2019 Steven Worley, NSF/NCAR/SCD

Download ppt "Research Data Archives at NCAR"

Similar presentations

Use of VOS data in Climate Products Elizabeth Kent and Scott Woodruff National Oceanography Centre, Southampton NOAA Earth System Research Laboratory.

Use of VOS data in Climate Products Elizabeth Kent and Scott Woodruff National Oceanography Centre, Southampton NOAA Earth System Research Laboratory.
Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage.

Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage.
SCD Research Data For UCAR Data Management Working Group January 10, 2001 Steven Worley Scientific Computing Division Data Support Section.

SCD Research Data For UCAR Data Management Working Group January 10, 2001 Steven Worley Scientific Computing Division Data Support Section.
ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.

ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.

The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.

TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Scientific Investigations; Support from Research Data Archives for Computing in Atmospheric Sciences 2001 29 October, 2001 Steven Worley National Center.

Scientific Investigations; Support from Research Data Archives for Computing in Atmospheric Sciences October, 2001 Steven Worley National Center.
U.S. Surface Archives Sent to China (1997-2000) 7 th PRC-U.S. Joint Coordination Panel for Data and Information Cooperation 29 Nov. – 1 Dec, 2000 Steven.

U.S. Surface Archives Sent to China ( ) 7 th PRC-U.S. Joint Coordination Panel for Data and Information Cooperation 29 Nov. – 1 Dec, 2000 Steven.
Dr Mark Cresswell Model Assimilation 69EG6517 – Impacts & Models of Climate Change.

Dr Mark Cresswell Model Assimilation 69EG6517 – Impacts & Models of Climate Change.
October 16-18, 20011 Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.

October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
Details for Today: DATE:18 th November 2004 BY:Mark Cresswell FOLLOWED BY:Literature exercise Model Assimilation 69EG3137 – Impacts & Models of Climate.

Details for Today: DATE:18 th November 2004 BY:Mark Cresswell FOLLOWED BY:Literature exercise Model Assimilation 69EG3137 – Impacts & Models of Climate.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.

Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
Growing and Future Datasets in the SCD Research Data Archives for NSF SCD Review Panel 16 October 2001 Steven Worley Scientific Computing Division Data.

Growing and Future Datasets in the SCD Research Data Archives for NSF SCD Review Panel 16 October 2001 Steven Worley Scientific Computing Division Data.
Data for Climate and Energy Studies Steven Worley Computational and Information Systems Laboratory NCAR.

Data for Climate and Energy Studies Steven Worley Computational and Information Systems Laboratory NCAR.
Collaborative Research: Toward reanalysis of the Arctic Climate System—sea ice and ocean reconstruction with data assimilation Synthesis of Arctic System.

Collaborative Research: Toward reanalysis of the Arctic Climate System—sea ice and ocean reconstruction with data assimilation Synthesis of Arctic System.
Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.

Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.
NCAR Computation and Information Systems Laboratory Facilities and Support Overview UCAR Postdoctoral and Graduate Fellows March 16, 2007 Mike Page Consulting.

NCAR Computation and Information Systems Laboratory Facilities and Support Overview UCAR Postdoctoral and Graduate Fellows March 16, 2007 Mike Page Consulting.
A Comparison of the Northern American Regional Reanalysis (NARR) to an Ensemble of Analyses Including CFSR Wesley Ebisuzaki 1, Fedor Mesinger 2, Li Zhang.

A Comparison of the Northern American Regional Reanalysis (NARR) to an Ensemble of Analyses Including CFSR Wesley Ebisuzaki 1, Fedor Mesinger 2, Li Zhang.
Data to Support Ocean-Atmosphere Research NCAR Research Data Archive (RDA), Zaihua Ji, NCAR Steven Worley, NCAR Scott Woodruff,

Data to Support Ocean-Atmosphere Research NCAR Research Data Archive (RDA), Zaihua Ji, NCAR Steven Worley, NCAR Scott Woodruff,
Archive and Access Practices that Support Data Reuse and Transparency Steven Worley Doug Schuster Bob Dattore National Center for Atmospheric Research.

Archive and Access Practices that Support Data Reuse and Transparency Steven Worley Doug Schuster Bob Dattore National Center for Atmospheric Research.

Similar presentations

Ads by Google