Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage.

Similar presentations


Presentation on theme: "Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage."— Presentation transcript:

1 Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage networks –SCD Research Data Archives 20 Terabytes

2 Characteristics Development began in middle 1960’s, (35 years) Managed by seven people 211K primary data files 530 datasets – all sizes

3 Search and Discover Data How?  Web based Information Server Features –5K+ html pages (metadata) –All datasets are described –Location of all data files in MSS –Access options are identified –Higher level information Catalogs Project specific descriptions Always current dataset descriptions

4 Dataset Page Title and Brief description Systematic Navigation Metadata highlights Period of Record Usage Variables Related Sites (NOAA) Contact Person Related Datasets

5 Archive Content Weather Center Operational Analyses –NCEP beginning in 1976 Many products – global, regional, different resolutions, full atmosphere stack, all surface grids –ECMWF beginning in 1980 Ditto Atmospheric Reanalyses –NCEP/NCAR 1948 – 2001 –NCEP Version II, 1979 – 2000 –ECMWF ERA15, 1979 – 1993 –ECMWF ERA40, 1958 – 2002 –NCEP N.America Reanalysis

6 Outstanding Features Three different coordinate surfaces Very long analysis, 2+ Terabytes size Unrestricted distribution CD-ROMS are very popular

7 Archive Content Observational dataset –Comprehensive Ocean-Atmosphere Data Set (COADS), beginning in 1794 –Global land surface observations, beginning in 1930’s, some earlier –Global upper air measurements, beginning in 1946 Many more supporting datasets and analyses

8

9

10 Real time access to data Community Data Portal –Multi-tiered systems Gui, middleware, file service (local or remote) Access + subsets + analysis –Much more from Don –Some SCD Research Datasets will be served through CDP


Download ppt "Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage."

Similar presentations


Ads by Google