Presentation on theme: "October 16-18, 20011 Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section."— Presentation transcript:
October 16-18, 20011 Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section
October 16-18, 20012 Research Data sets 35 year old collection & stewardship Ocean, Atmosphere, operational analysis and re-analysis - all secured on MSS 530 distinct data sets, 17 TB, 211K files Information Interface - WEB/professional consultation (match data with research requirements) User guides to different categories of data Staff specialist for each dataset Web search tools
October 16-18, 20013 Data Management Stewardship of data is done by a meteorological & oceanographic staff Each dataset is maintained in a standardized system Metadata, identification of files, software, etc are secure under a change control system Each dataset has a web page that is automatically generated, and is always current.
October 16-18, 20014 Data Access Remote users Data discovery is through a web interface Data packages provided upon request Staged to disk for network transfer, e.g. FTP A variety of magnetic tapes and CD-ROMS NCAR facility users Directly accessible to all computing platforms File location, metadata, documentation, software, and some data are available online through a web interface All users Receive consulting from staff specialist as needed
October 16-18, 20015 TBytes of Data Provided 5.6 TB in 1995 to about 20.5 TB in 2001
October 16-18, 20016Holdings Global Observations dating from 1942 ( and a few earlier) ECMWF Global Operational Analysis from 1985. NCEP Operational Analysis from 1976. Reanalysis NCEP/NCAR, ECMWF, NCEP Reanalysis II.
October 16-18, 20017 Outstanding Features Three different coordinate surfaces Very long analysis (1948 – 2001) CD-ROMS are very popular
October 16-18, 20018 Countries Receiving Reanalysis CD-ROMs Highlights Over 8900 CDROMs 1997-09/2001 Percent received; U.S. 46%, Japan 11%, (Canada, UK) @ 4%, etc
October 16-18, 20019 UCAR Research Collaboration Support real-time data services Unidata’s (UCAR) role –Runs full capacity IDD/LDM application –Serves ± 20 universities downstream SCD’s role –24 hr x 7 day operation monitoring –Routine system back up –Data archive backup and maintenance Covers one year – done daily 2.3 GB per day to the MSS Observations, NCEP model data, wind profilers