SCD User Briefing The Community Data Portal and the Earth System Grid Don Middleton with presentation material developed by Luca Cinquini, Mary Haley, Fred Clare - and many project collaborators NCAR Scientific Computing Division Section Head, Visualization & Enabling Technologies January 11, 2005 Don Middleton with presentation material developed by Luca Cinquini, Mary Haley, Fred Clare - and many project collaborators NCAR Scientific Computing Division Section Head, Visualization & Enabling Technologies January 11, th AMS Annual Meeting January 9-14, 2005

Data Organized by… Org Chart (?)

The NCAR Community Data Portal (CDP)

CDP Goals  Build the cyberinfrastructure for the integration and support of a broad range of geo-informatic projects within NCAR, thus reducing startup cost and development time  Develop unified gateway to the large, diverse UCAR/NCAR/UOP data holdings, providing a wide range of data services on these holdings: publishing, browsing, search and discovery, download, remote access, analysis, visualization  Build the cyberinfrastructure for the integration and support of a broad range of geo-informatic projects within NCAR, thus reducing startup cost and development time  Develop unified gateway to the large, diverse UCAR/NCAR/UOP data holdings, providing a wide range of data services on these holdings: publishing, browsing, search and discovery, download, remote access, analysis, visualization

The Community Data Portal - A Brief Tour

Browse Click

Mozart Metadata

Mozart Data

Search for NCEP ETA Type

Search for NCEP ETA results

Search for tree ring Type

Search for tree ring results

Advanced Search 1

Advanced Search 2

Forest Fire Visualization Click

CDP Home with WACCM Click

WACCM Data

WACCM Source Code

CDP Collaborations and Acknowledgements  SCD/DSG: thanks for supporting the hardware!  SCD/DSS: metadata and data services  SCD/MSS: online access to MSS  ESG (including CGD, HAO): shared development, hosting environment, technologies  Unidata: joint development of NcML, collaborated on THREDDS search and discovery metadata  DLESE, BADC, GCMD: export or exchange (via OAI) of metadata documents for cross-institutional searches  COLA: provide remote data services through GRADS  Many data providers across UCAR/NCAR/UOP and others: ACD, ATD, CGD (CAS, PCM, CCSM), JOSS, SCD (DSS, VETS), Unidata, WACCM and CU/ENLIL  GridBGC: shared development  GIS: NetCDF to GIS conversion services  BADC: cross-center data discovery  ESP: sharing information and technologies  NOMADS: undergoing exploratory collaboration  SCD/DSG: thanks for supporting the hardware!  SCD/DSS: metadata and data services  SCD/MSS: online access to MSS  ESG (including CGD, HAO): shared development, hosting environment, technologies  Unidata: joint development of NcML, collaborated on THREDDS search and discovery metadata  DLESE, BADC, GCMD: export or exchange (via OAI) of metadata documents for cross-institutional searches  COLA: provide remote data services through GRADS  Many data providers across UCAR/NCAR/UOP and others: ACD, ATD, CGD (CAS, PCM, CCSM), JOSS, SCD (DSS, VETS), Unidata, WACCM and CU/ENLIL  GridBGC: shared development  GIS: NetCDF to GIS conversion services  BADC: cross-center data discovery  ESP: sharing information and technologies  NOMADS: undergoing exploratory collaboration

Climate Data Click

The Earth System Grid

The ESG Collaboration ORNL: Climate storage & computational resources ORNL: Climate storage & computational resources LANL: Next generation coupled models & computing LANL: Next generation coupled models & computing USC/ISI: Computational grids, & grid-based applications USC/ISI: Computational grids, & grid-based applications NCAR: Climate change predication and scenarios NCAR: Climate change predication and scenarios LBNL: Climate storage facility LBNL: Climate storage facility LLNL: Model diagnostics & inter-comparison LLNL: Model diagnostics & inter-comparison ANL: Computational grids, & grid-based applications ANL: Computational grids, & grid-based applications

ESG Home

PCM Metadata

PCM Files and MSS

ESG CCSM

CCSM Datasets

Subsetting List

Subsetting Interface

IPCC Data Click

Data Available via ESG Portal (November 2004)  Community Climate System Model  28.4 Terabytes, including 21 simulations, 141 datasets, and 289,374 files  Parallel Climate Model  Terabytes, including 98 simulations, 434 datasets, and 44,000 files  Total  48.8 Terabytes, 119 simulations, 575 datasets, in over 333,872 files  167 registrations, 132 approved, 154.2GB downloaded to date  Plus new IPCC Data  150 user registrations, 1.1TB of data downloaded, in 16,000 files  Community Climate System Model  28.4 Terabytes, including 21 simulations, 141 datasets, and 289,374 files  Parallel Climate Model  Terabytes, including 98 simulations, 434 datasets, and 44,000 files  Total  48.8 Terabytes, 119 simulations, 575 datasets, in over 333,872 files  167 registrations, 132 approved, 154.2GB downloaded to date  Plus new IPCC Data  150 user registrations, 1.1TB of data downloaded, in 16,000 files

‘ing Our Data

Data->Knowledge Mass Storage System (2.0PB) Petascale Knowledge Environment Establish new paradigms for managing and accessing scientific data based on semantic organization.

END