A Climate Data Portal An FY2000 HPCC Proposal Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U of Hawaii HPCC Project Review.

Slides:

Advertisements

Similar presentations

The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,

Advertisements

ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.

1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France

I.1 Distributed Systems Prof. Dr. Alexander Schill Dresden Technical University Computer Networks Dept.

Global Argo Data Repository Status Report for 2009 Charles Sun US National Oceanographic Data Center 10 th Argo Data Management Team Meeting 30 September.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

NCAR GIS Program : Bridging Gaps

DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):

Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Information Technology for Ocean Observations and Climate Research TYKKI Workshop, December 9-11, 1998, Tokyo, Japan Nancy N. Soreide NOAA Pacific Marine.

TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.

Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.

Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.

Presented by The Earth System Grid: Turning Climate Datasets into Community Resources David E. Bernholdt, ORNL on behalf of the Earth System Grid team.

The Scientific Graphics Toolkit (A Technical Overview) Donald Denbo UW-JISAO/NOAA-PMEL

1 AJAX and Dapper: The Good, the Bad, and the Ugly Joe Sirott PMEL/NOAA.

Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.

Establishing a User-Driven, World- Class Oceanographic Data Center by the Right People, in the Right Place, and at the Right Time L. Charles Sun National.

NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software

Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.

Data Access to Marine Surface Observations and Products from COADS 29 January, 2002 Steven Worley National Center for Atmospheric Research.

1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.

Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.

The Arctic Observing Network (AON) Cooperative Arctic Data and Information Service (CADIS) Florence Fetterer,

1 Dapper and Argo Joe Sirott PMEL/NOAA. 2 What is Dapper? Web server that provides distributed access to in-situ data via OPeNDAP protocol Clients include.

NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Pacific Region Integrated Data Enterprise (PRIDE) A Hawaii-Pacific View Ken Waters National Weather Service, Pacific Region Headquarters Honolulu.

Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)

Tools for collaboration How to share your duck tales…

Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)

Policy Based Data Management Data-Intensive Computing Distributed Collections Grid-Enabled Storage iRODS Reagan W. Moore 1.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

1 DAPPER: An OPENDAP Server for In-Situ Data Joe Sirott Donald W. Denbo, Willa H Zhu University of Washington PMEL/NOAA.

Web Portal Design Workshop, Boulder (CO), Jan 2003 Luca Cinquini (NCAR, ESG) The ESG and NCAR Web Portals Luca Cinquini NCAR, ESG Outline: 1.ESG Data Services.

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

IndOOS—a sustained ocean observing system in the Indian Ocean for climate research Howard Cattle for Gary Meyers Co-Chair CLIVAR/GOOS Indian Ocean Panel.

UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.

NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.

Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012.

Center for Computational Visualization University of Texas, Austin Visualization and Graphics Research Group University of California, Davis Molecular.

Recent developments and trends in Network Access to Oceanographic In-situ Data Nancy Soreide, NOAA/PMEL John “Oz” Osborne, NOAA/PMEL - OceanAtlas Software.

NdEdit for Interactive in-situ Data Selection John R. Osborne and Donald W. Denbo NOAA/PMEL American Meteorological Society / IIPS January 13-17, 2002,

NOAAServer: Unified access to distributed NOAA data Ernest Daddio, NOAA/ESDIM Steve Hankin, NOAA/PMEL Donald Denbo, NOAA/PMEL/JISAO Nancy Soreide, NOAA/PMEL.

Information Technology: GrADS INTEGRATED USER INTERFACE Maps, Charts, Animations Expressions, Functions of Original Variables General slices of { 4D Grids.

A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, NOAA/PMEL Charles Sun, NOAA/NODC Bernie Kilonsky,

Arctic Applications achievable through Information Technology “… combining the interests of the scientific community … with those of the computer science.

Observing System Monitoring Center (OSMC) Work in progress in brief June 2005 Steve Hankin, Kevin O’Brien – PMEL.

Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.

1 OceanShare: Interactive Access to Distributed In Situ Data in a Collaborative Tool Environment D.W. Denbo C.R. Windsor NOAA/Pacific Marine Environmental.

Java Web Server Presented by- Sapna Bansode-03 Nutan Mote-15 Poonam Mote-16.

March 23, 1999GOIN 99, Honolulu, HI1 Network Collaborative Tool for Integrated Browsing D.W. Denbo 1 C.R. Windsor 2 NOAA/Pacific Marine Environmental Laboratory.

Long Term Archival of ECS Data Held at the National Snow and Ice Data Center.

Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.

A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U.

The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

SGT Beans Easy-To-Use Graphics Toolkit for Java Applications Donald W. Denbo UW/JISAO-NOAA/PMEL.

EPIC Tools for in-situ data collections Donald W. Denbo, NOAA/PMEL Willa H. Zhu, NOAA/PMEL/JISAO John Osborne, OceanAtlas Software Christopher Moore, NOAA/PMEL/JISAO.

1 Virtual Collaboratory: How Climate Research can be done Collaboratively using the Internet U.S. – China Symposium and Workshop on Climate Variability,

A Collaboration Tool to Support Modeling Groups Donald W. Denbo JISAO/UW-NOAA/PMEL 20 th IIPS/AMS, 12 – 15 January, 2004,

The NOAA Operational Model Archive and Distribution System NOMADS CEOS-Grid Application Status Report Glenn K. Rutledge NOAA NCDC CEOS WGISS-19 Cordoba,

NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO

In Situ Data Access Some reasons for success or failure Nancy N. Soreide, Donald W. Denbo NOAA Pacific Marine Environmental Laboratory IIPS Session 3B.

NOS DataExplorer Enterprise GIS Efforts within NOAA's Ocean Service Jason Marshall (PSGS) NOAA Coastal Services Center.

NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne 1, Kevin T. McHugh 2, and Donald W. Denbo.

NcBrowse: OPeNDAP Server Access and 3-D Graphics Presented by Nancy N. Soreide NOAA/PMEL Donald W. Denbo UW/JISAO-NOAA/PMEL.

Data Browsing/Mining/Metadata

Flanders Marine Institute (VLIZ)

Comeaux and Worley, NSF/NCAR/SCD

Presentation transcript:

A Climate Data Portal An FY2000 HPCC Proposal Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U of Hawaii HPCC Project Review Meeting, Norman, Oklahoma, May 2000

Objective: Unified, networked access to geographically distributed data from Observing Systems and Historical Data Archives (focus on in situ data) Method: Integrate several new, modern and proven network-based applications and technology developments CORBA/Java RMI Data Server - NOAAServer (ESDIM), OceanShare (HPCC) Interactive, Java Scientific Graphics Toolkit - NOAAServer (ESDIM), OceanShare (HPCC) Interactive Java tools selecting data from large in situ data collections - 4dEdit Java utility (ESDIM) Automated metadata generation tool – NODC/PMEL Project (ESDIM) Collaborative tool environment – OceanShare (HPCC) 3D visualization - VRML, ImmersaDesk (HPCC) Dual access: Web and desktop Java application A Climate Data Portal Overview

Web Browser Java Application User NetworkNetwork CORBA/DOT* Client Support Java Servlet Graphics One or more Web Servers UHi Sea Level Data CORBA/DOT* Data TAO data support CORBA/DOT* Data Observing System Servers Satellite data support CORBA/DOT* Data Satellite Data Servers NODC Archive Data CORBA/DOT* Gridded data support CORBA/DOT* Data Gridded Data Servers Common Object Request Broker Architecture (CORBA) is an industry standard Distributed Object Technology (DOT) Middleware. CORBA is used in the NOAAServer software from which this effort will leverage. Based on performance indicators, Java Remote Method Invocation (RMI), an alternative middleware, could easily be substituted for CORBA. CORBA/DOT* Network Data Servers Climate Data Portal Data Obs. data support CORBA/DOT* Data Additional Data Servers

First Year Deliverables: A Climate Data Portal focused on NOAA El Nino Observing System data TAO El Nino buoys - PMEL TAO El Nino buoys Sea Level Data Center - University of Hawaii Sea Level Data Center Historical Archives - NODC Historical Archives I.e., WOCE UOT (upper ocean thermal) data for this year and NODC TSDB (time series database) next year Progress and collaborations to data ncBrowse: operational all-Java tool for interactive desktop graphical browsing of netCDF data files ncBrowse Close coordination with WOCE Data Product Committee, Java OceanAtlas (Scripps), Data Centers, etc. OceanAtlasScripps Numerous national and international institutions have expressed interest in collaborating (next slide) A Climate Data Portal Progress

Potential Data Portal Partners NODC PMEL JOSS CDC UHSLC IPRC ODU KOREA (KORDI) CHINA (NMDIS) TAIWAN (NCOR) AUSTRALIA (CSIRO) CO-OPS UA AOML FSU NCSU NCDC CSC IRELAND (IMI) Based on CORBA/Java RMI distributed object technology NOAA National Coastal Data Development Center

ncBrowsencBrowse: A netCDF graphical browser An operational utility that contributes directly to the Climate Data Portal Platform independent, interactive Java graphics Coordination: Unidata (netCDF authors), EPIC, NCEP, WOCE, and COADS users ncBrowse reads a large number of different netCDF conventions. Relevance: Developed by Don Denbo Synthesis of NOAAServer, HPCC/OeanShare, EPIC and NSF support Contributes directly to the Climate Data Portal

ncBrowse is a highly successful operational utility Released March 29, 2000 Downloaded by 244 unique machines in 22 countries In the first 1.5 months since its release Inside US: 43 government, 41 US university, and 49 commercial sites Outside US: Over 100 sites in 21 countries (i.e., Germany, France, Australia, Italy, and England and 16 others) Sample user response: “… nice tool...” – Charlie Zender (UC-Irvine) “… this is a great idea!” – Lyn Greenhill (DynaTech Engineering) “Kewl tool!” – Rich Signell (WHOI/USGS) “Thanks for making ncBrowse available!” – Joe Van Andel (NCAR) ncBrowsencBrowse: A netCDF graphical browser An operational utility that contributes directly to the Climate Data Portal

ncBrowse is the first major accomplishment of FY2000 HPCC Climate Data Portal team ncBrowse Excellent collaborations established WOCE Data Product Team and DAACs Scripps Java OceanAtlas NOAA data centers and collaborators Observing System project offices Consistent with NOAA IT Architecture plans A Climate Data Portal FY2000 Accomplishments to date