Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.

Slides:



Advertisements
Similar presentations
Integrating ChemAxon technology into your End User Applications Java solutions for cheminformatics Ver. Mar., 2005.
Advertisements

WOCE Global Data V3 WOCE-DPC Report Nathan Bindoff and David M. Legler Co-Chairs, WOCE DPC WOCE Conference November 2002 All of it.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
DapperM: A Matlab Interface to Dapper — An OPeNDAP In Situ Data Service D.W. Denbo 1, J. Sirott 2, W.H. Zhu 1 1 UW/JISAO-NOAA/PMEL 2 NOAA/PMEL IIPS Session.
What’s New in ArcGIS Desktop
McIDAS-V McIDAS-V The 5 th Generation of McIDAS by Tom Whittaker Space Science and Engineering Center University of Wisconsin-Madison USA with contributions.
Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Information Technology for Ocean Observations and Climate Research TYKKI Workshop, December 9-11, 1998, Tokyo, Japan Nancy N. Soreide NOAA Pacific Marine.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.
Tutorial 1: Getting Started with Adobe Dreamweaver CS4.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
The Scientific Graphics Toolkit (A Technical Overview) Donald Denbo UW-JISAO/NOAA-PMEL
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View.
GMT: The Generic Mapping Tools Paul Wessel, Walter H.F. Smith and the GMT team.
1 AJAX and Dapper: The Good, the Bad, and the Ugly Joe Sirott PMEL/NOAA.
U.S. GLOBEC Pan-Regional Synthesis Workshop 1 Presentation to the U.S. GLOBEC Pan-Regional Workshop 29 November 2006 Bob Groman Data Access and Associated.
Exploring PMEL EPIC Profile Data With Java OceanAtlas (JOA). John R. Osborne
NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software
Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.
Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.
The Arctic Observing Network (AON) Cooperative Arctic Data and Information Service (CADIS) Florence Fetterer,
1 Dapper and Argo Joe Sirott PMEL/NOAA. 2 What is Dapper? Web server that provides distributed access to in-situ data via OPeNDAP protocol Clients include.
Using a LDAP Directory Server for Environmental Data Discovery Donald Denbo NOAA-PMEL/UW-JISAO Presented by Eugene Burger NOAA-PMEL/UW-JISAO
August 2003 At A Glance VMOC-CE is an application framework that facilitates real- time, remote cooperative work among geographically dispersed mission.
Web-based Interaction with 3D Environmental Data Sets using Virtual Reality Modeling Language Nancy Soreide, NOAA/PMEL Christopher Moore, NOAA/JISAO Cathy.
OceanBrowser viewing service, overview and upgrades Alexander Barth (1), Charles Troupin (2), Aida Alvera Azcárate (1), Jean-Marie Beckers (1) (1) University.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
1 DAPPER: An OPENDAP Server for In-Situ Data Joe Sirott Donald W. Denbo, Willa H Zhu University of Washington PMEL/NOAA.
GIS System Design for the Coastal Storms Initiative Nazila Merati OAR/PMEL & OAR Representative to NOAA Enterprise GIS Chris Moore – OAR/PMEL Tiffany C.
NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.
A Data Access Framework for ESMF Model Outputs Roland Schweitzer Steve Hankin Jonathan Callahan Kevin O’Brien Ansley Manke.
Recent developments and trends in Network Access to Oceanographic In-situ Data Nancy Soreide, NOAA/PMEL John “Oz” Osborne, NOAA/PMEL - OceanAtlas Software.
NdEdit for Interactive in-situ Data Selection John R. Osborne and Donald W. Denbo NOAA/PMEL American Meteorological Society / IIPS January 13-17, 2002,
NOAAServer: Unified access to distributed NOAA data Ernest Daddio, NOAA/ESDIM Steve Hankin, NOAA/PMEL Donald Denbo, NOAA/PMEL/JISAO Nancy Soreide, NOAA/PMEL.
A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, NOAA/PMEL Charles Sun, NOAA/NODC Bernie Kilonsky,
EPIC: Providing World Wide Web Access to Oceanographic Observations D.W. Denbo 1, N.N. Soreide 2, M.C. Spillane 1, and W.H. Zhu 1 1 Joint Institute for.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
GrADS-DODS Server An open-source tool for distributed data access and analysis Joe Wielgosz, Brian Doty, Jennifer Adams COLA/IGES - Calverton, MD
1 Final Report on WTF-CEOP JAXA Prototype system Satoko Horiyama MIURA JAXA/Earth Observation Research Center.
1 OceanShare: Interactive Access to Distributed In Situ Data in a Collaborative Tool Environment D.W. Denbo C.R. Windsor NOAA/Pacific Marine Environmental.
1 1 NOAA Office of Ocean Exploration End-to-End Data Management: A Success Story NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data.
Java OceanAtlas A Cross-Platform Application for Visualization and Selection of Oceanographic Profile Data John R. Osborne
A Climate Data Portal An FY2000 HPCC Proposal Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U of Hawaii HPCC Project Review.
Java OceanAtlas A Cross-Platform Application for Visualization and Selection of Oceanographic Profile Data John R. Osborne ftp://odf.ucsd.edu/pub/OceanAtlas/
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U.
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
SGT Beans Easy-To-Use Graphics Toolkit for Java Applications Donald W. Denbo UW/JISAO-NOAA/PMEL.
EPIC Tools for in-situ data collections Donald W. Denbo, NOAA/PMEL Willa H. Zhu, NOAA/PMEL/JISAO John Osborne, OceanAtlas Software Christopher Moore, NOAA/PMEL/JISAO.
1 Virtual Collaboratory: How Climate Research can be done Collaboratively using the Internet U.S. – China Symposium and Workshop on Climate Variability,
A Collaboration Tool to Support Modeling Groups Donald W. Denbo JISAO/UW-NOAA/PMEL 20 th IIPS/AMS, 12 – 15 January, 2004,
GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
In Situ Data Access Some reasons for success or failure Nancy N. Soreide, Donald W. Denbo NOAA Pacific Marine Environmental Laboratory IIPS Session 3B.
NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne 1, Kevin T. McHugh 2, and Donald W. Denbo.
NcBrowse: OPeNDAP Server Access and 3-D Graphics Presented by Nancy N. Soreide NOAA/PMEL Donald W. Denbo UW/JISAO-NOAA/PMEL.
Data Browsing/Mining/Metadata
Global Precipitation Data Access, Value-added Services and Scientific Exploration Tools at NASA GES DISC Zhong Liu1,4, D. Ostrenga1,2, G. Leptoukh4, S.
MERRA Data Access and Services
Ocean Data View Reiner Schlitzer
Prepared by: Jennifer Saleem Arrigo, Program Manager
Code Analysis, Repository and Modelling for e-Neuroscience
Ocean Data View Reiner Schlitzer
Code Analysis, Repository and Modelling for e-Neuroscience
Presentation transcript:

Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level Center/ADCP Center, University of Hawaii John R. Osborne, OceanAtlas Software L. Charles Sun, NOAA/NODC Willa H. Zhu, NOAA/JISAO Nancy Soreide, NOAA/PMEL AMS IIPS Feb , Long Beach, CA

Challenge  Locating and selecting individual observations from large, distributed collections of in situ data observations   Examples: Individual oceanic or atmospheric profiles, time series, buoy tracks, etc.

Some solutions  Tools and Applications   LDAP Directory Services   NdEdit for subsetting large in-situ collections   Interactive Java graphics   Intensive exploration of multiple data types   OPeNDAP (DODS) clients and servers for in-situ data   Access from Desktop and Web  Assembled from OpenSource components  

LDAP Directory Service Finding distributed data collections  Search on geographic region, observed quantities or keyword  Automatically populated from data servers  Metadata instantly known to LDAP directories  Access control for experimental data products  Open Source  Standards-based  Platform independent,  Scalable, extensible,  Supports desktop or web client

X-Y map view Y-T Y-T time range NdEdit Investigate space-time distribution Select data in any View Explore Data Locations and Subset Data Collections Interactive, linked windows View any 2D sliice xy, xt, xz, yt, yz, yt Select time range See data in range X-Y map view Y-T Y-T time range

Section Tool - select stations along a depth contour NdEdit

Selected stations are in a narrow time band NdEdit

Polygon tool – select an oblique section line See time range of stations NdEdit

NdEdit  NdEdit is an interactive Java tool  NdEdit is being re-engineered for the Web

SGT: A Scientific Graphics Toolkit  Java toolkit for scientific graphics  On-line documentation, examples, tutorials, streaming video  JavaBeans in next release  Features  Contour, line and vector plots,  Axes user settable or automatically scaled  multiple Time Axis formats  mouse-movable, customizable Labels, line keys, icons  Legend generation automatic  Widely used, freely available  scientific and commercial applications use SGT  downloads by 4508 unique sites from 66 countries 

Applications Java Desktop and Web clients

ncBrowse Java tool for data/metadata browse  NetCDF and full OPeNDAP support   Desktop Java application   Axis mapping, parametric plots, flexible mapping of independent variables to axes   Line, vector and contour plots   Animations, 3D graphics via VisAD  Popular, freely available   6471 downloads by 2896 unique sites in 57 countries   OPeNDAP (DODS) client, Unidata netCDF client, WOCE data CD, etc.   See: AMS Paper 15.2 – Thursday 4:45pm - Donald Denbo

Java OceanAtlas for browsing ocean data  Intensive Java desktop browsing of ocean data  Property-property plots with up to 7 x axes, waterfall diagrams, Contour plots/residual contour plots, Map plots with optional "bubble" isosurface plots, Linked browsing of all plot types, Built-in and custom calculations, NdEdit for data location/selection  Reads WOCE, EPIC, OPeNDAP netCDF data, some ARGO formats  Extended for wide range of data types  Profile, time series, drifting buoy, gridded analyses, model outputs  Widely used, freely available  

Climate Data Portal Distributed ocean observations  Major in situ data collections:   TAO El Nino buoy data (realtime/PMEL), Global sea level data (realtime/U of Hi), GTSPP (NODC), PMEL hydrographic data and time series collection, WOCE ADCP (U of Hi), IPRC/APDRC in situ data, US Coastal Ocean Time Series database (NODC) OPeNDAP: in-situ data server and client OPeNDAP: in-situ data server and client LDAP directory services NdEdit for data selection/subsetting Data Servers, Clients (Java and Web) – focus on in situ data

OceanShare Network collaboration tool  Collaboration features  Local, remote data file access and Java graphics  Standard collaboration tool features (annotation, whiteboard, etc)  Secure LDAP Document Repository  Proposals, papers in progress, data, images  Access control by document or by folder  Accessible from web and desktop  OPeNDAP compatible soon 

EPIC tools for the Web for building customized web access to data EPIC Web Toolkit EPIC Web Toolkit   Interface design   Backend graphics   Map data selector Example applications Example applications EPIC Web Browser (general) TAO (El Nino buoys) Unaami (Arctic time series) OSCAR (Satellite ocean currents) Multibeam data (hydrography)

Tools and Applications Java desktop and Web  Modular Web and Open Source components  Java interactivity  Low cost development/maintenance  OpenSource, standards-based  Scalable, extensible  OPeNDAP supported or planned  