Future Development Plans

Slides:



Advertisements
Similar presentations
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Advertisements

OPeNDAP’s Server4 Building a High Performance Data Server for the DAP Using Existing Software Building a High Performance Data Server for the DAP Using.
A Common Data Model In the Middle Tier Enabling Data Access in Workflows … HDF/HDF-EOS Workshop XIV September 29, 2010 Doug Lindholm Laboratory for Atmospheric.
Streaming NetCDF John Caron July What does NetCDF do for you? Data Storage: machine-, OS-, compiler-independent Standard API (Application Programming.
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
C van Ingen, D Agarwal, M Goode, J Gupchup, J Hunt, R Leonardson, M Rodriguez, N Li Berkeley Water Center John Hopkins University Lawrence Berkeley Laboratory.
Citation and Recognition of contributions using Semantic Provenance Knowledge Captured in the OPeNDAP Software Framework Patrick West 1
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
OPeNDAP and the Data Access Protocol (DAP) Original version by Dave Fulker.
Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
OOI CyberInfrastructure: Technology Overview - Hyrax January 2009 Claudiu Farcas OOI CI Architecture & Design Team UCSD/Calit2.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
ALCME: OAI at OCLC Jeffrey A. Young OCLC Online Computer Library Center, Inc.
OPeNDAP Developer’s Workshop Feb OPeNDAP 4 Data Server – Hyrax James Gallagher and Nathan Potter 21 Feb 2007.
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness TA Weijing Chen Semantic eScience Week 10, November 7, 2011.
Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.
GI-cat / THREDDS notes. GI-cat/THREDDS system
Integrating netCDF and OPeNDAP (The DrNO Project) Dr. Dennis Heimbigner Unidata Go-ESSP Workshop Seattle, WA, Sept
DAP4 James Gallagher & Ethan Davis OPeNDAP and Unidata.
Unidata TDS Workshop THREDDS Data Server Overview
Accessing Remote Datasets using the DAP protocol through the netCDF interface. Dr. Dennis Heimbigner Unidata netCDF Workshop August 3-4, 2009.
Citation and Recognition of contributions using Semantic Provenance Knowledge Captured in the OPeNDAP Software Framework Patrick West 1
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
Unidata’s Common Data Model and the THREDDS Data Server John Caron Unidata/UCAR, Boulder CO Jan 6, 2006 ESIP Winter 2006.
Semantic Technologies and Application to Climate Data M. Benno Blumenthal IRI/Columbia University CDW /04-01.
HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.
Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netCDF Workshop October 25, 2012.
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
OPeNDAP Hyrax Harnessing the power of the BES OPeNDAP Hyrax Back-End Server Patrick West
Overviews of the Library of Texas & ZLOT Project Dr. William E. Moen Principal Investigator.
The NetCDF/OPeNDAP (NO) Project or “What part of NO do you not understand?”
11/8/2007HDF and HDF-EOS Workshop XI, Landover, MD1 Software to access HDF5 Datasets via OPeNDAP MuQun Yang, Hyo-Kyung Lee The HDF Group.
OPeNDAP’s Server4: Building a High Performance Data Server for the DAP Using Existing Software James Gallagher*, Nathan Potter*, Patrick West**, Jose Garcia**
Glossary WMS – OGC Web Mapping Services WFS – OGC Web Feature Services XML- Extensible Markup Language OGC – Open GIS Consortium ADN –
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
1 Earth System Grid Center for Enabling Technologies OPeNDAP Services for ESG March 9, 2016 Peter Fox, Patrick West, Stephan Zednik RPI Performance Measures.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
9/21/04 James Gallagher Server-Side: The Basics This part of the workshop contains an overview of the two servers which OPeNDAP has developed. One uses.
Update on Unidata Technologies for Data Access Russ Rew
THREDDS Data Server (TDS) and Data Discovery John Caron Unidata/UCAR May 15, 2006.
TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.
IRI Data Library Faceted Search: an example of RDF-based faceted search for climate data Drawing on multiple ontologies to build an application Using inference.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Installing the THREDDS and Aggregation Servers ● Install and verify the Tomcat servlet engine ● Install and verify the THREDDS servlet (which also contains.
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Data Browsing/Mining/Metadata
Advancing netCDF-CF for the Geoscience Community
Data Are from Mars, Tools Are from Venus
DAP+NETCDF Using the netCDF-4 Data Model
James Gallagher OPeNDAP
Other Services in Hyrax
Common Framework for Earth Observation Data
Improving Data Access, Discovery, and Usability
Tools to Build Clients.
Extending the NetCDF Supported Data Formats using a Dispatch Layer
Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)
Remote Data Access Update
Accessing Remote Datasets through the netCDF interface.
Dispatch Layer and the NetCDF Architecture
HAO/SCD: VO, metadata, catalogs, ontologies, querying
OPeNDAP Community Working Groups October 18, 2007
OPeNDAP’s Server4: Building a High Performance Data Server for the DAP
OPeNDAP/Hyrax Interfaces
Adapting an existing web server to S3
Presentation transcript:

Future Development Plans

Future Development Plans Funded WCS/WFS support added to Hyrax netCDF Client Library integration Current research Cataloging/Discovery Wish list Aggregation SQL handler File responses WMS

OGC’s WCS/WFS NASA is currently funding development of a plugin so Hyrax can read from a WCS server WCS data exposed using DAP IOOS/NOAA has funded a proposal to develop a WCS and WFS interface for Hyrax DAP data exposed using WCS/WFS

WCS/WFS: How Using DAP4’s DDX response Use namespaces to categorize the attributes as belonging to DAP, WCS, WFS, et cetera Develop an ontology to map between those namespaces (i.e., sets of attributes) The data models for both DAP and WCS/WFS are similar enough to enable a crosswalk using an inference engine The ontology(ies) used will model both the Interfaces (DAP, WCS, WFS) and the response semantics.

The netCDF Client Library NSF funded two year effort Move support for the netCDF Client Library out of OPeNDAP and into Unidata Unidata is the author of netCDF Our library is currently a ‘version’ of their official library The software will move into Unidata’s source code repository and will be an integral part of all future releases of netCDF.

netCDF Client Library: How Using the Ocapi C library we developed recently The current netCDF CL software is written in C++ The design will be recast in C The libdap (C++) code will be replaced by Ocapi (C) code CDM support will be integrated

Cataloging & Discovery NSF funded research effort with UCSB and URI Using a crawler to harvest metadata Developing clustering techniques to automatically build inventories Inventory search is closely related to data source aggregation

Inventories An inventory is a catalog that falls between the individual data sources (DAP URLs, files, database blobs) and a list of ‘logical’ datasets A logical dataset is what a person typically thinks of when they use the word ‘dataset’ The inventory collects all the pieces that the computer manages and lists each one that makes up the logical dataset My apologies for the phrase ‘logical dataset’

Aggregation As TDS currently supports, data sources (e.g., files) from within an ‘inventory’ are combined into a virtual data source The virtual data source is typically ‘extended’ and choosing points along this extension is effectively searching an inventory Example: A set of two-dimensional images are combined to form a cube with the new dimension the date/time of image capture Choosing a range of dates/times along that new axis returns the same data as choosing individual inventory entries

Other things we would like … SQL A handler for SQL Currently pyDAP and DRDS provide this support Please contact us before using DRDS as it is no longer supported File-type responses We would like for Hyrax to be able to return a netCDF, HDF4/5 or GeoTIFF file The server can return ASCII CSV responses now and we have some work done on a netCDF tool, but no funding WMS Since we have WCS/WFS support planned, WMS support is a natural thing to expect.