Beyond simple features: Do complex feature types need complex service descriptions?' B.N. Lawrence (1,2), D. Lowe (1,2), S. Pascoe (1,2) and A. Woolf (1).

Slides:



Advertisements
Similar presentations
Publishing Data Catherine Jones Library Systems Development Manager, STFC Rutherford Appleton Laboratory CLADDIER workshop, Chilworth, Southampton, UK.
Advertisements

Project of the Darmstadt University of Technology within the competence network New Services, Standardization, Metadata (bmb+f) Stephan Körnig Ali Mahdoui.
Geographic Interoperability Office ISO and OGC Geographic Information Service Architecture George Percivall NASA Geographic.
Page 1© Crown copyright 2006 Registry technology & case study implementation J. Tandy, D. Thomas - November 2006.
Snejina Lazarova Senior QA Engineer, Team Lead CRMTeam Dimo Mitev Senior QA Engineer, Team Lead SystemIntegrationTeam Telerik QA Academy SOAP-based Web.
Interactive Systems Technical Design Seminar work: Web Services Janne Ojanaho.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
The MashMyData project Combining and comparing environmental science data on the web Alastair Gemmell 1, Jon Blower 1, Keith Haines 1, Stephen Pascoe 2,
A Similarity Measure for OWL-S Annotated Web Services Web Intelligence Laboratory, Sharif University of Technology, Tehran, Iran WI 2006 SeyedMohsen (Mohsen)
NERC Data Grid Helen Snaith and the NDG consortium …
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES WMS Map Integration - Improved Ghulam Memon Ashraf Memon.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
OPeNDAP and the Data Access Protocol (DAP) Original version by Dave Fulker.
WPS Application Patterns at the Workshop “Models For Scientific Exploitation Of EO Data” ESRIN, October 2012 Albert Remke & Daniel Nüst 52°North Initiative.
Web Services Architecture1 - Deepti Agarwal. Web Services Architecture2 The Definition.. A Web service is a software system identified by a URI, whose.
Using SRB and iRODS with the Cheshire3 Information Framework Building Data Grids with iRODS May, 2008 National e-Science Centre Edinburgh Dr Robert.
Bryan Lawrence on behalf of BADC, BODC, CCLRC, PML and SOC An Introduction to NDG concepts [ ]=
Extending ArcGIS for Server
Grid-enabling OGC Web Services Andrew Woolf, Arif Shaon STFC e-Science Centre Rutherford Appleton Lab.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
MapServer Support for Web Coverage Services Stephen Lime - Minnesota DNR Dr. Thomas E. Burk - University of Minnesota MUM Ottawa, Canada.
NOCS, PML, STFC, BODC, BADC The NERC DataGrid = Bryan Lawrence Director of the STFC Centre for Environmental Data Archival (BADC, NEODC, IPCC-DDC.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
1 Advanced Software Architecture Muhammad Bilal Bashir PhD Scholar (Computer Science) Mohammad Ali Jinnah University.
Shannon Hastings Multiscale Computing Laboratory Department of Biomedical Informatics.
AUKEGGS Architecturally Significant Issues (that we need to solve)
Introduce Grid Service Authoring Toolkit Shannon Hastings, Scott Oster, Stephen Langella, David Ervin Ohio State University Software Research Institute.
What is CWIC? Authors: Doug Newman Andrew Mitchell
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
COWS CEDA OGC Web Services Framework Stephen Pascoe.
1 MESSAGE EXCHANGE FOR Web Service-Based Mapping Services AHMET SAYAR INDIANA UNIVERSITY COMMUNITY GRIDS LAB. COMPUTER SCIENCE DEPARTMENT August 17, 2005.
SOAP-based Web Services Telerik Software Academy Software Quality Assurance.
Semantic Phyloinformatic Web Services Using the EvoInfo Stack Speaker: John Harney LSDIS Lab, Dept. of Computer Science, University of Georgia Mentor(s):
1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
Matthew B. Jones National Center for Ecological Analysis and Synthesis (NCEAS) University of California Santa Barbara Advancing Software for Ecological.
PLANETS, OPF & SCAPE A summary of the tools from these preservation projects, and where their development is heading.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Ideas on Opening Up GEOSS Architecture and Extending AIP-5 Wim Hugo SAEON.
Software Architecture Patterns (3) Service Oriented & Web Oriented Architecture source: microsoft.
ECMWF 24 th November 2008 Deploying secure OGC services in front of a heterogeneous data archive. Bryan Lawrence, Phil Kershaw, Dominic Lowe, and Stephen.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Geospatial interoperability Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Service Oriented Architecture (SOA) Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Enhancements to Galaxy for delivering on NIH Commons
GEOSS Component and Service Registry (CSR)
NERC DataGrid: Googling for Secure Data
Flanders Marine Institute (VLIZ)
Common Framework for Earth Observation Data
Software Design and Architecture
Distribution and components
HMA Follow On Activities
Grid Portal Services IeSE (the Integrated e-Science Environment)
Interoperability & Standards
PDAP Query Language International Planetary Data Alliance
Service-centric Software Engineering 1
OneStop: Architecture Review
Service Oriented Architecture
PREMIS Tools and Services
Service Oriented Architecture (SOA)
Session 2: Metadata and Catalogues
SAMANVITHA RAMAYANAM 18TH FEBRUARY 2010 CPE 691
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Publishing image services in ArcGIS
Data Management Components for a Research Data Archive
Distributed System using Web Services
A. Della Vecchia, D. Guerrucci (ESA)
OPeNDAP/Hyrax Interfaces
OGC Happenings: OGC19-020: Testbed-15 Service Discovery
Presentation transcript:

Beyond simple features: Do complex feature types need complex service descriptions?' B.N. Lawrence (1,2), D. Lowe (1,2), S. Pascoe (1,2) and A. Woolf (1). (1) Centre for Environmental Data Archival, Rutherford Appleton Laboratory, STFC; (2) NCAS British Atmospheric Data Centre'

Outline Motivation NDG Portal Link Types Standards Experience Futures

Scientific Data and the Web Scientific Data Complex feature types. Complex workflow. Reuse wanted, but within the “science” community and between science communities? Web 2.0 etc RESTful Scalable Reusable. SIMPLE!

State of the Art in the Grid World Create a new service using the Introduce integrated development environment, defining operations and resource properties, folding in required functionality (e.g., security, notification), and selecting types from both base types and predefined libraries. (Using gRAVI we can also encapsulate executables.) Publish this service into registries (GT4 index services). Discover available services. Compose services into workflows, e.g., via the use of Taverna, which thanks to recent work by Wei Tan and Ravi Madduri (and much help from the Taverna team) can now invoke GT4 services. Deploy and publish the workflow in turn … (Ian Foster: But: GLOBUS JAVA (Python?) Not an “interoperable stack” (which is not to say that it is in any way less impressive) …. HARD … What if I want to use ENVIRONMENT-A LANGUAGE-B REGISTRY-C And still use catalogues, workflow Orchestration (or even build a hardwired client that does the first of these?) … in an interoperable manner? OGC and the WEB of course! STILL HARD

Portals and Services Deployment issue: Services deployed remotely Portal aggregates data descriptions ( EBRIM model of data+service descriptions+associations not yet deployable but even if it were, much of what follows would apply for auto generated associations) Portal Client needs “shopping cart” functionality before handing over to service client Service client may or may not be colocated with portal/catalogue!

Catalogues (type 1) Metadata! Not directly useful to client software! (Great for humans)

Catalogues (type 2) Note: 1)Link- type icons 2)Metadata and data links.

How do we decide to show what services work? How do we pass the right information to those services? HARDWIRED!

Links and Link Descriptions NASA GCMD DIF: how does a catalogue client USE these links? Needs to parse them (I.e. understand the semantics of the link type). ISO19115: even less utility for USING the links. ATOM Syndication: Semantics of link meaning, but relies on a mime type for the link-type. Not much use for services.

Sadly, not much better: what we have in MOLES (today), allows us to to do more than the syntax (mimetype) and add the featureType.

ISO Services “An implementation of a service may be associated with a specific dataset or it may be a service that can be used to operate on multiple, unspecified datasets. The first case is referred to as a tightly-coupled service. The second case is referred to as a loosely-coupled service.”

Discovery Portal Data Provider 1 Data Provider 2 Client DIF OAI-PMH

Service Description: Option 1 Portal Data Provider 1 Data Provider 2 Client Capabilities WMS GetCapabilities

Service Description: Option 2 Portal Data Provider 1 Data Provider 2 Client WMC HTTP GET

Visualise Portal Data Provider 1 Data Provider 2 Client Image WMS GetMap

Portal Visualisation From Web Map Context OpenLayers WMS Client

Layer Model differences WMC Layer + queryable [required] + hidden [required] WMS_Capabilities Layer + queryable [default=0] WMC LayerList 1..* Similar differences exist in

WMS Service description flaws 1 Capabilities document per service leads to bloat as service expands Web Map Context not designed as a service description –captures (and enforces) more information than necessary –layer model differs from WMS Capabilities

OGC WXS - tight coupling Dataset 1 WMS Dataset 1 WCS Dataset 2 WMS Dataset 2 WCS Dataset 1 WCS Dataset 2 WCS Resource centric Loosely coupled

Loose coupling: CSML features with plotting service

Futures Better Link Descriptions RESTful (i.e OGC services should be recast!) Packaged up for multiple granules and services per catalogue entry! OAI-ORE? Machine readable service descriptions OWL-S?