© Roy Williams 2002 The Uphill Battle of Semantic Interoperability Roy Williams California Institute of Technology.

Slides:



Advertisements
Similar presentations
May 18, 2006IVOA Interoperability Meeting Fine-grained vs. Coarse-grained Registries or How much detail about a resource should be stored in a registry?
Advertisements

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.
Victoria, May Session III Theory Interest Group Session III Victoria, May
3 September 2004NVO Coordination Meeting1 Grid-Technologies NVO and the Grid Reagan W. Moore George Kremenek Leesa Brieger Ewa Deelman Roy Williams John.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.
An Introduction to Web Services Sriram Krishnan, Ph.D.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
1 Understanding Web Services Presented By: Woodas Lai.
19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
Presentation 7 part 2: SOAP & WSDL. Ingeniørhøjskolen i Århus Slide 2 Outline Building blocks in Web Services SOA SOAP WSDL (UDDI)
CSE 636 Data Integration Web Services.
Web Services February 14 th, Outline Overview of web services Create a web service with MS.Net Requirements for project Phase II.
Processing of structured documents Spring 2003, Part 6 Helena Ahonen-Myka.
Section 2.1 Compare the Internet and the Web Identify Web browser components Compare Web sites and Web pages Describe types of Web sites Section 2.2 Identify.
The NERC DataGrid Vocabulary Server Roy Lowry British Oceanographic Data Centre Ontology Registry Meeting.
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
Roy Williams Andrew Drake, Matthew Graham, Ashish Mahabal California Institute of Technology Skyalert and Event Processing.
How Web Servers and the Internet Work by by: Marshall Brainby: Marshall Brain
Digital Media Dr. Jim Rowan ITEC The Internet your computer DHCP: your browser (Safari)(client) webpages and other stuff yahoo.com (server)
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
NERC DataGrid Vocabulary Server Access Vocabulary Workshop, RAL, February 25, 2009.
Tero Oittinen Sampo Team Department of Astronomy University of Helsinki,Finland Using ESO Reflex to access astronomical WebServices by The Sampo.
1 Accelerated Web Development Course JavaScript and Client side programming Day 2 Rich Roth On The Net
Last News of and
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Virtual Observatory & LIGO Roy Williams California Institute of Technology.
Scalable Metadata Definition Frameworks Raymond Plante NCSA/NVO Toward an International Virtual Observatory How do we encourage a smooth evolution of metadata.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
An Introduction to METS Morgan Cundiff Network Development and MARC Standards Office Library of Congress Metadata Encoding and Transmission Standard.
Semantic Grid + Data Federation US National Virtual Observatory Roy Williams California Institute of Technology NVO co-director.
Asynchronous services from NVO Roy Williams Conrad Steenberg Craig Miller Matthew Graham Joe Jacob Julian Bunn.
Introduction to Web Services Eric Lease Morgan University Libraries of Notre Dame June 24, 2005.
1 Web Service Description Language (WSDL) 大葉大學資工系.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
F. Genova, VO as a Data Grid, 2003/06/301 Interoperability of astronomy data bases Françoise Genova, CDS.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
Report of UCD Working Group Roy Williams Caltech.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia.
VOEvent and the Registry Introducing VOEventStream and VOEventService Roy Williams Caltech.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
DEVELOPING WEB SERVICES WITH JAVA DESIGN WEB SERVICE ENDPOINT.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
Finally getting to html and CSS… Tim Berners-Lee, the writer of the software program that makes him the inventor of the WWW, defines the Internet as a.
Domain Name System (DNS)
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
Lesson 11: Web Services & API's
Google Sky.
IVOA Interoperability Meeting - Boston
A Semantic Peer-to-Peer Overlay for Web Services Discovery
The Internet and Electronic mail
Presentation transcript:

© Roy Williams 2002 The Uphill Battle of Semantic Interoperability Roy Williams California Institute of Technology

© Roy Williams 2002 A semantic web of interoperable resources rather than THE TOWER OF BABEL This talk: 1. Services 2. Vocabularies & Translation 3. Standard services

© Roy Williams 2002 Example Service name=M51 x=10 y=10 sky_survey=DSS2_red mime_type=download_gif Client interface Request: Keyword/value Response: image/gif Server Web Services Structures in and out Self-defined (WSDL) Exceptions

© Roy Williams 2002 Networks of Services What does the service do? Who is responsible? How can I use the service from Perl/Java/C++? What can I get from the service? What are the keywords, their meanings?? What values can they take? What authentication do I need? Storage Service Archive Service Catalog Service User’s code Crossmatch Service Archive Service Query Check Service Query Estimator

© Roy Williams 2002 Service/File Shape Each service has a shape Defined by a combination of labels from a vocabulary NVO works with community on standardizing the “bricks” Line, Point, Symbol, Text, … drawing service SOHO FITS file DATE_OBS, DATE_END, DEL_TIME, EXPTIME, …. RA, Dec, Long, Lat, … FITS Image cutout service Curation: title, author, …

© Roy Williams 2002 File Shape: FITS keywords FITS keyword lists This is the heart of astro interop today….. VO will have registry of these “file shapes”?

© Roy Williams 2002 Resource Interoperability Right Ascension (degrees) Declination (degrees) Magnitude (mags) Drawing Program right ascension declination magnitude result ? Producer Consumer

© Roy Williams 2002 Cone Search Registry POS_EQ_RA_MAIN POS_EQ_DEC_MAIN POS_EQ ID URLbase RA=200&DEC=20&SR=2 Request: HTTPget of shape: Response: VOTable of shape: A collection of services that have the same shape

© Roy Williams 2002 Cone Search + Density Probe Far infrared, Finkbeiner et al Cone Search Density Probe baseURL Spacing Search radius interoperating NVO-compliant services!

© Roy Williams 2002 Semantics with UCD Templates program user form service dataset POS_GAL_LON POS_GAL_LAT POS_EQ_RA_MAIN POS_EQ_DEC_MAIN POS_EQ POS_GAL POS ID NVO: locatedSource CREDIT DESCRIPTION TITLE CONTACT SHORT LONG NAME NVO: curation URL DISCLAIMER

© Roy Williams 2002 UCD for Curation IVOA:CURATION_IDENTIFIER IVOA:CURATION_DESCRIPTION IVOA:CURATION_CREATOR IVOA:CURATION_CONTACT SHORT LONG NAME IVOA:CURATION_URL IVOA:CURATION_ACKNOWLEDGEMENT IVOA:CURATION_PUBLISHER IVOA:CURATION_TITLE IVOA:CURATION_CONTRIBUTOR SHORT LONG  CAN WE AGREE THIS PROTOCOL NOW?

© Roy Williams 2002 Namespaces “We took the table and chair dimensions, and wrote them in a table.” Namespace = mydomain.com/furniture Namespace = mydomain.com/word-processing This is a URI (NOT a URL). A URI is a unique string. A URL is an address on the Internet. FITS keywords have no namespace!

© Roy Williams 2002 Resource Interoperability Right Ascension CDS:POS_EQ_RA_MAIN Declination CDS:POS_EQ_DEC_MAIN Magnitude CDS:PHOT_MAG Drawing Program DRAW:X DRAW:Y DRAW:SIZE result Producer Consumer CDS  DRAW mapping VOSchema (Plante)

© Roy Williams 2002 Ontology Mapping Horse Pig Sheep Cochon Mouton Cheval The translation is possible if we are talking about the same things

© Roy Williams 2002 Ontology Mapping Horse Pig Sheep Voiture Bateau Bicyclette ? The mapping fails if it is impossible!

© Roy Williams 2002 VO Services Every registry is a resource returns lists of resources A service may be described by a SD, expressed in a SDL Inputs and outputs are hierarchical keyword/value set stream of VOTable records stream of XDF objects A resource is a set of services that include Send description Send curation Send query SDL Send query registry resource curation service

© Roy Williams 2002 Elements of Conversation client registry “Send resource list” “Here is my list” service “Send Query-SD” “Here is the SDL” client service Give resources with keywords Here is my list client service Here are its params Give curation data client resource “Send service list” “Here is my list” client

© Roy Williams 2002 Astronomy Conversation Do you speak VO version 3.5.2? If you have catalogs, give me the list. Give me the schema for catalog X Give me query mechanisms (service types) Answer this query on catalog X  CAN WE AGREE THIS PROTOCOL NOW?