IVOA Registry WG, IVOA Registry WG Pune, 28 Sept 2004

IVOA Registry WG, Agenda Introduction (B. Hanisch) NVO registry activities (B. Hanisch) CDS registry activities (S. Derriere) AstroGrid registry activities (K. Benson) Registry interface to GLU (P. Fernique) Registry curation (B. Hanisch) Registry curation (A. Richards) Registry Interface standard (K. Benson) Discussion

IVOA Registry WG, Registry activities since May VOResource v0.10 Standard Registry Interface v0.1 Support for mirror sites Fine-grain/coarse-grain discussion continues Function of AccessURL for Web Services (WSDL) How to support UCD versions RM/schema extensions (e.g., in situ magnetic field measurements) Registry and GLU Curation

IVOA Registry WG, The role of Resource Registries Used to discover and locate resourcesdata and servicesthat can be used in a VO application Resource: anything that is describable and identifiable. –Besides data and services: organizations, projects, software, … –Presently concerned with simple set of resource types Registry: a list of resource descriptions –Expressed as structured metadata to enable automated processing and searching

IVOA Registry WG, An Overview of Data Discovery You can search the main VO registries to find resources based on descriptive criteria NVO Registries are coarse-grained –You can find organizations, archives, catalogs –Wont find images, celestial objects, table records AstroGrid Registries are fine-grained –Table columns, individual images and associated metadata Registry framework contains multiple registries: –searchable registries –publishing registries

IVOA Registry WG, Local Publishing Registry Local Searchable Registry Full Searchable Registry Local Publishing Registry Full Searchable Registry Data Centers VO Projects Specialized Portals & Services Registry Framework

IVOA Registry WG, Local Publishing Registry Local Searchable Registry Full Searchable Registry Local Publishing Registry Full Searchable Registry Data Centers VO Projects Specialized Portals & Services Registry Framework harvest (pull)

IVOA Registry WG, Local Publishing Registry Local Searchable Registry Full Searchable Registry Local Publishing Registry Full Searchable Registry Data Centers VO Projects Specialized Portals & Services Registry Framework harvest (pull) replicate

IVOA Registry WG, Local Publishing Registry Local Searchable Registry Full Searchable Registry Local Publishing Registry Full Searchable Registry Data Centers VO Projects Specialized Portals & Services Registry Framework harvest (pull) replicate selective harvesting

IVOA Registry WG, Local Publishing Registry Local Searchable Registry Full Searchable Registry Local Publishing Registry Full Searchable Registry Data Centers VO Projects Specialized Portals & Services Client Applications search queries Registry Framework

IVOA Registry WG, Local Publishing Registry Local Searchable Registry Full Searchable Registry Local Publishing Registry Full Searchable Registry Data Centers VO Projects Specialized Portals & Services Client Applications search queries Registry Framework

IVOA Registry WG, NVO Public Registries RegistryURLSearchable?Publishing? STScI/JHU NVO Registry Caltech Carnivorehttp://mercury.cacr.caltech.edu:8080/carnivore/Yes NCSA Registration Portal Private Publishing Registries HEASARC (CDS) Only support harvesting protocol

IVOA Registry WG, Overview of Publishing Resources are published if one can use VO facilities to find them. Multiple layers of publishing –Starts with registry description of resource –Data Access Services Incremental exposure for incremental effort Who are you? How you publish depends on what you want to publish. –An individual with a small data collection –An archive center –Someone with a cool service

IVOA Registry WG, Persistent Archives: Tools for Federation Registering your resources with a VO publishing registry –Enter description into registration form at one of the available NVO registries: STScI/JHU Registry: NCSA Registration Portal: Caltech Carnivore: –If you have a large number of resources to register, you can run your own registry on your own site NCSA VORegistry-in-a-Box Caltech Carnivore:

IVOA Registry WG, What can/should you register? –Should: your Organization Declares yourself as a publisher with an ID –Should: your Collection –Can: your existing services Browser-based services: e.g. search page Traditional CGI services Web Services The next level… Implement and register one or more standard services –Cone Search –Simple Image Access –SkyNode* –Simple Spectral Access* *standard still in development Persistent Archives: Tools for Federation

IVOA Registry WG, A word about Identifiers… IVOA Identifier: a globally-unique URI identifying a resource Ex: ivo://adil.ncsa/targeted/SIA Required as part of a registered resource description As publisher, you control what it looks like Two components: –Authority ID: e.g. adil.ncsa, hst.nasa, vlt.eso Defines a namespace for identifiers Owned by a single publishing organization –Resource Key: e.g. targeted/SIA, acs/SIA Name for the resource unique within the namespace Encourage re-use of local identifiers

IVOA Registry WG, Resource Metadata: XML Schema Classes of Resources Organisation, DataCollection, Service, Registry –Specific classes inherit from generic Organized into separate schemas: –Core resource metadata: VOResource –Various extensions schemas containing specific types Capable of describing… –Data centers, research organizations, missions, observatories –Data collections, archives –VO standard services: Cone Search, Simple Image Access –Existing Browser/CGI-based services –Web Services

IVOA Registry WG, Describing Resources with XML: VOResource Model: types of Resources –Generic Resource –Extensions: e.g. DataCollection, Service, ConeSearch, … VOResource: Family of XML schemas –Core schema: VOResource Common set of metadata applicable to all resources including Dublin Core Resource types: Resource, Service, Organisation –Extension schemas to describe specific kinds of resources Extended type inherits generic metadata adds metadata specific to the type of resource –Extensibility allows for evolution Developers only need to support types of interest to them Allows developers to experiment with non-standard extensions –Currently transitioning from v0.9 to v0.10 Lastest status of metadata standards:

IVOA Registry WG, Extension Schemas VODataService: describing data and services –Types: DataCollection, SkyService, TabularSkyService ConeSearch: describes location and behavior of a Cone Search service –Types: ConeSearch SIA: describes location and behavior of a Simple Image Access service –Types: SimpleImageAccess VORegistry: metadata for managing registries –Types: Registry, Authority

IVOA Registry WG, IVOA Standard Registry Interface IVOA Working Draft: 2 parts –Harvesting: sending descriptions from publishers to searchable registry –Searching Searching –methods keywordSearch(string words, boolean combineByOr) search(ADQLWhere constaints) –Returns a list of VOResource descriptions –Advanced searching with ADQL: Just the where parti.e. search constraints--of ADQL In place of column names, use XPath to VOResource element –Curation/Publisher like %NASA% –Query extensible to any VOResource XML extension –Maps readily to registry implementations based on RDBMS or XML-DB.

IVOA Registry WG, Why might a client use the standard search interface? Uniform interface to all VO Registries –Not dependent on a single registry Direct relationship between information you are querying and information you get back. Extensible to any type of resource description Re-use of ADQL Custom interfaces to Registries: Registries can provide extended functionality –More advanced capabilities: e.g. XQuery –Simpler interfaces for specialized purposes Client toolkits can provide simplifying interfaces –Support for ADQL/s –XPath aliases

IVOA Registry WG, Registry activities since May VOResource v0.10 Standard Registry Interface v0.1 Support for mirror sites Fine-grain/coarse-grain discussion continues Function of AccessURL for Web Services (WSDL) How to support UCD versions RM/schema extensions (e.g., in situ magnetic field measurements) Registry and GLU Curation

IVOA Registry WG, Agenda Introduction (B. Hanisch) NVO registry activities (B. Hanisch) CDS registry activities (S. Derriere) AstroGrid registry activities (K. Benson) Registry interface to GLU (P. Fernique) Registry curation (B. Hanisch) Registry curation (A. Richards) Registry Interface standard (K. Benson) Discussion