IVOA, Kyoto May 16-20 20051 Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations Sep 2006, Moscow, Russia Simple Line.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
IVOA, Kyoto May Simple Spectral Access SSA Query Interface Doug Tody (NRAO) Markus Dolensky (ESO) Et. al. International V IRTUAL O BSERVATORY.
DM WORKING GROUP MADRID OCT WG STATUS Spectral DM: document updated and reformatted Spectral DM Java library prototype nearly ready Characterization:
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Gretchen Greene Pierre Lesidaner Closing Plenary 20 May 2011 IVOA Interoperability.
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
Achievements in VOQL WG May 20, 2005 Masatoshi Ohishi.
Photometry Data Model| Jesus Salgado | ESAC | 19 May 2010 | IVOA Interop Victoria | Pag. 1/5 Photometry data model Jesus Salgado
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
16 October 2003IVOA Interoperability Conference Registry Working Group VOResource (v0.8.4) XML Schema defining core metadata applicable to all resources.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.
SLAP: Simple Line Access Protocol v0.5
Grey Literature, Institutional Repositories and the Organisational Context Simon Lambert, Brian Matthews & Catherine Jones Business & Information Technology.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen 9-Sep Data Access Layer Doug Tody (NRAO) US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
NVO Summer School, Aspen 9-Sep TimeServer Andrew Drake Robyn Allsman David Gasson Mark Huber Kathy Vivas US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
Using Several Ontologies for Describing Audio-Visual Documents: A Case Study in the Medical Domain Sunday 29 th of May, 2005 Antoine Isaac 1 & Raphaël.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
IVOA interop meeting, Kyoto, May 2005 GWS-WG status (1) ► VOStore (Friday)  Spec v0.18 WD + WSDL  Next steps: ► Review operation set, WSDL, metadata.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
VO Data Access Layer Working Group Summary IVOA Cambridge, UK 16 May 2003 Doug Tody, NRAO.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
Last News of and
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado IVOA Interop meeting Strasbourg, May 2009 (1/12) SLAP v0.9.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
11 F.Bonnarel (CDS) Kyoto IVOA Interoperabilty Meeting DAL: a mechanism for Metadata extensions F.Bonnarel In behalf of T.Boch, M. Louys, P.Fernique (CDS)
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
IVOA Interop, SL de El Escorial, Oct IVOA Data Access Layer Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
Simple Image Access International VIRTUAL OBSERVATORY
Data Models: Plenary-1 Jonathan McDowell May 2006
PDAP Query Language International Planetary Data Alliance
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
Technical Coordination Group
Presentation transcript:

IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International V IRTUAL O BSERVATORY

IVOA, Kyoto May SSA - Role of Data Model Foreign or External Data –Access to native project dataset (external data) is important –Pass-through of external dataset required –Some support for mapping data model onto external data in general this is a hard, possibly intractable, problem VO Spectral Data Model –Active data model mediation is required for general multiwavelength data analysis Data model must be comprehensive enough to support real analysis –Extension mechanism allows pass-through of project metadata

IVOA, Kyoto May SSA - Service Levels, Compliance Minimally-Compliant Service –Provide at least the parameter-based GET interface WS interface will be required in the future for advanced capabilities –Implement "MUST provide" query parameters –Implement "MUST provide" query response metadata –Implement at least one SSA DM-compliant output format –Implement service metadata query method Query-Compliant Service –Implements minimal query, query response –Returns foreign/external dataset –Some support for understanding contents of external dataset Fully-Compliant Service –Implements everything in minimal service –Implements all "SHOULD provide" query parameters and query response metadata

IVOA, Kyoto May SSA Query Interface Basic Query –Add spectral and time bandpass to minimal required parameters POS,SIZE, BANDPASS, TIME, FORMAT –Allows query in all physical axes: spatial, temporal, spectral –Range syntax VAL1,VAL2 to express ranges Other Changes –Add TIMERES at same level as SPECRES (for time series) –Drop VERBOSITY - ADQL will provide a better way to provide this –Compression applies to query response as well as data retrieval Other New Parameters –TOP, APERTURE, SPECRES, TIMERES –COLLECTION, CREATORID, PUBID –SNR, REDSHIFT, TARGETCLASS

IVOA, Kyoto May SSA Query Response Classes of Query Metadata Returned –Query metadataDescribes the query itself –Dataset metadata Describes data object; object-specific –Target metadata Astronomical target –Curation metadata External identification of dataset –Characterization Coverage, Accuracy, Frame, etc. –Instrument metadata Optional; service-defined –Access metadata Describes how to access the dataset Most of this is generic dataset metadata and will apply equally to SIA as well.

IVOA, Kyoto May Data Model Integration Data model-based data access –Basic capability has been achieved Concepts –Primary data object types are all top-level Datasets Spectrum, TimeSeries, SED –Data model name should apply to a class of data Working name: Spectral data model Other issues –Good progress on Characterization –Role of dimensional analysis still under discussion

IVOA, Kyoto May Simple Line Access Protocol (SLAP) Authors –ML Dubernet, P.Osuna, et.al. Consists of –Detailed physical data model –Query interface –Line list returned as VOTable Status –Broad working group established –Draft specification in preparation (summer)

IVOA, Kyoto May SIA V1.1 Upgrade Goals –Query parameters Add spectral and time bandpass to minimal required parameters Query by dataset characteristics as for SSA –Update and enhance query response metadata Query response consistent with SSA New metadata extension mechanism –Some new functionality Logical name associations, score, compression, etc. Improved service metadata query Probably Defer –Web Services interface –Asynchronous i/o, staging to VOStore, authentication, etc. possibly we can include this as an experimental feature

IVOA, Kyoto May Managing New Releases Concern about impact on community –Versioning essential describe both in registry and at service level find services based on version of interface supported a single service can support multiple interfaces –Plan to keep old version around for at least one cycle user wants to defer upgrading until time is right

IVOA, Kyoto May ADQL/DAL Integration Agree on Architecture –ADQL/SkyNode is an alternative query interface Parameter-based interface will be retained –Query response is unaffected –Data staging is unaffected –Data access (getData) is unaffected Major Interfaces –Client query interface –Data collection metadata in RDBMS –Specification of virtual data product (for getData)

IVOA, Kyoto May DAL Roadmap Update SSA –V0.9 WDDiscussed in Kyoto –V0.9+ WDSummer 05 updated draft, trials –V1.0 PRMadrid (Oct 05) - ready for general implementation? SIA –V1.0 WDCurrent version –V1.1 WD Document available for review in fall –V1.1 WD Discuss in Madrid (Oct 05), trials to follow ADQL/DAL integration –Lower priority for DAL than data access protocols –Work with VOQL group on SkyNode/DAL interface in Fall 2005 Reference Implementations –Service framework (still in concept/design phase) –VO-Client (still in concept/design phase)