Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.

Slides:



Advertisements
Similar presentations
Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
Advertisements

IVOA Registry WG, IVOA Registry WG Pune, 28 Sept 2004.
IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,
William OMullane - JHUIVOA Cambridge May 12-16, 2003 NVO Registry Prototype Harvest Query Entry.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Yuji Shirasaki National Astronomical Observatory of Japan JVO JVO Publishing/Searchable Registry Implementation Experience IVOA Interoperability Meeting.
May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
May 2005IVOA Kyoto1 Astronomical Data Query Language(ADQL) William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Aug 3-4, 2003 Victoria1 Montage, Pegasus and ROME G. B. Berriman, J.C. Good, M. Kong, A. Laity IPAC/Caltech J. Jacob, A. Bergou, D. S. Katz JPL R. Williams.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
Footprint Service Specification NVO Summer School 2008 Gretchen Greene (thanks to Tamas Budavari and Francois Bonnarel) T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
Us-vo.org/vim VIM Visual Integration and Mining A Tool to Explore Your Sources Roy Williams ( Caltech) And the NVO Portal Team T HE US N ATIONAL V IRTUAL.
László Dobos 1,2, Tamás Budavári 2, Nolan Li 2, Alex Szalay 2, István Csabai 1 1 Eötvös Loránd University, Budapest,
July 2004SC4DEVO -Caltech1 IVOA WebServices William O’Mullane The Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
EdSkyQuery-G Overview Brian Hills, December
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
Web Services for the National Virtual Observatory Tamás Budavári Johns Hopkins University.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
ADQL/s Syntax (Proposal) -- towards unification of ADQL, SIAP, SSAP, SXAP Yuji SHIRASAKI National Astronomical Observatory.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
VO Enabled Mirage and The IVOA Client Package Samuel Carliles 1, Tin Kam Ho 2, and William O’Mullane 1 1 Department of Physics and Astronomy, The Johns.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
Catalog Data Interface Tool Virtual Observatory-India (VO-I) May 16-20, 2005 Catalog Data Interface.
IVOA RM, VOResources, Identifiers, Interfaces Chenzhou CUI.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
May IVOA Interop Meeting1 Standard Interfaces William O’Mullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
How to use the GALEX SkyNode*
Standard Query Language for VO
May 14 (Wed) Masatoshi Ohishi (Japan)
Progress Report of VOQL WG
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
VOQL WG Plenary Session
Presentation transcript:

Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

Sept. 2003NVO Team Meeting / Victoria2 Virtual Observatory Query Language Layers VOQL3 SkyXQuery VOQL2 SkyQL VOQL1 WebServices future XML-based query language. SQL-like query language and federation system i.e. combination of SkyQuery, JVOQL and VO standards Astronomical Data Query Language (ADQL) and VOTABLE to exchange information between machines

Sept. 2003NVO Team Meeting / Victoria3 Architecture Clients VOQL Portal High Level Language allowing seemingly uniform access to services. VOQLQuery IVOA SkyNodes Lower level ADQL (including regions) and services to Support VOQL. laterEnd 2003 Tables MetaData PerformQuery Columns LEV1 Tables MetaData PerformQuery Columns LEV2 XMatch Tables MetaData PerformQuery Columns LEV1 Registry Register Tables MetaData PerformQuery Columns LEV4 XMatch ExecPlan Footprint Tables MetaData PerformQuery Columns LEV3 XMatch ExecPlan Open SkyQuery Portal Uses only Registry, Lev3 and Lev4 SkyNodes. SkyQuery SkyQuery WebApp May use Services at any level SKYQLADQLVOQLADQL

Sept. 2003NVO Team Meeting / Victoria4 SkyNode Levels FeatureLEV1– ADQL LEV2 – XMATCH LEV3- SKYNODE LEV4- SKYNODE Advanced Optional ADQL – circle XXXX Xmatch XXX Performance Query XX Takes exec plan XX Footprint – Region intersect X MYDB X Authentication X

Sept. 2003NVO Team Meeting / Victoria5 SkyQL and ADQL Same semantics different syntax ADQL - parse tree easy for SkyNodes SkyQL – textual easy for humans ADQl Includes Rots regions, Xmatch,math functions Simple parser working both ways(demo) ADQLtoSkyQLADQLtoSkyQL SkyQLtoADQLSkyQLtoADQL

Sept. 2003NVO Team Meeting / Victoria6 MYDB – not in v0.4 local space for data and results –Like astorgrid mysapce Requires on node –User Identification –Job tracking/monitoring –Asynchronous execution CasJobs does all of this (short demo) – Should we try to do this for OpenSkyQuery now? What about across nodes…

Sept. 2003NVO Team Meeting / Victoria7 MYDB across Nodes Need user identification across nodes –Centralize (not nice technically nor politically) –How to integrate with exiting mysapce and MYDB … Federate ! (IBM/MS Paper )IBM/MS Paper –Authentication service on each node –User signs up anywhere or uses exisiting id –Accept userids issued by trusted nodes Authenticate userid with node it is supposed to be from

Sept. 2003NVO Team Meeting / Victoria8 Security with federated Auth. How secure do we want this? Should the userid be: – an encrypted token – just a number Do we copy user info to each node so we can have integrity constarins in our db on USERID

Sept. 2003NVO Team Meeting / Victoria9 MYVOSPACE Next step is an integration service One stop service

Sept. 2003NVO Team Meeting / Victoria10 Current Issues for discussion Since v0.3

Sept. 2003NVO Team Meeting / Victoria11 Hardcore Levels Drop Lev3 Skynode Require Footprint/Region intersect for Skynodes. Personally – I think we will have nodes without and would rather have a name for them

Sept. 2003NVO Team Meeting / Victoria12 Interface Issue Currently PerformQuery returns VOTable Votable performQuery (ADQL query) M.Hill would like a more general wrapper e.g. IVOAResult performQuery (ADQL query) Here IVOAResult would be abstract or a wrapper containing VOTable or some pointer to a file. Would also allow for putting other things in result (region densities Yasuda San has suggested).

Sept. 2003NVO Team Meeting / Victoria13 Neighbours or XMatch Xmatch is a probabilistic matching returning all neighbours taking account of errors. B. Mann suggests we should use lowest common denominator which is Neighbors – this would return all objects within a certain distance of each other not using the errors.

Sept. 2003NVO Team Meeting / Victoria14 Region Specification Issue Have suggested Region,RefionUrl,RegionXml. Region would take simple strings like Circle j A.Rots has another suggestion for Region strings which is comprehensive Is this as complex as just using the XML …

Sept. 2003NVO Team Meeting / Victoria15 A. Rots Region Strings define CSys = (TimeFrame = (TimeScale='TT') and (TimeRefPosition='TELESCOPE')) and (SpaceFrame = (CoordFrame='ICRS') and (CoordRefPosition='TELESCOPE')) and (SpectralFrame = 'OBSERVATORY') and (CoordFlavor = 'SPHERICAL') define CArea = (TimeInterval = (StartTime=(ISOTime=' ')) and (StopTime=(ISOTime=' '))) and (Region = (Circle = (Center='60.0d,30.0d') and +(Radius='10arcmin')) and (SpectraLinterval = (LoLimit='1GHz') and (HiLimit='2GHz')) define CSpec = (Time = (CoordResolution<='10s')) and (Pos2Vector = (CoordResolution<='10arcsec,10arcsec')) and (Spectrum = (CoordResolution<='50MHz')) The query: select from where and SearchLocation = (CoordSystem = $CSys and CoordArea = $CArea