Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.

Slides:



Advertisements
Similar presentations
Trying to Use Databases for Science Jim Gray Microsoft Research
Advertisements

Web Services for the Virtual Observatory Alex Szalay, Tamas Budavari, Tanu Malik, Jim Gray, and Ani Thakar SPIE, Hawaii, 2002 (Living in an exponential.
Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Registry Interop Summary IVOA Interoperability meeting Cambridge, Boston, MA May 2004.
VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Achievements in VOQL WG May 20, 2005 Masatoshi Ohishi.
Yuji Shirasaki National Astronomical Observatory of Japan JVO JVO Publishing/Searchable Registry Implementation Experience IVOA Interoperability Meeting.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
27-28 Sep 2007 CambridgeIVOA VOQL Group – Pedro Osuna IVOA VOQL Closing Plenary Session Cambridge Interop meeting Sep 2007.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
May 2005IVOA Kyoto1 Astronomical Data Query Language(ADQL) William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Data Mining, ADQL, & The National Virtual Observatory's OpenSkyQuery Utility by Richard Doc Kinne, KQR 2008 AAVSO Fall Conference Nantucket, MA.
Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
László Dobos 1,2, Tamás Budavári 2, Nolan Li 2, Alex Szalay 2, István Csabai 1 1 Eötvös Loránd University, Budapest,
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
05/24/2004The 12th UN/ESA Workshop on Basic Space Science Chinese Virtual Observatory (China-VO) Chenzhou Cui Chinese Virtual Observatory Project National.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
How to build your own SkyNode A quick tutorial by Alberto Conti & Bernie Shiao Space Telescope Science Institute Baltimore, MD
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Status Spring 2014 Theresa Dower Registry WG IVOA Interoperability Meeting – Madrid 2014.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
Web Services for the National Virtual Observatory Tamás Budavári Johns Hopkins University.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
ADQL/s Syntax (Proposal) -- towards unification of ADQL, SIAP, SSAP, SXAP Yuji SHIRASAKI National Astronomical Observatory.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
Catalog Data Interface Tool Virtual Observatory-India (VO-I) May 16-20, 2005 Catalog Data Interface.
AstroGrid Datacenters IVOA Interoperability meeting M Hill (ROE), May 2004.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
IVOA Interoperability Meeting Oct 2008, BaltimoreIVOA VOQL-TEG – Iñaki Ortiz ADQL status Iñaki Ortiz VOQL-TEG.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Standard Query Language for VO
May 14 (Wed) Masatoshi Ohishi (Japan)
Google Sky.
Progress Report of VOQL WG
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
Footprint Service Specification
VOQL WG Plenary Session
Presentation transcript:

Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG

Aus-VO Workshop 2003 VOQL Working Group Chair : Masatoshi Ohishi (JVO) William O'Mullane, Tamas Budavari, Vivek Haridas, Nolan Li, Tanu Malik, Alex Szalay (NVO, JHU) Martin Hill, Tony Linde, Bob Mann, Clive Page (AstroGrid) Jim Gray (Microsoft) Yoshihiko Mizumoto, Naoki Yasuda (JVO) have contributed.

Aus-VO Workshop 2003 Brief History Jan 2003 at Seattle : First IVOA Meeting Start WG May 2003 at Cambridge : IVOA Interoperability Meeting Agreed on ADQL and SkyNode concept Jul 2003 : First Working Draft Discussions on mailing list have been continued. Oct 2003 at Strasbourg : IVOA Interoperability Meeting More detailed discussion Nov 2003 : Version 0.6 Working Draft is available

Aus-VO Workshop 2003 Architecture

Aus-VO Workshop 2003 Architecture Description Astronomical Data Query Language (ADQL) is an SQL like language but passed as an XML document. SkyNodes have standard interface and will accept ADQL and return the query result as VOTable. SkyQL have the same semantics as ADQL but the syntax would be an SQL like string rather than XML. VOQL is an ambitious language at a higher level than ADQL.

Aus-VO Workshop Layers of VOQL

Aus-VO Workshop 2003 ADQL and SkyQL Many astronomical data are tabular data and they are stored in relational database. SQL as a first step The only SQL command allowed in ADQL is aselect. Additional predicates are Region and XMatch. XMatch is supported in Full SkyNode. See the XSD for complete structure of ADQL.

Aus-VO Workshop 2003 Select t.*, b.* From Tab t, Bob b Where t.g <> b.g and Region('Circle J ') t b Tab t Bob b t g <> b g Ra Dec SkyQL vs ADQL We need SkyQL as a human readable expression.

Aus-VO Workshop 2003 SkyNode All data servers joining the IVO would implement a standard IVOA SkyNode Interface based on Web Services. All VO WebServices shall implement theMetaData port. All VO WebServices shall implement theHeartbeat port.

Aus-VO Workshop 2003 Basic / Full SkyNode FeatureBasic SkyNodeFull SkyNodeOptional ADQL – circleXX FunctionsXX XMatchX QueryCostX Takes exec planX Footprint – Region intersectX MYDBX Authentication – must have with MYDB X

Aus-VO Workshop 2003 Basic SkyNode Interface //Return RSM compliant VOResource public VOResource MetaData(); //Return a list of all tables that may be used from this node. public string[] Tables(); //Return ucd, name, unit, type for each column of table public MetaColumn[] Columns(string table); //Return available query result formats, VOTable, DataSet, ASCII public string[] Formats(); //Return available functions public MetaFunctions[] Functions(); //Return the result of executing ADQL query in requested format public VOResult PerformQuery(Select query, string format);

Aus-VO Workshop 2003 Full SkyNode Interface //Returns object density per square degree for a given criteria. public float QueryCost(Select query); //Return Cross matched objects according to Query and input Tables public VOResult XMatch(Select select, VOTABLE[] votables); // Return result of executing an ExecPlan, format specified in plan public VOResult ExecutePlan(ExecPlan plan); //Return region of intersection between given region and this SkyNode public Region Footprint(Region region);

Aus-VO Workshop 2003 Open SkyQuery Portal Portal should not be in this specification, but some description will help how to use SkyNodes. Open SkyQuery Portal will enable the following query select s.ra, s.dec, s.r, s.i, s.g, s.objid, p.* from SDSS:PhotoObj s, Twomass:Photo t,First:Photo f, SDSS:Spectro p, IVOA:MyDB.MyObjList m where XMatch (s,t,f,m) < 3 and Region(Circle Cartesian ) and s.objid=p.objid and s.r<15 and abs(s.i-t.j_m)<2 Open SkyQuery Portal is open version of SkyQuery developed at JHU based on Microsoft.NET technology. Currently Open SkyQuery Portal will use only Full SkyNodes.

Aus-VO Workshop 2003 Discussions How to use Unified Content Descriptors? UCDs will hide raw column names. UCDs are not unique. XMatch algorisms? User customized XMatch. XMatch vs Neighboring Search Someone need all possible corresponding objects.

Aus-VO Workshop 2003 Summary ADQL and SkyNode architecture is adopted in VOQL WG. ADQL is SQL like language. SkyNode is WebService interface. Specifications of ADQL and SkyNode are almost finalized (Jan 2004). Full XML-baed VOQL (SkyXQuery) will be available in a few years. See details on