2003 May 24Clive Page Physical Units in Queries. 2003 May 24Clive Page Where units are needed Consider simple query like this: SELECT * from t1, t2 WHERE.

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
Interoperability meeting S. Derriere, Strasbourg, 2003 October UCD2... When all you have is a hammer every problem looks like a nail. Registry,
1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues.
SLAP: Simple Line Access Protocol v0.5
2003 May 24Clive Page Simple ADQL Enhancements Clive Page, AstroGrid Project University of Leicester, UK.
A.Micol IVOA Registry REGISTRY WG Mar 2003 A Science Case (and 1000 Questions) for the IVOA Registry.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
Configuration management
Configuration management
Metadata in the TAP context (1) The Problem: learn about which tables, tablesets,... are available from a TAP server for each of the tables / tablesets,
Hash Tables and Sets Lecture 3. Sets A set is simply a collection of elements Unlike lists, elements are not ordered Very abstract, general concept with.
CSE 1302 Lecture 23 Hashing and Hash Tables Richard Gesick.
Access Tables 1. Creating a Table Design View Define each field and its properties Data Sheet View Essentially spreadsheet Enter fields You must go to.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
School Census Summer 2011 Headlines Version Jim Haywood Product Manager for Statutory Returns.
CMPT 354 Views and Indexes Spring 2012 Instructor: Hassan Khosravi.
CSE 330: Numerical Methods
Pre-defined System Functions Simple IF & VLOOKUP.
Chapter 6 UNDERSTANDING AND DESIGNING QUERIES AND REPORTS.
CS 599 – Spatial and Temporal Databases Realm based Spatial data types: The Rose Algebra Ralf Hartmut Guting Markus Schneider.
Canonical Producer CP API User Code CP Servlet Files CreateTable, Port, Protocol, Security, SQL Support, Multiple Query Support Security Insert Query Port.
U of R eXtensible Catalog Team MetaCat. Problem Domain.
1 CS 502: Computing Methods for Digital Libraries Lecture 4 Identifiers and Reference Links.
Introduction To Databases IDIA 618 Fall 2014 Bridget M. Blodgett.
JS Arrays, Functions, Events Week 5 INFM 603. Agenda Arrays Functions Event-Driven Programming.
Indexing. Goals: Store large files Support multiple search keys Support efficient insert, delete, and range queries.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.
Epydoc API Documentation Extraction in Python Edward Loper.
Working with Derby. RHS – Creating tables We know how to create a database in Derby – an empty database Next step is to add tables to the database.
Names Variables Type Checking Strong Typing Type Compatibility 1.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
AstroGrid AstroGrid increases scientific research possibilities by : enabling access to distributed astronomical data and information resources. providing.
PHP meets MySQL.
Tunis International Centre for Environmental Technologies Small Seminar on Networking Technology Information Centers UNFCCC secretariat offices Bonn, Germany.
An Introduction to Programming and Algorithms. Course Objectives A basic understanding of engineering problem solving process. A basic understanding of.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations May 2007, Beijing, China Simple Line.
Moodle (Course Management Systems). Glossaries Moodle has a tool to help you and your students develop glossaries of terms and embed them in your course.
Linking electronic documents and standardisation of URL’s What can libraries do to enhance dynamic linking and bring related information within a distance.
PHP and MySQL CS How Web Site Architectures Work  User’s browser sends HTTP request.  The request may be a form where the action is to call PHP.
Disclosure risk when responding to queries with deterministic guarantees Krish Muralidhar University of Kentucky Rathindra Sarathy Oklahoma State University.
1 Database Management Systems: part of the solution or part of the problem? Clive Page 2004 April 28.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
IT Just Works ©2008 BigFix, Inc. Practical Guide to Relevance Ben Kus – 1/31/2008.
1 Tree Indexing (1) Linear index is poor for insertion/deletion. Tree index can efficiently support all desired operations: –Insert/delete –Multiple search.
WIRED Week 3 Syllabus Update (next week) Readings Overview - Quick Review of Last Week’s IR Models (if time) - Evaluating IR Systems - Understanding Queries.
2003 May 24Clive Page Implementation of XMATCH function.
Joseph M. Hellerstein Peter J. Haas Helen J. Wang Presented by: Calvin R Noronha ( ) Deepak Anand ( ) By:
 Enhancing User Experience  Why it is important?  Discussing user experience one-by-one.
Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.
Access Queries Agenda 6/16/14 Review Access Project Part 1, answer questions Discuss queries: Turning data stored in a database into information for decision.
Lecture 10 Page 1 CS 111 Summer 2013 File Systems Control Structures A file is a named collection of information Primary roles of file system: – To store.
Discussed in Kyoto Schema changes for the next version (Gerard Lemson)  will be included in VOTable1.2 Schema changes for the next version (Gerard Lemson)
Ch. 1: Introduction: Physics and Measurement. Estimating.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Working with MySQL. SWC – Creating tables We know how to create a database in MySQL – an empty database Next step is to add tables to the database.
© Roy Williams 2002 The Uphill Battle of Semantic Interoperability Roy Williams California Institute of Technology.
Retele de senzori Curs 2 - 1st edition UNIVERSITATEA „ TRANSILVANIA ” DIN BRAŞOV FACULTATEA DE INGINERIE ELECTRICĂ ŞI ŞTIINŢA CALCULATOARELOR.
LEuroCRIS 31st October 2001 A list of CERIF 2000 problems Walter Niedermayer
CSE 330: Numerical Methods. What is true error? True error is the difference between the true value (also called the exact value) and the approximate.
Is non-unicity of utype/ucds a problem? The problem: is it possible to query some IVOA database directly from UCDs or Utypes? Select * from ivoa_table.
Progress Report of VOQL WG
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
Human and Computer Interaction (H.C.I.) &Communication Skills
Presentation transcript:

2003 May 24Clive Page Physical Units in Queries

2003 May 24Clive Page Where units are needed Consider simple query like this: SELECT * from t1, t2 WHERE REGION(whatever) AND properMotion > 100 ; What does the 100 mean? Vizier collection has 231 tables containing proper motions:

2003 May 24Clive Page 0.01s/yr3 10-2arcsec/yr1 10-4arcsec/yr1 10-5s/yr6 10-6s/yr2 10mas/a2 10mas/yr4 10ms/yr3 arcsec/a6 arcsec/yr26 cs/yr2 mas/a10 mas/yr103 ms/a2 ms/yr11 s/a11 s/ha17 s/yr20 Us/yr1

2003 May 24Clive Page Units – Vizier example Vizier collection has 231 tables containing proper motions: These have 19 different units for it. IAU recommends using SI units where possible (with a few extensions for astronomy) SI unit of angular velocity is radians/second None of the 231 tables uses radians/second.

2003 May 24Clive Page Importance of supporting units The cone-search works only because the REGION keyword has the units of its parameters specified (degrees). Almost all other selections involving numerical quantities will be meaningless (or at the very least error-prone) without units information.

2003 May 24Clive Page Possible solution (1) Give astronomer information on units in each column OK for simple queries on one table Will not work in general for multi-table queries, as different tables will use different units. Would have to rely astronomers checking all necessary metadata before submitting a query.

2003 May 24Clive Page Possible solution (2) Use standard units in all interfaces Data access layer of DBMS has to do the conversion to/from units used in each column. Problems: –Will be hard to get agreement on standard units for hundreds of quantities –Different branches of astronomy have different conventions, e.g. flux in mJy, μJy. –SI units are approved by IAU, but rarely used –SI units with large scaling factors make browsing harder, errors much more likely.

2003 May 24Clive Page Possible solution (3) Allow users to specify units in queries Example SELECT … WHERE properMotion > 100 [mas/yr] Notation: –Suggest CDS notation, based on earlier work at GSFC which is compact, flexible, unambiguous, easy to read. –Would be nice to avoid the brackets, e.g. 100mas/yr but this will be hard to parse unambiguously. Problem: how does the VO system know what units are attributed to each column? –Answer: metadata queries.

2003 May 24Clive Page Requirements on system for unit-handling Need to find the units of each column: a metadata query. Need to parse the units strings in a query and apply the appropriate conversion functions. A few complications: –Do magnitudes have units, or as the logarithm of a ratio are they unit-less? –Functions in queries need special treatment, e.g. COS returns a unit-less value, ACOS always returns radians. –Some conversions cannot be exact, e.g. magnitudes to flux densities in Janskys. (Suggest: leave until later.)

2003 May 24Clive Page Metadata Queries VO opinion seems divided on whether metadata queries should be satisfied by the DBMS (via DAL?) or by the Registry. We need to invent an interface which can be implemented either way. One can regard the registry as a kind of cache of metadata. Absolutely minimal function: –What is the units string of column C of table T of database D at site S?

2003 May 24Clive Page Metadata query – desirable functionality Ask which databases are available at site S Ask which tables are in database D Ask which columns are in table T Ask for properties of a table: length, width, indexes available, astronomical metadata (epoch, equinox,...), curational metadata (version, author,...) Ask for properties of a column: name, data-type, units, nullability, UCD, short description, data range,... Provided these functions are supported, it does not matter whether the information comes from the DBMS or from the Registry.