Unified Content Descriptors Semantic types for astronomy Roy Williams, California Institute of Technology.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

BEIJING IVOA Meeting – 14/18 May 2007 Publishing FITS files and VOtables in the VO with.
May 18, 2006IVOA Interoperability Meeting Fine-grained vs. Coarse-grained Registries or How much detail about a resource should be stored in a registry?
UCDs Notes on discussion 2003 October 16 14:00 – 16:00.
F.Ochsenbein, P. Fernique [CDS] Aladin V3 script mode for the VO.
Interoperability meeting S. Derriere, Strasbourg, 2003 October UCD2... When all you have is a hammer every problem looks like a nail. Registry,
16 October 2003IVOA Interoperability Conference Registry Working Group VOResource (v0.8.4) XML Schema defining core metadata applicable to all resources.
A few notes on JVOQL François Ochsenbein. JVOQL: a few questions FROM clause: not clear how to specify the list e.g. FROM clause: not clear how to specify.
VOEvent An Information Infrastructure for Immediate Astronomical Events Roy Williams NVO co-director.
A.Micol IVOA Registry REGISTRY WG Mar 2003 A Science Case (and 1000 Questions) for the IVOA Registry.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
VO Standards and Protocols XML VOTable UCD ConeSearch Roy Williams California Institute of Technology NVO co-director.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
An International Virtual Observatory data exchange format VOTable Roy Williams François Ochsenbein Clive Davenhall Daniel Durand Pierre Fernique David.
Metadata in the TAP context (1) The Problem: learn about which tables, tablesets,... are available from a TAP server for each of the tables / tablesets,
UCD inheritance in VOTables François Ochsenbein. 11 May 2003 François Ochsenbein Summary 1. Alternative propositions 2. impact of the notion of column.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
CH-4 Ontologies, Querying and Data Integration. Introduction to RDF(S) RDF stands for Resource Description Framework. RDF is a standard for describing.
The Semantic Web – WEEK 4: RDF
RDF Tutorial.
5-6 Dec 2005 VOEvent II Workshop1 VOEvent Specification, v1.0 T HE US N ATIONAL V IRTUAL O BSERVATORY Rob Seaman, National Optical Astronomy Observatory,
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
Module 2b: Modeling Information Objects and Relationships IMT530: Organization of Information Resources Winter, 2007 Michael Crandall.
RDF (Resource Description Framework) Why?. XML XML is a metalanguage that allows users to define markup XML separates content and structure from formatting.
26 May 2004IVOA Interoperability Meeting - Boston1 Recommendations for Revisions to the VOResource XML Schema IVOA Registry Working Group.
VOTable: Tabular Data for Virtual Observatory François Ochsenbein Roy Williams Clive Davenhall, Daniel Durand, Pierre Fernique, Robert Hanisch, David Giaretta,
S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.
The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
Web Services for Earth Science Data Edward Armstrong, Thomas Huang, Charles Thompson, Nga Quach, Richard Kim, Zhangfan Xing Winter ESIP 2014 Washington.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Hello!. International Virtual Observatory Alliance Ajit Kembhavi, IUCAA, Pune.
Virtual Observatory & LIGO Roy Williams California Institute of Technology.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
1 Metadata –Information about information – Different objects, different forms – e.g. Library catalogue record Property:Value: Author Ian Beardwell Publisher.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
IVOA Interoperability MeetingBoston, 2004/05/23-28 IVOA plenary session UCD R. Williams, S. Derriere, and the UCD folks.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
IVOA Interoperability MeetingUCD Session – 2004/05/26 S. Derriere UCD services.
ADQL/s Syntax (Proposal) -- towards unification of ADQL, SIAP, SSAP, SXAP Yuji SHIRASAKI National Astronomical Observatory.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
24-28 May 2004Interop Meeting1 Realization of UCD1+ Andrea Preite Martinez Sébastien Derriere CDS.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
Discussed in Kyoto Schema changes for the next version (Gerard Lemson)  will be included in VOTable1.2 Schema changes for the next version (Gerard Lemson)
F. Genova, VO as a Data Grid, 2003/06/301 Interoperability of astronomy data bases Françoise Genova, CDS.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
Report of UCD Working Group Roy Williams Caltech.
VOEvent and the Registry Introducing VOEventStream and VOEventService Roy Williams Caltech.
Determination of radio spectra from catalogues and identification of Gigahertz peaked sources (GPS) from the Virtual Observatory Bernd Vollmer, S. Derriere,
Chapter 2 Data in Science. Section 1: Tools and Models.
VOTable agenda Current VOTable status News from Applications Referring STC (as a data model example) Relations between s Questions about VOTable schema.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
© Roy Williams 2002 The Uphill Battle of Semantic Interoperability Roy Williams California Institute of Technology.
Subjects in the FR family
Standard Query Language for VO
The state of VOEvent semantics THE US NATIONAL VIRTUAL OBSERVATORY
UTYPES Jonathan McDowell.
Presentation transcript:

Unified Content Descriptors Semantic types for astronomy Roy Williams, California Institute of Technology

History Created at CDS Strasbourg (the first VO prototype) Harvested From 5000 tables, table columns To create ~450 UCD words Example –pos.eq.ra means right ascension –think of a UCD as a semantic type: int n; float x; pos.eq.ra alpha;

UCD is a semantic type (not a name) pos.eq.rapos.eq.decpos.eq.rapos.eq.dec alpha1delta2delta1alpha2 name ucd example: tablae of double stars

Summary UCD is inherently fuzzy –does not contain all metadata UCD is a description, not a unique name UCD already works –easy to shoot at! UCD is mined from large amount of metadata –phenomenological, not opinion Natural Language UCD Data Model Richer, Fuzzier Thinner, Exact

Why is UCD useful Finding table attributes Aladin can draw based on UCD info Cone search demands UCD labelling of output Searching a registry that has tables –Relevance of a table based on its UCDs –Registry metadata for some data types defined with UCDs VOResource includes VOTable, which has UCD description of table attributes. Do this with a Matching Function –Which UCD matches best the UCD I am looking for? Data exchange from legacy systems

UCD and utype UCD is a type, struct Myposition { pos.eq.ra alpha;....} utype is a data-model-part struct VOStandardPosition { float RA;...} standard meaning

General Syntax of IVOA UCD [namespace:] w.o.r.d; [namespace:] w.o.r.d;.... Character set is –A-Z, a-z, 0-9, hyphen, + 3 special –No white space –Case insensitive Three special characters. period for hierarchy : colon for namespaces ; semicolon for separating words

UCD Tree arith Quantities related to arithmetic and mathematics, including count, difference, ratio em The electromagnetic spectrum meta Quantities related to metadata, such as identifiers, flags, notes, URL, and instr Quantities related to an instrument; typical sub-levels are telescope, observatory, etc. obs Observation methods such as detector, filter, plate, spectrograph, exposure time, etc. phot All photometric measurements, organized according to the wavelength; includes polarization. phys Generic physical quantities, such as length, velocity, mass, and including atomic & molecular concepts and properties, temperature, pressure, gravity, etc... pos Position in the sky, reference frames; including equatorial, galactic etc coordinates; geocentric, heliocentric etc; and precession and nutation. spect Quantities related to spectroscopic measurements src Properties of the observed source of radiation: source classifications and morphology, extension in the sky, variability, stat Statistical quantities and quantities related to model fitting, including concepts such as error, maximum, residuals. time Quantities related to time.

Multiple words QuantityUCD Magnitudephot.mag Flag (weather, reliability, etc) meta.code; phot.mag Error on magnitudestat.error; phot.mag Maximum temperature of an instrument phys.temperature; instr; stat.max Error of a V-band magnitudestat.error; phot.mag; em.opt.V First word: what semantic type is this thing? -- other words are helpers

Names need a Namespaces We took the table and chair dimensions, and wrote them in a table. Namespace = furniture Namespace = wordProcessing FITS keywords have no namespace! What does TARGET mean?

Namespaces –Introduce special character colon : –example: mynamespace:em.opt.myfilter –Default namespace is ivoa –Should be an attempt to integrate to core –UCD committee –Example: SIAP 1.0 has VOX namespace –VOX:Image_AccessReference (should be meta.ref) –VOX:WCS_CoordRefPixel (should be pos.wcs.crpix)

Cone Search service request is a cone service response is a table: meta.idpos.eq.rapos.eq.dec blahblahbananafoobarsyzygy Must have 3 columns with these UCDs May be other columns

UCD Use cases Subclassing a table Table that has columns of specified UCD –eg Conesearch, SIAP Aladin [phot.mag*] < 16 {draw circle [phot.mag]} exact syntax experiments with other template-action language generation through GUI Aladin as a framework – wider development Other matching function template/action

Matching Function Given two UCD, the matching function expresses how alike: –double mu (u1, u2) [0,1] I want a table column like this –maximize mu over available UCD How to construct mu? Example: mu ( pos.eq.ra;src.galaxy stat.error;pos.eq.ra )

Concept & Property Idea of Galaxy Particular Galaxy: M31 Velocity 120 km/sec Class Instance ConceptProperty

What is a table galaxyvelocity M31 NGC 3039 M km/s 350 km/s 448 km/sec the velocity of M31 is 120 km/s the velocity of NGC3039 is 350 km/s the velocity of M51 is 448 km/s class instances a table is a set of statements

UCD Tools (from CDS Strasbourg) Tree browser Natural language to UCD Explain a UCD

VOTable/VOEvent Uses UCD to indicate what has been observed

VOEvent Types of objects –BH, burster, AGN, etc etc Types of events –SNe, GRB, lensing event, flare, etc etc Use cases –Shall I observe this/ –Probabilistic interpretation –Has interpretation changed with follow-up?

Semantics RDF (Resource Description Framework) statements are triples: –Resource Related-to Resource –(Cat Is-instance-of Animal) –(Sigma Is-standard-deviation X) –(RA is-member-of position), (Dec is-member-of position) –T has-UCD phys.temperature Could use UCD for deduction –Create SED from magnitudes –Grouping parameters to make complex object »eg error ellipse as errX, errY, covXY

RDF Resource Description Framework is for describing and exchanging metadata Roy Williams = Author ( Example of an RDF statement predicate subject object Roy Williams Resource or literal Resource