Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.

Slides:



Advertisements
Similar presentations
VOTable 2005 Discussion Summary and Roadmap. Agenda Description of some applications dealing.
Advertisements

A VO experience: Lessons learnt from accessing SIA compliant image servers with the AVO prototype F.Bonnarel on behalf of M.Allen, T.Boch, M.Dolensky,
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE May 14, 2013 Registry Coverage * Status and Necessity Gretchen Greene 1Apps IV/ Registry I Session -
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
DM WORKING GROUP MADRID OCT WG STATUS Spectral DM: document updated and reformatted Spectral DM Java library prototype nearly ready Characterization:
May 18, 2007TIG, closing plenary Conclusions from theory IG sessions, Beijing 2007.
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
Characterization 2 and Provenance data models. Use cases and first roadmap F.Bonnarel (CDS)
Interop May 2007 Spectrum Data Model Jonathan McDowell.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
2004 Sepjcm/sao/nvo1 Spectrum Data Model Jonathan McDowell CfA US National Virtual Observatory.
SLAP: Simple Line Access Protocol v0.5
SIAP Extensions F.Bonnarel, T.Boch, P.Fernique M.Louys, P.Osuna,J.Salgado.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
A centre of expertise in digital information management UKOLN is supported by: XML and the DCMI Abstract Model DC Architecture WG Meeting,
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
IVOA Interoperability Meeting – Victoria, BC – 18 May 2006 Data Discovery and Metadata Query Using Characterisation DM Igor Chilingarian (CRAL Observatoire.
Web Database Design Session 6 and 7 Matakuliah: Web Database Tahun: 2008.
Metadata Understanding the Value and Importance of Proper Data Documentation Exercise 2 Reading a Metadata File Exercise 3 Using the Workbook Exercise.
Metadata Harvesting The Hague, 13 & 14 January 2009 Julie Verleyen Scientific Coordinator, Europeana Office EuropeanaLocal Knowledge Sharing Workshop.
IVOA Interop Beijing, DM I Analysis of Characterisation in Domain Model Context With application to (SNAP) simulations Gerard Lemson DWith feedback.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
The need for a stronger IVOA review process An SDM+SSA correctness assessment Bruno Rino, Nov
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Handling 3D Data in the Virtual Observatory
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
Victoria, May Closing plenary Theory Interest Group Closing plenary Victoria, May
Aladin, VO standards, spectra and datacubes T.Boch, F.Bonnarel, P.Fernique (CDS, Aladin development group)
11 F.Bonnarel (CDS) Kyoto IVOA Interoperabilty Meeting DAL: a mechanism for Metadata extensions F.Bonnarel In behalf of T.Boch, M. Louys, P.Fernique (CDS)
Creating a FRBRized Data Structure in XML Jenn Riley Metadata Librarian Indiana University Digital Library Program.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
WIGOS Data model – standards introduction.
Discussed in Kyoto Schema changes for the next version (Gerard Lemson)  will be included in VOTable1.2 Schema changes for the next version (Gerard Lemson)
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
IVOA, Trieste, DM Gerard Lemson SimDB Data Model IVOA interop, DM WG session Trieste,
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Obscore DM v 1.1 Mireille Louys, Doug Tody, Patrick Dowler, Daniel Durand, Laurent Michel, François Bonnarel, Alberto Micol and the IVOA DataModel working.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
Chapter 29. Copyright 2003, Paradigm Publishing Inc. CHAPTER 29 BACKNEXTEND 29-2 LINKS TO OBJECTIVES Attach an XML Schema Attach an XML Schema Load XML.
WELCOME TO OUR PRESENTATION UNIFIED MODELING LANGUAGE (UML)
Data Models: Plenary-1 Jonathan McDowell May 2006
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
DAL concluding remarks
SDMX Information Model
Google Sky.
Aladin V5 T.Boch, F.Bonnarel, P.Fernique, A.Oberto
Utypes for Model Referencing
Item 7.3 (b) SDMX for UOE data collection
UTYPES Jonathan McDowell.
Footprint Service Specification
SDMX IT Tools SDMX Registry
Presentation transcript:

Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.

M.Louys, DM Characterisation, Interop Madrid 2005 Data Models Interaction Observation Characterisation

M.Louys, DM Characterisation, Interop Madrid 2005 Summary The main concepts needed to characterise an observation are now fully described –Property/Axis perspective –Each item can be developed as a hierarchy: increasing levels of details All properties and all axes are treated similarly –Unified framework This structure helps to cope with evolution: it allows to add new types of metadata in the future.

M.Louys, DM Characterisation, Interop Madrid 2005 General outline

M.Louys, DM Characterisation, Interop Madrid 2005 Categorising Use cases complexity (1) In terms of use cases : I.Data discovery and selectionlevel Multi regime, multi data type Xmatch of metadata to navigate between complex datasets: cubes, spectra, images, catalogs … Experienced in Aladin, FOV descriptions, SAADA customisable database environment II.Advanced data processing level 4 Physical interpretation, recalibration Description of side products to help for data interpretation: PSF variation, transmission curve, quality maps, etc…

M.Louys, DM Characterisation, Interop Madrid 2005 Categorising Use cases complexity (2) In terms of data types –More complex axes: spatial, spectral, time, observable + polarimetry, velocity, visibility –Dependencies along different characterisation axes R esol=f(pos, em) –More expertise for specific regimes as radio, polarimetric data. Schedule Version 1.0 to describe the top 3 levels and Version 2.0 to model the level 4 in details.

M.Louys, DM Characterisation, Interop Madrid 2005 New features: Errors on the data We plan to code all the characterisation items via container classes from STC or/and Quantity data models. Each assessed property will have the required value, unit, ucd, fields plus an error on this value. The typical error on the data, that is the error we make when we map sampling elements to coordinates, is also needed. –Here we accomodate astrometric error, photometric error, etc… –They will be attached to the axis on which the mapping is done: spatial, observable, etc… Valid for both systematic and statistical errors.

M.Louys, DM Characterisation, Interop Madrid 2005 Axis description and mapping error

M.Louys, DM Characterisation, Interop Madrid 2005 New features : Sampling For the SamplingRefVal class (level1) attributes – samplingPeriod : records here the value of the sampling period along the axis in question. –sampleExtent : an average estimation of the bin size along the characterisation axis. –documentation : a url to point to some description of the sampling process, for instance. methods getNyquistRatio() resolutionRefval and sampleExtent

M.Louys, DM Characterisation, Interop Madrid 2005 Using the data model Utypes are derived from the hierarchical structure Charaterisation XML Schema From these we can : instantiate description of real data –As VOtable document,with Utypes references, –As XML documents

M.Louys, DM Characterisation, Interop Madrid 2005 Implementations (to do) DAL VOtable+Utypes SIA 1.1 can provide implementation as Using GROUP and FIELDS –Level 1 & 2 –Level3 and 4, developped in extensions Web services Xml schema compliant or VOTABLE +Utype Interface Aladin with a web service providing the full characterisation of the observations available in the server via get and SOAP methods Use case exemple: On-the-fly SED construction from Vizier sources –Select radio sources from catalogs –Point to the related observations from Aladin and get characterisation metadata –Check for location, error and resolution on spatial axis, bounds on spectral axis –Use the characterisation values to validate the source type with respect to a radio source model (error bars)

M.Louys, DM Characterisation, Interop Madrid 2005 Conclusion Characterisation DM is now complete and usable The logical structure of the XML schema is ready. Different instances documents of the schema produced. –3D IFU by Igor Chilingarian Implementations are taking place Characterisation draft to be issued end of October.