IVOA, Kyoto May 16-20 20051 Simple Spectral Access SSA Query Interface Doug Tody (NRAO) Markus Dolensky (ESO) Et. al. International V IRTUAL O BSERVATORY.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
Interop May 2007 Spectrum Data Model Jonathan McDowell.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
16 October 2003IVOA Interoperability Conference Registry Working Group VOResource (v0.8.4) XML Schema defining core metadata applicable to all resources.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
SLAP: Simple Line Access Protocol v0.5
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
Practical Footprints bin/twiki/bin/view/IVOA/DALBasicFootprintHere Gretchen Greene, Jonathan Fay, Thomas Boch, Francois Ochsenbein,
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen 9-Sep Data Access Layer Doug Tody (NRAO) US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
NVO Summer School, Aspen 9-Sep TimeServer Andrew Drake Robyn Allsman David Gasson Mark Huber Kathy Vivas US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
14 Sep 2006NVO Summer School T HE US N ATIONAL V IRTUAL O BSERVATORY Simple SSA Query Kelly McCusker Amy Kimball Mike Koss Phil Warner Melinda Mello.
VGISCs view VGISC Uses Cases Geneva October 2005.
ICDT Optimal Distributed Declustering using Replication Keith Frikken Purdue University Jan 5, 2005.
May 9, September 2005, Barcelona, Spain Prioritization of Forestry Themes for the SRA Risto Päivinen.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Jeroen Stil Department of Physics & Astronomy University of Calgary Stacking of Radio Surveys.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
The need for a stronger IVOA review process An SDM+SSA correctness assessment Bruno Rino, Nov
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Scalable Metadata Definition Frameworks Raymond Plante NCSA/NVO Toward an International Virtual Observatory How do we encourage a smooth evolution of metadata.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Photometric Redshifts in Astro-Wise PhotRedCatalog Astro-Wise Workshop Leiden 2008 Jan Snigula, MPE.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
IVOA Interop, SL de El Escorial, Oct IVOA Data Access Layer Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
VOEvent and the Registry Introducing VOEventStream and VOEventService Roy Williams Caltech.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
© Roy Williams 2002 The Uphill Battle of Semantic Interoperability Roy Williams California Institute of Technology.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Simple Image Access International VIRTUAL OBSERVATORY
Standard Query Language for VO
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
PDAP Query Language International Planetary Data Alliance
Observation/dataset datamodel: Restart non-characterization efforts?
Google Sky.
Presentation transcript:

IVOA, Kyoto May Simple Spectral Access SSA Query Interface Doug Tody (NRAO) Markus Dolensky (ESO) Et. al. International V IRTUAL O BSERVATORY

IVOA, Kyoto May Concepts - Dataset-oriented Data object type –Spectrum, TimeSeries, SED Dataset creation type –AtlasWhole datasets, uniform survey data –Pointed Whole datasets, variable instrumental data –Cutout Subset, data samples are not modified –Resampled Subset, data samples computed by service Dataset derivation –Observed An observation –Composite Combination of several observations –Simulated Simulated observation made from real data –Synthetic Data from a theoretical model

IVOA, Kyoto May Concepts - Role of data model Multiple data models –VO spectral data model –external data models (project data in archive) Active data model mediation –map external data into VO data model –may involve some loss of project-specific information –but this is generally not needed for analysis –enables general multiwavelength analysis Separation of data model and data representation –same data object can be represented in multiple ways –multiple output formats (VOTable, FITS, text, etc.) Document-oriented vs object API

IVOA, Kyoto May Compliance Minimally compliant service –Implements HTTP GET interface –Input: at least POS, SIZE, FORMAT –Output: all MUST-provide metadata –Support for 1+ compliant output data format (e.g., VOTable) –Service metadata query Fully compliant –Input: all SHOULD-provide parameters –Output: all MUST-provide parameters Advanced service –Multiple interfaces (GET, WS, ADQL eventually) –Additional optional or service-defined input/output parameters –Can return data in any whatever format the client wants

IVOA, Kyoto May Basic Usage Simple query –POS, SIZE - like cone search –Possibly refined by spectral or time bandpass, etc. –Most metadata in query response is optional Data retrieval –URL-based –Get back a dataset (normally VOTable or FITS) –In simplest case could be wavelength, flux as text (for Spectrum) –Or external data pass-through

IVOA, Kyoto May Query Interface Mandatory query parameters –POSRA, DEC (ICRS) –SIZEdiameter (decimal degrees) –FORMATVOTable, fits, xml, text, graphics, html, external Should other parameters be mandatory? –e.g., BANDPASS, TIME, SPECRES, APERTURE

IVOA, Kyoto May Query Interface Recommended query parameters –BANDPASSwave1,wave2 (meters in vacuum; source or observer) –TIME data1,date2 (epoch in decimal years UTC) –APERTURE approx spatial resolution (decimal degrees) –SPECRES spectral resolution (meters) –TOP number of top-ranked records to return Should other parameters be recommended? –e.g., SNR, OBJTYPE, COLLECTION, CREATORID, PUBID

IVOA, Kyoto May Query Interface Optional parameters –OBJTYPEmandatory if service returns multiple object types –COLLECTIONdata collection identifier (short name) –CREATORID creator-assigned dataset identifier (at most 1) –PUBIDpublisher-assigned dataset identifier (at most N) –COMPRESSenable compression (for both data _and_ queries?) –SNR signal-to-noise ratio –REDSHIFT redshift range (dlambda/lambda) –TARGETCLASSstar, galaxy, pulsar, PN, QSO, AGN, etc.

IVOA, Kyoto May Query Interface Service-defined parameters –Service may define additional parameters describe in service metadata –Query-by-Utype has been suggested probably better to just do ADQL; need expressions etc.

IVOA, Kyoto May Query Response Format –VOTable –Utype used to identify interface elements Includes both protocol and data model –Standard metadata is in a flat table Optional extension metadata may be included

IVOA, Kyoto May Query Response Classes of query metadata –Query metadataDescribes the query itself –Dataset metadataDescribes data object; object-specific –Target metadata Astronomical target –Curation metadata External identification of dataset –Characterization Coverage, Accuracy, Frame, etc. –Instrument metadata Service-defined; hard to standardize –Access metadata Describes how to access the dataset

IVOA, Kyoto May Query Response Query Metadata –Query.ScoreHow well object matches query –Query.LNameLogical name (identifier) –Query.LNameKeyLogical name key (id-ref) Example: LName="MyObj123" LNameKey="server,format"

IVOA, Kyoto May Query Response Dataset Metadata –Dataset.Type Spectrum, TimeSeries, SED, etc. –Dataset.DataModel DM name, e.g., "SSA-V0.90" –Dataset.Title Brief descriptive title of dataset –Dataset.SSA.NSamples Total samples in dataset Dataset.SSA.Aperture Characteristic aperture diameter –Dataset.SSA.TimeAxis TimeCoord axis (external data) –.SSA.SpectralAxis SpectralCoord axis (external data) –Dataset.SSA.FluxAxis Flux axis (external data) –Dataset.CreationType atlas, pointed, cutout, resampled –Dataset.Derivation observed, composite, simulated, synthetic

IVOA, Kyoto May Query Response Target Metadata –Target.NameName of astronomical object –Target.Class Target class (star, galaxy, QSO, etc.) –Target.SpectralClassSpectral class (e.g., 'O', 'B', etc.) –Target.Redshift Nominal redshift for object –Derived.VarAmpl Variability amplitude (fraction 0-1) –Derived.SNR Observed signal to noise ratio

IVOA, Kyoto May Query Response Curation Metadata –Curation.CollectionData collection name (identifier) –Curation.Creator Creator identify (identifier) –Curation.CreatorID Creator-assigned dataset identifier –Curation.PublisherID Publisher-assigned dataset identifier –Curation.Date Dataset creation date (ISO date string) –Curation.Version Dataset version (within same ID)

IVOA, Kyoto May Query Response Characterization1 - Coverage –.Location.SpatialPosition (e.g., RA, DEC) –.Location.Time Observation time characteristic value –.Location.Spectral Spectral bandpass characteristic value –.Location.Spectral.BandID Bandpass ID (band or filter name) –.Bounds.Spatial Aperture footprint (polygon on sky) –.Bounds.Time Low/High time values –.Bounds.Spectral Low/High spectral values –.Bounds.Flux Limiting flux, saturation limit (Jansky) –.Fill.Spatial Spatial sampling filling factor (0-1) –.Fill.Time Time sampling filling factor (0-1) –.Fill.Spectral Spectral sampling filling factor (0-1)

IVOA, Kyoto May Query Response Characterization2 - Accuracy –Accuracy.*.Calibrateduncalibrated, relative, absolute –Accuracy.*.Resolution Resolution of measured signal –Accuracy.*.StatErr Statistical error (measured) –Accuracy.*.SysErr Systematic error (estimated) ('*' = Spatial, Time, Spectral, Flux)

IVOA, Kyoto May Query Response Characterization3 - Reference Frames –Frame.Spatial.TypeCoordinate frame (default ICRS) –Frame.Spatial.Equinox Coordinate system equinox (J2000) –Frame.Time.System Timescale (TT) –Frame.Time.SIDim SI factor and dimension –Frame.Spectral.SIDim SI factor and dimension –Frame.Flux.SIDim SI factor and dimension –Frame.Flux.UCD UCD of flux value (flux type) (These apply only to the query response) (SIDim metadata still under construction)

IVOA, Kyoto May Query Response Instrument Metadata –Instrument.NameInstrument name (identifier) –Instrument.Exposure Total exposure time (seconds) –Instrument. Service-defined Notes –Optional; provided for instrumental data collections –In general, Collection, Bounds.Time, etc. are preferred –In general Instrument metadata is service-defined –Use Observation model as a starting point

IVOA, Kyoto May Query Response Access Metadata –Access.ReferenceData access URL –Access.Format MIME type of returned dataset –Access.Size Approximate dataset size (bytes) –Access.Server Server endpoint URL Staging support goes here in the future –e.g., will dataset access require asynchronous staging –estimated cost to construct dataset

IVOA, Kyoto May Service Metadata Usage –Describe service type and capabilities –Characterize service (data resources served, coverage, etc.) –Describe interface (optional query parameters) Interface –Requires new service metadata query method –Returns resource metadata descriptor (XML) Issue: –Registry resource descriptor (XML) or VOTable as in SIA?

IVOA, Kyoto May SSA/SED Data Model Issues #1 What is the overall concept? –SSA sees Datasets of several types Spectrum, TimeSeries, SED are all top-level Dataset objects Most metadata in the query response applies to all datasets –SED Model SED model sees Spectrum, TimeSeries as special case of SED Model a class of spectral data or model SEDs? Segment is core of spectral (SED) data model

IVOA, Kyoto May SSA/SED Data Model Issues #2 Subclassing vs aggregation –Class root is Dataset –Subclass Image, Spectrum, etc. –Aggregate component data models to model each type dataset Component Models –Why [SSA,SED].Segment.Coverage instead of just Coverage? –Query, Dataset, Curation, Coverage, etc. are components –Can be reused in both SSA query response and in dataset object