NVO Summer School, Santa Fe Sept 20081 Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
Interop May 2007 Spectrum Data Model Jonathan McDowell.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
2004 Sepjcm/sao/nvo1 Spectrum Data Model Jonathan McDowell CfA US National Virtual Observatory.
SLAP: Simple Line Access Protocol v0.5
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, September Desktop Integration with VO VOClient, DALClient NVO Summer School, Aspen Sept 2006 Doug Tody (NRAO), Mike Fitzpatrick.
Sep 3, 2008NVOSS VO Analysis Using Local Utilities Mike Fitzpatrick NOAO.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sep 6, 2008NVOSS Desktop Messaging Mike Fitzpatrick NOAO.
Sep 3, 2008NVOSS Mobile VO Mike Fitzpatrick NOAO.
2008 NVO Summer School1 Image Visualization in the VO Doug Tody (NRAO) Francois Bonnarel (CDS) T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
14 Sep 2006NVO Summer School T HE US N ATIONAL V IRTUAL O BSERVATORY Simple SSA Query Kelly McCusker Amy Kimball Mike Koss Phil Warner Melinda Mello.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.
26 May 2004IVOA Interoperability Meeting - Boston1 Recommendations for Revisions to the VOResource XML Schema IVOA Registry Working Group.
VO Data Access Layer Working Group Summary IVOA Cambridge, UK 16 May 2003 Doug Tody, NRAO.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Science with the Virtual Observatory Brian R. Kent NRAO.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
Aladin, VO standards, spectra and datacubes T.Boch, F.Bonnarel, P.Fernique (CDS, Aladin development group)
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
● Link between : – the DALIA tool (Direct Approach to Spectral Line Analysis ) ● Generic Interface for Modelisation Codes – the Basecol database ● Use.
IVOA Interop, SL de El Escorial, Oct IVOA Data Access Layer Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
VO-enabled spectroscopy tools Ivo Busko Science Software Branch STScI.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Simple Image Access International VIRTUAL OBSERVATORY
VO tools and applications in a nutshell
Data Models: Plenary-1 Jonathan McDowell May 2006
Concluding Remarks Paolo Padovani Head, Virtual Observatory Project Office, ESO, Garching bei München, Germany & EURO-VO Facility Centre.
Google Sky.
Presentation transcript:

NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE

NVO Summer School, Santa Fe Sept Access to Spectroscopic Data in the VO

NVO Summer School, Santa Fe Sept Access to Spectroscopic Data in the VO Status –SSA standard completed late 2007 First of a family of spectrophotometric interfaces A number of SSA 1.0 services are now coming on line –Integration of client apps is underway –End-to-end testing and integration needed Analysis Tools –Specview, SPLAT, VOSpec, IRAF, TOPCAT, others –Various SED builders under development –Legacy software still needs to become VO-aware

NVO Summer School, Santa Fe Sept Types of Spectrophotometric Data One Dimensional Spectra –Addressed by Simple Spectral Access (SSA) –Most survey data is probably of this form –Worth treating as a special case Spectral Energy Distributions (SEDs) –SEDs are a vital tool for modern astronomical research Time Series Data –Not really spectral data; but it is not that simple Spectral/Time Data Cubes –A major data product in the future (and present) –Longslit spectra are related Spectral Line Lists (SLAP) –Access to observed and theoretical spectral line lists Complex Data –Aggregations of simpler datasets, e.g., 1-D spectra

NVO Summer School, Santa Fe Sept One Dimensional Spectra (SSA) Summary –Basic concept is a "simple" 1-D spectrum spectral coordinate, flux, error, quality flag, etc. –SSA includes both a query interface _and_ a spectrum data model mediation to a standard model for heterogenous spectra –Virtual data generation mediation, cutout, reprojection, dynamic extraction, etc. TSAP (theory spectra) is a good example –Data formats VOTable, FITS binary table, CSV, native XML, HTML, etc. a good service can return data in any of these formats Issues –How to treat multi-segment spectra, e.g., associations –Photometry model needs further work (in progress)

NVO Summer School, Santa Fe Sept Spectral Energy Distributions (SEDs) SEDs can be complex –Often generated by combining heterogeneous observations –Individual observations can be very large –Source confusion is a real issue –SEDs can (theoretically) be dynamically generated Current Concept –A SED is a primary data object (like Image, Spectrum) –Generic dataset metadata describes entire SED object –A uniform view (table) is presented summarizing all segments –Segments are data objects in their own right may be included directly in SED dataset, e.g., as resources large segments may be referenced via an acref URL Status –Main effort within NVO is by SAO, NED –Prototype using NED and Chandra data

NVO Summer School, Santa Fe Sept Time Series Data Summary –Spectrum and TimeSeries are closely related both are a series of photometric points current Spectrum data model almost works for both SSA has already been used as-is for time series data –Both can be multi-segment time series often revisit the same object repeatedly –Time series can be large, like a highres spectrum "cutout" capability required, as for Spectrum Current Concept –TimeSeries is a primary data object (like Image, Spectrum) –Common spectrophotometric data model –Custom data access interface

NVO Summer School, Santa Fe Sept Spectral/Time Data Cubes Summary –Data cubes are increasingly common with modern instruments radio interferometers, O/IR IFU/MOS instruments –Time cubes (synoptic imagery) are also important similar to Spectrum/TimeSeries relationship –Cubes can be very large typically 10 2 MB today, 10 2 GB not far off –Access required is complex subcube, 2-D plane or projection, slice, spectral filter, spectral extraction, etc. Possible Approach –Current plan is to extend image interface (SIA) to N-D –Parallels approach of using FITS for radio data cubes –IFU/MOS data may require a different approach (e.g., Euro3D)

NVO Summer School, Santa Fe Sept Complex Data Problem –How to deal with complex structured datasets for example, an Echelle or MOS observation Approach –Don't create ever more complex data models –Instead logically associate primary datasets SED segments are also an example of this approach –DAL query describes each primary dataset –Association metadata is used to logically associate these Advantages –Re-use primary data objects, such as 1-D spectrum –Standard tools can be used to access complex data –Same concept applies elsewhere in DAL; not just for spectra

NVO Summer School, Santa Fe Sept Spectrum Data Model Motivations –No standard way to represent spectra in astronomy –VO requires automated combination of data from many sources need to mediate external data to a standard model still provide access to native project data as well Not just for Spectra –SSA first of second generation DAL interfaces –Generic dataset metadata (DataID, Curation, Target, Char, etc.) –Used for both SSA query and actual spectral datasets References –SSA and Spectrum specifications –Spectrum data model spreadsheet –DALServer reference implementation

NVO Summer School, Santa Fe Sept Spectrum Data Model

NVO Summer School, Santa Fe Sept Spectrum Data Elements

NVO Summer School, Santa Fe Sept Dataset Characterization

NVO Summer School, Santa Fe Sept

NVO Summer School, Santa Fe Sept