Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop January 24-25, 2008

ESO Overview Publish images and spectra of a given survey:  Setup data centre infrastructure  Populate an archive & search index  Setup and register services  Access services

ESO Data Centre Components File Store Meta Data Repository Registry VO Client SSA Service SIA Service VO IFs: RI, SIA, SSA, UCD, VOTable

ESO Data Ingest/Homogenezation DB FITS files keyword mapper database mapping definition database mapper specific data models per observing mode analysis codes... homogenization mapping unit conversion compute values... keyword mapping definition observatory specifics policy (business logic) bookkeeping...

ESO Simple Access Protocols  SIAP –Protocol defining an uniform interface for retrieving image data from a variety of astronomical image repositories. A query defining a rectangular region on the CAR frame is used to query for candidate images. The service returns a list of candidate images formatted as a VOTable. For each candidate image an access reference URL may be used to retrieve the image.  SSAP –Protocol defining an uniform interface to remotely discover and access one dimensional spectra. SSA is based on a more general data model capable of describing most tabular spectrophotometric data, including time series and spectral energy distributions (SEDs) as well as 1-D spectra. Defines spatial (cone region), temporal, spectral and format queries.

ESO Workflow Software Installation Software Installation Metadata Extraction and Ingestion Process Metadata Extraction and Ingestion Process Database setup Database setup  create SQL tables Mapping editor Mapping editor  get sample FITS file header per data type  define mappings between FITS keywords and IVOA data model parameters  test mappings against sample FITS file headers MEx MEx  ingest FITS into database Creation of services to access the data Creation of services to access the data

ESO Workflow Listing Sample Headers Mappings Metadata Repository SIA Setup SSA Setup DAL Service Query Client Tools Response/Retrieval 1. Ingestion: 2. Access: yes no more yes no more FITS Data Inventory Head DM Mapping Homogeniz. SkyIndex

ESO Hands-on session Workflow step by step instructions step by step instructions Software Installation Software Installation Metadata Extraction and Ingestion Process Metadata Extraction and Ingestion Process Database setup Database setup Mapping data Mapping data MEx (ingest data) MEx (ingest data) Access the data Access the data

ESO Mapping editor Defines FITS keyword mapping by running the mapping engine against a sample FITS header

ESO ESO guidelines  To publish data in VO compliant way:  Data items required for image data:  Data items required for spectral data:

ESO Access the data  Query the ESO SIA Service –Metadata query Metadata queryMetadata query –Regional query Regional queryRegional query  Query the ESO SSA Service –Metadata query Metadata queryMetadata query –Regional query Regional queryRegional query –Temporal query Temporal queryTemporal query

ESO Mapping Editor

ESO SIA METADATA response

ESO SIA Positional Query

ESO SSA METADATAresponse

ESO SSA Positional Query

ESO SSA Positional Query

ESO Acknowledgment  Data of Great Observatories Origins Deep Survey  CDS unit conversion library & Aladin client  VOTech sponsored metadata extraction code  ESO/DMO/VOS utilities and libraries

ESO