1 15.11.2006 AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.

Slides:



Advertisements
Similar presentations
Common Instrument Middleware Architecture and Federation of Instrument Resources for X-ray Crystallography Rick McMullen Indiana University.
Advertisements

© Copyright 2008 All rights reserved 2 VO-India Project Started in 2002 as a collaboration between IUCAA and Persistent Systems Ltd. Part of International.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.
Remote Visualisation System (RVS) By: Anil Chandra.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
Australian Virtual Observatory Pacific Rim Applications and Grid Middleware Assembly The 4th Workshop 5th-6th June 2003 Monash University David Barnes.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
Physical design. Stage 6 - Physical Design Retrieve the target physical environment Create physical data design Create function component implementation.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
SCEC: An NSF + USGS Research Center ShakeAlert CISN Testing Center (CTC) Development Philip Maechling Information Technology Architect Southern California.
March 2004 At A Glance ITOS is a highly configurable low-cost control and monitoring system. Benefits Extreme low cost Database driven - ITOS software.
Advance Computer Programming Java Database Connectivity (JDBC) – In order to connect a Java application to a database, you need to use a JDBC driver. –
05/24/2004The 12th UN/ESA Workshop on Basic Space Science Chinese Virtual Observatory (China-VO) Chenzhou Cui Chinese Virtual Observatory Project National.
OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.
VO & Astro-Wise & others A.Belikov OmegaCEN
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Science with the Virtual Observatory Brian R. Kent NRAO.
Handling 3D Data in the Virtual Observatory
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
AIP E-Science. 2 AIP Workshop Globus-Hands-On AIP: E-Science E-Science:  AstroGrid-D  GAVO  Support for Collaborative working.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
Astronomical Spectroscopy and the Virtual Observatory ESAC, March 2007 VO tools and cross-calibration Pedro García-Lario European Space Astronomy.
11/26/2003IVOA Small Projects Meeting Potential R&D focuses for China-VO Chenzhou Cui National Astronomical Observatory of China Chinese Virtual.
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
Wiss. Beirat AIP, ClusterFinder & VO-Methods H. Enke German Astrophysical Virtual Observatory ClusterFinder VO Methods for Astronomical Applications.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Integration of Astro-WISE with Grid storage.
Workshop Garching, June 27 – July Statistical Cross-Matching Across Distributed Archives H.-M. Adorf & GAVO Team MPI f. extraterrestrische Physik.
The CoRoT ground-based complementary archive The CoRoT ground-based complementary archive Monica Rainer, Ennio Poretti M. Rosa Panzera, Angelo Mistò INAF.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
March 1st, 2006Prospective PNG PNG: Databases - Virtual Observatory.
Grid Based Chinese Virtual Observatory System Design Chenzhou CUI, Yongheng ZHAO National Astronomical Observatories, Chinese Academy of Sciences
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Pipeline Basics Jared Crossley NRAO NRAO. What is a data pipeline?  One or more programs that perform a task with reduced user interaction.  May be.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Evanthia Hatziminaoglou, ESO - Garching Virtual Observatory Info-Workshop, SOFIA January 2008 VO Tools Overview.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
1 eScience in Astronomy: Grid & VO GAVO III KickOff eScience in Astronomy: VO & GRID eScience: making the most advanced tools of IT available to scientists.
Simulation Databases for the Virtual Observatory Work in progress and application to the StarFormat Project Patrick Hennebelle Franck Le Petit Benjamin.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
1 Workflows Access and Massage VO Data José Enrique Ruiz on behalf of the Wf4Ever Team IVOA INTEROP SPRING MEETING 2013 HEIDELBERG, MAY16th 2013.
Science Gateway- 13 th May Science Gateway Use Cases/Interfaces D. Sanchez, N. Neyroud.
JENAM 2008 Theory Standards for the Virtual Observatory SimDB + SimDAP.
Metadata for the SKA - Niruj Mohan Ramanujam, NCRA.
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
Middleware independent Information Service
Emerging Trends in Information Technology
Databases, Web Pages and Archives
Observing with Modern Observatories (the data flow)
Google Sky.
Presentation transcript:

AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives and datasources Virtual Observatoy compatible  Software  Tools  Database-Interfaces  User-Interfaces AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives and datasources Virtual Observatoy compatible  Software  Tools  Database-Interfaces  User-Interfaces

GAVO & AstroGrid-D

GAVO Projects within the AstroGrid-D Goal: Develop example and standard procedures to combine the typical process of data reduction and processing, using the AstroGrid-D and GAVO tools & standards. Goal: Develop example and standard procedures to combine the typical process of data reduction and processing, using the AstroGrid-D and GAVO tools & standards.

RAVE „Radial Velocity“ survey, collecting stellar spectra of 1 Mio local stars to measure radial velocity, metallicity and abundance ratios. Website running, data base growning continously. Currently only photometric data available. „Radial Velocity“ survey, collecting stellar spectra of 1 Mio local stars to measure radial velocity, metallicity and abundance ratios. Website running, data base growning continously. Currently only photometric data available. GAVO Projects: Necessary technical updates of already running VOTable webservice (switch to JDBC) Enlarge data base to include rave spectra: internally / for public use Decide about VO standard protocol for spectra: SDM („spectral data model“) versus SSA („simple spectrum access“) for RAVE data Use the AstroGrid-D to execute the RAVE data reduction pipeline Use synergy with the GAIA satellite project GAVO Projects: Necessary technical updates of already running VOTable webservice (switch to JDBC) Enlarge data base to include rave spectra: internally / for public use Decide about VO standard protocol for spectra: SDM („spectral data model“) versus SSA („simple spectrum access“) for RAVE data Use the AstroGrid-D to execute the RAVE data reduction pipeline Use synergy with the GAIA satellite project

Robotic Telescopes Automated data retrieval and storage of raw data Data reduction using the grid, reduced data stored in VO compliant data base Analyse and evaluate reduced data using VO tools RTML - RDF translation as first step for resource integration of RT into the Grid Develop interface to enable astronomer to easily specify new targets (for RT) using VO standards and tools Later: event-triggered observations with RT ( VOEvent ) Automated data retrieval and storage of raw data Data reduction using the grid, reduced data stored in VO compliant data base Analyse and evaluate reduced data using VO tools RTML - RDF translation as first step for resource integration of RT into the Grid Develop interface to enable astronomer to easily specify new targets (for RT) using VO standards and tools Later: event-triggered observations with RT ( VOEvent )

More Projects Implement simple data distribution methods for the common case of serialized data reduction using the grid Add simple access interfaces for VO compliant publishing of reduced data by individual astronomers Simplify publishing of single, ground based observations: Solar regions, spectra of bright stars. Increase amount of comparible data in these fields LOFAR: Solar Science Data Center at AIP GlowGrid: Event based observations with remote LOFAR stations Implement simple data distribution methods for the common case of serialized data reduction using the grid Add simple access interfaces for VO compliant publishing of reduced data by individual astronomers Simplify publishing of single, ground based observations: Solar regions, spectra of bright stars. Increase amount of comparible data in these fields LOFAR: Solar Science Data Center at AIP GlowGrid: Event based observations with remote LOFAR stations

E3D - Archives

E3D - Archives MetaData-Description E3D-data are stored in FITS-Format  Fits contains a WCS-description suitable for VO- Table COOSYS-Array Problem: WCS in the fits-file  refers to the AG, ie the Telescope, not to the  objects in the cube Problem: the IFU normally have different characteristics, those are (afaik) not stored in the E3D-format  E3D-fits-files are supposed to have instrument- characteristics removed via processing the raw data  Still to be defined: error-margins for processed data MetaData-Description E3D-data are stored in FITS-Format  Fits contains a WCS-description suitable for VO- Table COOSYS-Array Problem: WCS in the fits-file  refers to the AG, ie the Telescope, not to the  objects in the cube Problem: the IFU normally have different characteristics, those are (afaik) not stored in the E3D-format  E3D-fits-files are supposed to have instrument- characteristics removed via processing the raw data  Still to be defined: error-margins for processed data

E3D - Archives MetaData & VOTable-Conversion (aside of WCS-issue):  VOTable has no notion of spaxels  standard conversion tool for FITS-Header to VOTable-Header (aka MetaData) still missing  Standard set of MetaData for E3D to be defined  E3D-fits-file can be included into VOTable as a binary-tag (Is this what is desired?) MetaData & VOTable-Conversion (aside of WCS-issue):  VOTable has no notion of spaxels  standard conversion tool for FITS-Header to VOTable-Header (aka MetaData) still missing  Standard set of MetaData for E3D to be defined  E3D-fits-file can be included into VOTable as a binary-tag (Is this what is desired?)

E3D - Tool and Archives E3D-Archives Basic features  ConeSearch  Metadata-Description  VOTable-Conversion Advanced Features:  Spectrum-Extraction  SED-Creation  Slicing E3D-Archives Basic features  ConeSearch  Metadata-Description  VOTable-Conversion Advanced Features:  Spectrum-Extraction  SED-Creation  Slicing

E3D-Tool : Features main window

E3D-Tool Features I/O  read & write E3D  read & write RSS (row stacked spectra)  read & write CUBE  import & export slit-spectra  export wavelength-cuts of RSS I/O  read & write E3D  read & write RSS (row stacked spectra)  read & write CUBE  import & export slit-spectra  export wavelength-cuts of RSS

E3D-Tool Features spaxel-inspector  visualisation of previously selected slices of the datacube  (single or hash of spaxels)  plots intensity statistics (relative to selection)  Allows spectra-inspector to plot spectra of selected spaxels spaxel-inspector  visualisation of previously selected slices of the datacube  (single or hash of spaxels)  plots intensity statistics (relative to selection)  Allows spectra-inspector to plot spectra of selected spaxels