Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,

Slides:



Advertisements
Similar presentations
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Advertisements

VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
AstroGrid: Past, Present & Future Bob Mann Institute for Astronomy & National e-Science Centre University of Edinburgh.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK Dec 2004.
A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.
A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.
AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid and Euro-VO Technology Centre Project.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.
AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 21 September 2006 AHM 2006 Nottingham.
Birmingham/Warwick AstroGrid Science Workshop Meeting Goals Silvia Dalla Oct 10-11, 2006.
Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.
A PPARC funded project AstroGrid Architecture Consortium Meeting, Leicester, 3 rd Nov 2003.
A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
EdSkyQuery-G Overview Brian Hills, December
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.
AstroGrid: Science Use Ready AstroGrid: Science Use Ready Nicholas Walton AstroGrid Project Scientist IoA, Cambridge A PPARC funded project.
NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.
AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
Solar-B Global DataGrid Update for AstroGrid SAG 10 RALMSSL Tim Folkes Elizabeth Auden Jens Jensen Paul Lamb Matthew WildMatthew Whillock Len Culhane Elizabeth.
A PPARC funded project Tony Linde Programme Manager AG-SAG FM6 Programme Manager Report Wed 25-May, 2005 UCL.
AstroGrid: The UK’s Virtual Observatory Dr Dugan Witherick – Astrophysics Group, UCL Wednesday 5 th December 2007 The University of Warwick.
1 10-June-2004Andy Lawrence : PPARC data curation panel meeting AstroGrid, Data Centres, & Edinburgh What is curation ? Data Centres in the VO era Data.
Understand how the future will work exchange information on key projects understand PPARC priorities debate (conclude?) community approach to the PPARC.
18 November 2004AstroGrid Solar Movie Maker VOTechKick-off VOTech Kick-off Meeting AstroGrid Solar Movie Maker Deploying SolarSoft IDL tools with CEA Elizabeth.
Astronomical Data Archiving and Curation Clive Page AstroGrid Project University of Leicester 2004 March 22.
A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
Solar and STP science with AstroGrid Silvia Dalla School of Physics & Astronomy, University of Manchester A PPARC funded project.
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid
A PPARC funded project PM Report AstroGrid Project Meeting Cambridge April 2004.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
A PPARC funded project Tony Linde Programme Manager AG-SAG FM5: AG2/VOTech Scope & Targets Glasgow, 7 Feb 2005 VOTech Project.
1 8-Jun-2004Andy Lawrence : PharmaGrid talk, Diessenhofen The Virtual Observatory The VObs concept The structure of the VObs Standards, Standards, Standards.
A PPARC funded project Workflow in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
AstroGrid How to make your data famous OR One-click PhD creation.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.
A PPARC funded project Astro-Wise meeting April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
The Large Synoptic Survey Telescope Project Bob Mann Wide-Field Astronomy Unit University of Edinburgh.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
Solar and STP with AstroGrid Silvia Dalla School of Physics & Astronomy, University of Manchester A PPARC funded project.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
AstroGrid and the Virtual Observatory John Taylor Institute for Astronomy.
1 14-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh Meeting Goals review achievements review architecture identify targets for AG2 and.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
AstroGrid and Virtual Observatories for Radio Interferometry arrays/ proposals Anita Richards Paul Harrison Noel Winstanley (Jodrell Bank Centre for Astrophysics,
MSSL Astrogrid Workshop
E.C. Auden1, J.L. Culhane1, Y. P. Elsworth2, A. Fludra3, M. Thompson4
DUCKS – Distributed User-mode Chirp-Knowledgeable Server
Google Sky.
CEA Experiences Paul Harrison ESO.
Presentation transcript:

Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy, University of Manchester, UK  Institute of Astronomy, University of Cambridge, UK A PPARC funded project

What is AstroGrid?  A PPARC funded project to develop a Virtual Observatory for the UK  One of the main partners in Euro-VO  Founding member of IVOA (=International Virtual Observatory Alliance, Definition of standards. Interoperability.  Both night time astronomy and solar/STP components

AstroGrid components  Portal  Registry – Lists available resources (datasets, applications…). Harvests registries of other VOs.  MySpace – Virtual distributed storage of user files  Common Execution Architecture (CEA) - Models how an application is run in the VO. An application is any process that consumes or produces data.  Job Execution Service (JES)

Workflow  Allows a user to query datasets, call tools and applications, from a single programming environment.  Data remotely located at data centers. Applications running on distributed servers.  Queries to multiple datasets can be brought together in a single workflow. Allows processing of a large number of ‘events’.  Workflows submitted for remote execution. Results collected in a user’s MySpace.

Solar developments  Datasets accessible are SURF TRACE archive at MSSL, SOHO/CDS and SOHO/EIT files at the Virtual Solar Observatory.  Solar application Solar Movie Maker developed.  Solar Event Catalogue part of EGSO accessible from workflow.

Solar science case  Obtain VOTable of solar energetic events via query to EGSO/SEC.  For each event in list, query TRACE or EIT datasets.  Call the movie maker application & generate mpeg movie.

Demo  Demo : Portal Demo : Portal

Further info & contact  

AstroGrid portal

Locating resources  The databases, applications, and other resources available are listed in the AG Registry

Building queries  Queries to databases are formulated in ADQL (extension of SQL).  Query builder is provided in the portal

Building a workflow  Queries to databases, calls to applications, operations on data, are combined into workflows.  Workflow submitted for remote execution.

Job Monitor  Monitor job execution  Provide transcript of workflow execution

AG Science Services  In addition to release allowing users to develop own workflow.  Launched via a simple interface, requiring just a few input parameters.  Currently: Solar Movie Maker and Redshift Maker.  Solar Movie Maker: either specify a time range and solar instrument, or an ‘event’ via query to EGSO Solar Event Catalogue.  Monitor job execution and download to local machine from AG portal.

AG Science Services

Future plans  Complete installation of AstroGrid datacentre software at RAL (UKSSDC + solar archive).  Include other main STP datasets. Time series applications. Models.  New STP science cases.  STP science service?  Hands-on AstroGrid Wokshop