A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.

Slides:

Advertisements

Similar presentations

AstroGrid: Past, Present & Future Bob Mann Institute for Astronomy & National e-Science Centre University of Edinburgh.

Advertisements

Australian Virtual Observatory A distributed volume rendering grid service Gridbus 2003 June 7 Melbourne University David Barnes School of Physics, The.

The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.

A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.

A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK Dec 2004.

A PPARC funded project The Grid Data Warehouse Description of prototype work in progress by AstroGrid. Access-Grid lecture to Universities of Leeds and.

C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.

19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.

14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.

A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.

Slide 1Guy Rixon: AstroGrid’s trial data-grids“VO as data grid”: NeSC, July 2003 AstroGrid’s trial Data Grids Experiences with GT3 Guy Rixon July 2003.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

A PPARC funded project AstroGrid’s Common Execution Architecture Guy Rixon, reporting on behalf of Paul Harrison and the other AstroGrid developers SC4DEVO-1,

Interpret Application Specifications

Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.

Center for Environmental Studies Arizona State University Digital Research Records at Center for Environmental Studies Peter McCartney.

AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.

BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.

Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.

Virtual Observatory --Architecture and Specifications Chenzhou Cui Chinese Virtual Observatory (China-VO) National Astronomical Observatory of China.

Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.

Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.

AstroGrid Datacenters ESO M Hill (ROE), Aug 2004.

A PPARC funded project Review of architecture document Consortium meeting Edinburgh December 2004 Guy Rixon AstroGrid Technical Architect University of.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

AstroGrid 的安装，配置，组件介绍 LAMOST 王丹. AstroGrid Releases SNAPSHOT: latest bleeding edge code. Integration Tests results are available, but the code has not.

A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle.

Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.

Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.

AstroGrid: Science Use Ready AstroGrid: Science Use Ready Nicholas Walton AstroGrid Project Scientist IoA, Cambridge A PPARC funded project.

Virtual Observatory Interfaces reused in the Virtual Atomic and Molecular Data Centre Guy Rixon Institute of Astronomy University of Cambridge September.

NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.

AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.

1 Peter Allan14-15 Dec 2004AstroGrid Consortium Meeting: Architecture Discussion AstroGrid Architecture – the view from outside Is the description acceptable?

Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.

A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.

1 27-Apr-2004AstroGrid Consortium Meeting - PL talk Agenda Tuesday status review / goals / science Lunch + AGLI Itn-05 review Dinner at Coton (share.

INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,

A PPARC funded project Tony Linde Programme Manager AG-SAG FM6 Programme Manager Report Wed 25-May, 2005 UCL.

AstroGrid: The UK’s Virtual Observatory Dr Dugan Witherick – Astrophysics Group, UCL Wednesday 5 th December 2007 The University of Warwick.

1 10-June-2004Andy Lawrence : PPARC data curation panel meeting AstroGrid, Data Centres, & Edinburgh What is curation ? Data Centres in the VO era Data.

A PPARC funded project Astronomical services: situated software vs. commodity software Guy Rixon, AstroGrid/AVO/IVOA Building Service Based Grids - GGF11.

Understand how the future will work exchange information on key projects understand PPARC priorities debate (conclude?) community approach to the PPARC.

Science Processes in VOTECH Nicholas Walton AstroGrid Project Scientist and Euro-VO VOTC Project Scientist IoA, Cambridge 18 Nov2004.

The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid

A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,

Authentication and Authorization Architecture for AstroGrid and the VO Guy Rixon Tony Linde Elizabeth Auden Nic Walton TIVO, June 2002.

Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid

16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.

A PPARC funded project Architecture Appeal Guy Rixon AstroGrid Consortium meeting April 2004.

A PPARC funded project Workflow in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.

A PPARC funded project Tony Linde Programme Manager AstroGrid in the wider world AstroGrid Consortium meeting Cambridge, UK 10-July-2005.

A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.

A PPARC funded project Astro-Wise meeting April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester.

12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.

Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing

The Large Synoptic Survey Telescope Project Bob Mann Wide-Field Astronomy Unit University of Edinburgh.

AstroGrid consortium meeting, December 2005 Slide 1 Architecture review Guy Rixon AstroGrid consortium meeting Jodrell Bank, December 2005.

Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.

A PPARC funded project PM Report Grid Steering Committee MRC, London 18-Feb-2004.

LEAD Project Discussion Presented by: Emma Buneci for CPS 296.2: Self-Managing Systems Source for many slides: Kelvin Droegemeier, Year 2 site visit presentation.

Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.

AstroGrid & VO Structure NeSC, Edinburgh 21-March-2003 UK Astronomical Data Centres.

Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.

Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.

MSSL Astrogrid Workshop

Presentation transcript:

A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect University of Cambridge

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 2 But first......What is a Virtual Observatory? Dynamic collection of hardware, data and software working in harmony to solve arbitrarily large and complex astromonical problems.

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 3 Virtual Observatories: Unlocking new science Federating multi-λ data: Deep Field Surveys Nik Szymanek D. Ducros, ESA Link the X-ray and Opt/IR to understand energetic galaxies at the edge of the Universe NEP J : an X-ray cluster at z=0.81: Chandra X-ray image (C. Mullis) overlaid on a deep BRI image (D. Clowe & G. Luppino).

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 4 Bridging communities Virtual observatory (VO) Desktop astronomy Web archives in astronomy Semantic web/grid HPC

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 5 AstroGrid’s position within VO VO Interactive exploration/ Experiment design Bulk processing/ Experiment execution AstroGrid’s emphasis

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 6 Bulk processing  workflow Hands-off operation Reproducible experiments Common, reusable procedures Everything is recorded Integrated with interactive system “Virtual grad student”

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 7 Components within AstroGrid Data grid Compute grid Workflow System Web portal Resource Registry

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 8 Web portal Basic controls in web browser… …linked to traditional displays on desktop.

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 9 Resource registry Description of all accessible resources: Services Applications Archive data-sets Follows IVOA standards Standard interface for queries Standard XML schemata for resource entries Standard “harvesting” between registries Metadata for: Humans Software agents

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 10 Workflow: Job Execution System

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 11 Data grid: DSA and MySpace Archive Data-selection Service User-writeable storage Processing 1Processing 2 Desktop

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 12 Compute grid: Common Execution Architecture Common Execution Connector Application as.exe file (local) Application as.exe file (grid) Common Execution Connector Application as HTTP service Common Execution Connector Application as Java class Common Execution Connector Web servicesLegacy/situated s/w JES Registry

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 13 What you get AstroGrid makes Java software for others to run. All our software is server-side We recommend other s/w suppliers for desktop components, e.g. Starlink, SAO Our services are web services Built with Apache Axis Run in Jakarta-Tomcat Delivered as web-archive (WAR) files. No user coding needed! AstroGrid software adapts to your legacy archive/application Highly configurable

AstroGrid: new technology for the VO; SC2004, Pittsburgh PA Slide 14 Follow-up Our web site: Beta testing Contact Nic Walton Component Deployment Data Centre MySpace Local Registry Community Contact Nic Walton Software cooperation MySpace Workflow Data Centre Registry metadata updating Contact Tony Linde Keith Noddle