A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.

Slides:

Advertisements

Similar presentations

What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.

Advertisements

ESO-ESA Existing Activities Archives, Virtual Observatories and the Grid.

Development of China-VO ZHAO Yongheng NAOC, Beijing Nov

The e-Research framework for South Africa developed by Fernihough (2011), after in depth interviews with various.

Digital Content Solutions Digital content management technology has transformed the way to manage content and knowledge, in this knowledge era. Research.

19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.

A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

GEODE Workshop 16 th January 2007 Issues in e-Science Richard Sinnott University of Glasgow Ken Turner University of Stirling.

The Open Science Grid: Bringing the power of the Grid to scientific research

UK e-Science and the White Rose Grid Paul Townend Distributed Systems and Services Group Informatics Research Institute University of Leeds.

Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.

AstroGrid Group 7: Teemu Toivola Tero Viitala. Problem several separate databases no common interface between databases difficulties of joining related.

Benefits of Blended e-Learning in Education

The Virtual Observatory and other data issues computers and astronomy today background technology the future : opportunities and problems VO vision VO.

Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.

 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.

GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.

Virtual Observatory --Architecture and Specifications Chenzhou Cui Chinese Virtual Observatory (China-VO) National Astronomical Observatory of China.

1 27-Sept-2004Andy Lawrence : IVOA workshop, Pune State of the IVOA state of the VO state of the IVOA.

INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.

1 Common Challenges Across Scientific Disciplines Laurence Field CERN 18 th November 2013.

Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

The data challenge in astronomy archives technology problems solution DCC conference Bath Andy Lawrence Sep 2005 the virtual observatory.

Talk structure who are we ? what is a VO ? what are the challenges ? what is an e-project ? Andy Lawrence Garching June 2002.

Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.

Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.

Computing for Space Science – Current practice and future challenges Peter Allan Head, Space Data Division.

NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.

Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.

INFSO-RI Enabling Grids for E-sciencE Project Gridification: the UNOSAT experience Patricia Méndez Lorenzo CERN (IT-PSS/ED) CERN,

AstroGrid status SOFT the VO the future AstroGrid presentation to GSC Andy Lawrence July 2003.

1 10-June-2004Andy Lawrence : PPARC data curation panel meeting AstroGrid, Data Centres, & Edinburgh What is curation ? Data Centres in the VO era Data.

What is the VSO? (and what isn’t it?). The VSO …  Allows you to search multiple archives in a single search  Keeps you from needing to keep track of.

Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.

Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)

Understand how the future will work exchange information on key projects understand PPARC priorities debate (conclude?) community approach to the PPARC.

Scenarios for a Learning GRID Online Educa Nov 30 – Dec 2, 2005, Berlin, Germany Nicola Capuano, Agathe Merceron, PierLuigi Ritrovato

Prof. Peter #twcrpi) Tetherless World Constellation Chair, Earth and Environmental Science/ Computer Science/ Cognitive.

The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid

A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Data and the UK e-Science Programme Paul Watson Director North-East Regional e-Science Centre School of Computing Science University of.

Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO.

ECOLEAD 1 Jermol/JSI © Jermol/JSI Training activities WP7 Mitja Jermol Jozef Stefan Institute (JSI)

EURO-VO Structure Data Centre Alliance (DCA) A collaborative and operational network of European data centres who, by the uptake of new VO technologies.

…building the next IT revolution From Web to Grid…

Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid

E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.

1 18-Nov-2004Andy Lawrence :VO-TECH workshop, Cambridge VO-TECH : Intro Euro-VO VO-TECH project Key issues Goals of meeting.

The International Virtual Observatory Alliance (IVOA) interoperability in action.

1 8-Jun-2004Andy Lawrence : PharmaGrid talk, Diessenhofen The Virtual Observatory The VObs concept The structure of the VObs Standards, Standards, Standards.

Children’s Health Exposure Analysis Resource (CHEAR) CHEAR Center for Data Science Susan Teitelbaum, PhD November 4, 2015.

AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.

A centre of expertise in digital information management Shaping the e-future? Grids, Web Services and Digital Libraries Professor Tony.

The Collaborative Semantic Grid David De Roure University of Southampton, UK

Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.

Toward a common data and command representation for quantum chemistry Malcolm Atkinson Director 5 th April 2004.

Project number: ENVRI and the Grid Wouter Los 20/02/20161.

GRIDSTART a European GRID coordination attempt Fabrizio Gagliardi CERN.

GRIDSTART Brussels 20/9/02 1www.gridstart.org GRIDSTART and European activities Dr Francis Wray EPCC The University of Edinburgh.

ESDO: UK Access to the Solar Dynamics Observatory 1. Mullard Space Science Laboratory, University College London. Holmbury St. Mary, Dorking, Surrey SM2.

1 14-Dec-2004Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh Meeting Goals review achievements review architecture identify targets for AG2 and.

Joint Information Systems Committee Repositories Support Project Summer School 2008 Amber Thomas, JISC.

The National e-Science Centre. eSI in Edinburgh NeSC Roles National: help coordinate and lead the UK e- Science Programme Community building activities,

Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.

Chapter 1 Characterization of Distributed Systems

Grid Optical Burst Switched Networks

Presentation transcript:

a long tradition

e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we do ? Beijing workshop on small VO projects Andy Lawrence Nov 2003

what is e-science ? application of extreme IT to science –TFlops, PBytes, Gbps –distributed computing –algorithms internet enabled science collaborative computing inter-enterprise computing

Generic science drivers data growth on-line research multi-archive science rare object science large database science empowerment

from GridPP web page

shared managed distributed resources –documents + data + software + storage + cycles + expertise network : ability to pass messages web : transparent document system computational grid : transparent CPU datagrid: transparent data access and services information grid, knowledge grid... ? Virtual Organisations ? the Grid concept

same story everywhere astronomy particle physics biology education commerce etc etc...

multi- views of a Supernova Remnant Shocks seen in the X- ray Heavy elements seen in the optical Dust seen in the IR Relativistic electrons seen in the radio

What happens to the Earth's magnetosphere during a coronal mass ejection ? Event imaged by space-based solar observatory Effect detected later by satellites and ground radar

needles in a haystack Hambly et al faint moving object is a cool white dwarf - may be solution to the dark matter problem - but hard to find : one in a million - even harder across multiple archives

UK infrastructure co-ordinated programme national and regional centres shared facilities astronomy benefits from being on the map

Chinese infrastructure China Grid announced October featured areas in Grid Today article : –e-learning –video courses –bio-informatics CVO has GT3 focus –involvement in China Grid

VO structure : key points not a monolith data centres have the key role

not a monolith framework + standards inter-operable data inter-operable software modules content of VO : data + services + tools no central VO-command

VO geometry not a warehouse not a hierarchy not a peer-to-peer system small set of service centres and large population of end users

Data Centres build and curate databases deploy VO infrastructure supply data services –data access –data operations search / transform / combine / analyse data analysis standardised and online

yesterday browser front end CGI request html web page DB engine SQL data

today application web service SOAP/XML request SOAP/XML data DB engine SQL native data anything standard formats

tomorrow application web service job results anything web service web service web service web service web service Registry Workflow GLUE Community MySpace standard semantics publish WSDL

day after tomorrow application grid service job results anything grid service grid service grid service grid service grid service Registry Workflow GLUE Community MySpace pooled resource standard semantics ontology agents

what then must we do ?

work needed application grid service job results anything grid service grid service grid service grid service grid service Registry Workflow GLUE AstroPass MySpace pooled resource standard semantics TOOLS STANDARDS INFRASTRUCTURE TECHNOLOGY RESEARCH DATA SERVICES (access and analysis) INF. UPTAKE DATA PIPELINES ontology PHYSICAL GRID agents

work for "small" projects ? pipelines, databases    physical grid  infrastructure uptake    data services    infrastructure build  (niches) standards development  technology research   tools  

Ju Zhong