5/6 March 2003Life Sciences Workshop GGF7University of Manchester REALISTE – Realistic modelling in Environmental and LIfe Sciences Through Escience Presented.

Slides:



Advertisements
Similar presentations
March 6 th, 2009 OGF 25 Unicore 6 and IPv6 readiness and IPv6 readiness
Advertisements

European Commission DG Information Society Info Day Brussels, 2 June 2005 Focal points: 1. Concepts, methods and core services 2. Tools in Rich Environments.
The National Grid Service Mike Mineter.
Security Daniel Mallmann MWSG meeting Amsterdam December 2005.
Supporting education and research E-learning tools, standards and systems Sarah Porter Head of Development, JISC.
The UNICORE GRID Project Karl Solchenbach Gesellschaft für Parallele Anwendungen und Systeme mbH Pallas GmbH Hermülheimer Straße 10 D Brühl, Germany.
1 Richard White Design decisions: architecture 1 July 2005 BiodiversityWorld Grid Workshop NeSC, Edinburgh, 30 June - 1 July 2005 Design decisions: architecture.
Problem-Solving Environments: The Next Level in Software Integration David W. Walker Cardiff University.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
UNICORE UNiform Interface to COmputing REsources Olga Alexandrova, TITE 3 Daniela Grudinschi, TITE 3.
DAME, EuroGrid WP3 and GEODISE Esa Nuutinen. Introduction Dame, EuroGrid WP3 and GEODISE All are Grid based tools for Engineers. Many times engineers.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Database Taskforce and the OGSA-DAI Project Norman Paton University of Manchester.
INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.
1 Dr. Markus Hillenbrand, ICSY Lab, University of Kaiserslautern, Germany A Generic Database Web Service for the Venice Service Grid Michael Koch, Markus.
Taverna and my Grid Basic overview and Introduction Tom Oinn
NA-MIC National Alliance for Medical Image Computing NA-MIC Software Engineering Bill Lorensen GE Research NA-MIC Engineering Core PI.
Service-enabling Legacy Applications for the GENIE Project Sofia Panagiotidi, Jeremy Cohen, John Darlington, Marko Krznarić and Eleftheria Katsiri.
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
Taverna and my Grid Open Workflow for Life Sciences Tom Oinn
Forschungszentrum Jülich in der Helmholtz-Gemeinschaft UNICORE and Grid Computing in Europe Dietmar Erwin Forschungszentrum Jülich
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
The roots of innovation Future and Emerging Technologies (FET) Future and Emerging Technologies (FET) The roots of innovation Proactive initiative on:
Contact person: Prof. M. Niezgódka Prof. Piotr Bała ICM Interdisciplinary Centre for Mathematical and Computational Modelling Warsaw University,
OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.
Introduction Infrastructure for pervasive computing has many challenges: 1)pervasive computing is a large aspect which includes hardware side (mobile phones,portable.
NIH NCRR Overview The SCIRun and BioPSE Problem Solving Environments Chris Johnson, Rob MacLeod, and David Weinstein Scientific Computing and Imaging Institute.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
Scenarios for a Learning GRID Online Educa Nov 30 – Dec 2, 2005, Berlin, Germany Nicola Capuano, Agathe Merceron, PierLuigi Ritrovato
The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
Ian Taylor, Cardiff Work-Flow Application Toolkit Eger Meeting Ian Taylor & Ian Wang Cardiff University, UK.
GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße.
Infrastructures for Social Simulation Rob Procter National e-Infrastructure for Social Simulation ISGC 2010 Social Simulation Tutorial.
The National Grid Service Mike Mineter.
Using Federated Services with Triana Matthew Shields Cardiff University.
RealityGrid Peter Coveney 1 and John Brooke 2 1. Centre for Computational Science, Department of Chemistry, Queen Mary, University of London 2. Manchester.
Manchester Computing S. M. Pickles, R. Haines, R. L. Pinning and A. R. Porter UK e-Science All Hands Meeting, nd September 2004 Practical Tools.
Utility Computing: Security & Trust Issues Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.
Resource Brokering on Complex Grids EUROGRID and GRIP Presented by John Brooke ESNW October 3/4 UK/Japan N+N.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
The National Grid Service Mike Mineter.
DS-Grid: Large Scale Distributed Simulation on the Grid Georgios Theodoropoulos Midlands e-Science Centre University of Birmingham, UK Stephen John Turner,
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
GRIDSTART a European GRID coordination attempt Fabrizio Gagliardi CERN.
RC ICT Conference 17 May 2004 Research Councils ICT Conference The UK e-Science Programme David Wallace, Chair, e-Science Steering Committee.
Holding slide prior to starting show. GECEM: Grid-Enabled Computational Electromagnetics David W. Walker School of Computer Science Cardiff University.
Geoffrey Fox Panel Talk: February
Bob Jones EGEE Technical Director
Prototyping in the software process
Scientific Computing Department
UK Grid: Moving from Research to Production
Design and Manufacturing in a Distributed Computer Environment
Collaborations and Interactions with other Projects
Middleware independent Information Service
Similarities between Grid-enabled Medical and Engineering Applications
Grid Portal Services IeSE (the Integrated e-Science Environment)
Flexible Extensible Digital Object Repository Architecture
Flexible Extensible Digital Object Repository Architecture
University of Technology
Tutorial Overview February 2017
SDM workshop Strawman report History and Progress and Goal.
Software Engineering with Reusable Components
The SCIRun and BioPSE Problem Solving Environments
Large Scale Distributed Computing
GGF10 Workflow Workshop Summary
Presentation transcript:

5/6 March 2003Life Sciences Workshop GGF7University of Manchester REALISTE – Realistic modelling in Environmental and LIfe Sciences Through Escience Presented by John Brooke 1,2 1 SVE Group, Manchester Computing, University of Manchester 2 ESNW, North West UK Regional eScience Centre

GGF7 Life Sciences WorkshopMarch 5/ What is REALISTE about? REALISTE is a proposal for a European Network of Excellence in sciences of complexity, notably life and environmental sciences. These sciences are faced with the need to integrate massive amounts of complex data with large scale simulation in a collaborative environment. What distinguishes them from current DataGrid work is the complexity and heterogeneity of data and computation. Also the life sciences community does not have the long experience of very large and distributed collaboration that is the heritage of high energy physics or astronomy.

GGF7 Life Sciences WorkshopMarch 5/ REALISTE background UK myGrid eScience project provided ideas on data integration and management in a distributed environment. UK RealityGrid project provided ideas on integration of simulation, experiment and visualization. EU Project EUROGRID provided ideas for managing complex workflows in scientific problem solving. EU Project GRIP provided ideas on interoperability issues of Grid software, most specifically Globus and UNICORE. Access Grid provided ideas on promoting persistent distributed collaborations. We know there are many other relevant projects, but we now provide slides from each of these projects to show the REALISTE problem domain and proposals for integration.

GGF7 Life Sciences WorkshopMarch 5/ Obstacles Everywhere to Information Weaving (addressed by the UK myGrid project) Large amounts of different kinds of data & many applications. Highly heterogeneous. Different types, algorithms, forms, implementations, communities, service providers High autonomy. Highly complex and inter-related, & volatile.

GGF7 Life Sciences WorkshopMarch 5/ Need to integrate computation and visualization (addressed by UK RealityGrid Project) Need to understand binding affinities of various peptide antigens Binding mechanism depends on dynamical behaviour of peptide in MHC groove Full model has 58,825 atoms including water in periodic box Need many nanoseconds of simulation to compute binding energies (thermodynamic integration) Funding from BBSRC, EPSRC, Jenner Institute, CSAR

GGF7 Life Sciences WorkshopMarch 5/ SGI Compile Link Compute Compose complex workflows (EU Projects EUROGRID and GRIP) HP Transfer Import Monitor apparatus Export Onyx Render Transform Visualize Import & Compute IBM Import Compute Synchronize

GGF7 Life Sciences WorkshopMarch 5/ Access Grid meetings for problem solving, e.g. UK Engineering Task Force

GGF7 Life Sciences WorkshopMarch 5/ Grid challenges in complex problem-solving for life sciences Focus on heterogeneous networks providing data extraction, simulation, visualization and links with live experiments. Use of grid technologies to provide a unified image and a transparent access to such environments Need to componentise current scientific codes and use metadata to describe interaction with Grid environment. Steering and collaboration via visualization, brings to the fore issues of synchronicity and dataflow between running applications. Interoperability of data, software components and Grid middleware. Community involvement essential.

GGF7 Life Sciences WorkshopMarch 5/ Visual steering pipeline on Grid 1 Gbps Knowledge feedback (Steering) Geometrical Transformation Code Optimisation Parallel modules (e.g. vtk) 1 Gbps Rendering (e.g. AVS/MPE) Viewing and steering Gbps Graphics pipes VizServer

GGF7 Life Sciences WorkshopMarch 5/ Integrated experiments Simulation and informatics data often decoupled from experimental design and data gathering Experimental data compared with simulation and theory only ex post facto Scientific discovery can be enhanced by closely coupling computation and experiment E.g. X-ray microtomography, bio-electric field monitoring. This brings in a very important issue: integration into a Grid of entities which are not computers. It is an important issue in the GGF document “Core Functions for Production Grids” (Bill Johnston and John Brooke, GGF Working Document from GPA-RG)

GGF7 Life Sciences WorkshopMarch 5/ A workflow example – RealityGrid steering application Bezier SGI Manchester Vtk + VizServer Dirac SGI QMUL LB3D with RealityGrid Steering API Laptop SHU Conference Centre UNICORE Gateway and NJS Manchester Firewall SGI OpenGL VizServer Simulation Data VizServer client Steering GUI The Mind Electric GLUE web service hosting environment with OGSA extensions Single sign-on using UK e-Science digital certificates UNICORE Gateway and NJS QMUL Steering (XML)

5/6 March 2003Life Sciences Workshop GGF7 RealityGrid: “Fast Track” Demonstration

GGF7 Life Sciences WorkshopMarch 5/ Generic features of the steering application No need to commit to overall framework, e.g. Cactus, SciRun Fault-tolerant, components can be migrated, networks can go down and come up, application is resilient. User initiates by contacting OGSA service, in this application very coarse granularity at OGSA level, but can be refined. Single sign on via digital certificates (UK eScience CA) and single job committal implements entire workflow. Client application on the laptop is very lightweight, intend to port to PDA and beyond that mobile phones. Visualization not coupled to steering, therefore visualization component can crash but computation continues. UNICORE gives us “just enough” vertical integration.

GGF7 Life Sciences WorkshopMarch 5/ UNICORE-Globus interoperability Need UNICORE for workflow management, vertical integration and adaptivity of its client plugins (e.g. for biomolecular modelling) Need Globus for its ability to locate resources dynamically and ability to spawn jobs dynamically plus wider availability. So it would be good to use UNICORE to access Globus resources, but also: Globus-UNICORE interoperability is a proof-of-concept for the much wider interoperability necessary for REALISTE.

GGF7 Life Sciences WorkshopMarch 5/ Interoperability architecture Client grid-proxy-init plugin (Logical) Globus Usite Gateway Vsite A NJS Vsite B NJS Generic Globus IDB Globus JM Host A Globus JM Host B Globus TSI Globus GIIS IDB Maker IDB Host A IDB Host B GRIS Incarnation of a UNICORE Abstract Job Object (AJO) via a Target System Interface (TSI) for a Globus Grid

GGF7 Life Sciences WorkshopMarch 5/ REALISTE – Summary Realistic modelling in Environmental and LIfe Sciences Through Escience, proposal to 2 nd round of EU FP6 Can build on data and computation layers of the Grid, FP5 projects, plus UK eScience Programme. Bring together communities concerned with biological data- handling, simulation and experiment to agree standards and tools to create a problem-solving environment. Want to link with the live feeling of presence brought by AccessGrid, integrating visualization and interactive steering. Early exemplars, RealityGrid steering application, interoperability of UNICORE and Globus, show potential of underlying REALISTE approach.

GGF7 Life Sciences WorkshopMarch 5/ Thanks To Peter Coveney, Stephen Pickles and the RealityGrid team. To Carole Goble and the myGrid team. To our European partners in GRIP and EuroGrid and ANL partners Gregor von Laszewski and Sam Meder of Argonne. To the AccessGrid project and all involved in AG. To Dave Snelling, co-chair of the OGSI-WG at GGF and to Bill Johnston co-chair of GPA-RG. We acknowledge funding under the EU 5 th framework projects EuroGrid and GRIP and the UK eScience Pilot Projects RealityGrid and myGrid. Finally thanks to the Life Sciences Workshop organisers for inviting us.