European Network Policy Group Malcolm Atkinson Director 28 th October 2004

Outline The UK e-Science Programme Funding and organisation The UK Grid Example Projects and Middleware OGSA-DAI Biomedical applications Building e-Infrastructure: People, sociological, economic & technical challenges One e-Infrastructure: for all disciplines – they all need it. Balance application pull and organised delivery + Engage industry. International collaboration on building e-Infrastructure essential. All disciplines and commercial sectors will join in.

What is e-Science? Goal: to enable better research in all applications Method: Invention and exploitation of advanced computational methods to generate, curate and analyse research data  From experiments, observations and simulations  Quality management, preservation and reliable evidence to develop and explore models and simulations  Computation and data at extreme scales  Trustworthy, economic, timely and relevant results to enable dynamic distributed virtual organisations  Facilitating collaboration with information and resource sharing  Security, reliability, accountability, manageability and agility Does e-Science imply new European requirements?

The Primary Requirement … Enabling People to Work Together on Challenging Projects: Science, Engineering & Medicine

Staff costs - Grid Resources Computers & Network funded separately EPSRC Breakdown UK e-Science Budget ( ) Source: Science Budget 2003/4 – 2005/6, DTI(OST) Total: £213M + Industrial Contributions £25M + £100M via JISC

Globus Alliance CeSC (Cambridge) Digital Curation Centre e-Science Institute Open Middleware Infrastructure Institute The e-Science Centres EGEE Grid Operations Support Centre National Centre for e-Social Science National Institute for Environmental e-Science

CeSC (Cambridge) The e-Science Grid Engineering Task Force (Contributions from e-Science Centres) Grid Support Centre / Grid Operations Centre OGSA Test Grid projects Architecture Task Force Security Task Force Usability Task Force HPC(x) 1600 x CPU AIX 64 x CPU 4TB Disk Linux 20 x CPU 18TB Disk Linux 512 x CPU Irix

The European dimension EGEE: Enabling Grids for E-Science in Europe … and beyond 32M Euro, 10 regions, 70 partners Additional funding from NSF (USA) 50% production, 30% development, and 20% dissemination and training “The Grid Infrastructure in Europe” Deploy a production Grid across Europe Initially based on LHC Computing Grid UK NGS will converge and run same e-Infrastructure

Importance of collaboration: VDT A highly successful collaborative effort VDT Working Group VDS (Chimera/Pegasus) team  Provides the “V” in VDT Condor Team Globus Alliance NMI Build and Test team EDG/LCG/EGEE  Middleware, testing, patches, feedback … PPDG  Hardening and testing Pacman  Provides easy installation capability  Currently Pacman 2, moving to Pacman 3 soon Used by many projects Systematic testing Rich integration of components Europe should be part of this – exploit test bed contribute components Productise our M/W with this testing & packaging Thanks to Miron Livny

Where Next for e-Infrastructure Put people and teams first Invest in building a community The creative force The repository of Experience, Skills and Knowledge Focus on Major Priorities Developing well-defined Flexible Agreements  Embraced as standards High-level Software Investment  Applications & Requirements led Explore & Evolve Common & Shared Infrastructure Recognise and respond to differences Celebrate and support commonalities International Collaboration Essential Global Research Standards and interoperation

Outline The UK e-Science Programme Funding and organisation The UK Grid Example Projects and Middleware OGSA-DAI Biomedical applications Building e-Infrastructure: People, sociological, economic & technical challenges One e-Infrastructure: for all disciplines – they all need it. Balance application pull and organised delivery + Engage industry. International collaboration on building e-Infrastructure essential. All disciplines and commercial sectors will join in.

OGSA Infrastructure Architecture Grid or Web Service Infrastructure Data Intensive Applications for Science X Compute, Data & Storage Resources Distributed Simulation, Analysis & Integration Technology for Science X Data Intensive X Scientists Virtual Integration Architecture Generic Virtual Data Access and Integration Layer Structured Data Integration Structured Data Access Structured Data Relational XML Semi-structured- Transformation Registry Job Submission Data TransportResource Usage Banking BrokeringWorkflow Authorisation OGSA-DAI

OGSA-DAI Downloads R4 690 downloads since May 04 -Actual user downloads not search engine crawlers -Does not include downloads as part of GT3.2 releases Total of 838 registered users R1.0 (Jan 03)104 R1.5 (Feb 03)108 R2.0 (Apr 03)250 R2.5 (Jun 03)291 R3.0 (Jul 03)792 R3.1 (Feb 04)630 Total2865 United Kingdom 21% China 26% United States 13% Japan 5% Unknown 7% Germany 5% Italy 5% Austria 2% Australia 2% France 3% Taiwan 2% Downloads by Country – OGSA-DAI R4.0

Database Growth PDB Content Growth

Wellcome Trust: Cardiovascular Functional Genomics Glasgow Edinburgh Leicester Oxford London Netherlands Shared data Public curated data BRIDGES IBM

Biochemical Pathway Simulator (Computing Science, Bioinformatics, Beatson Cancer Research Labs) DTI Bioscience Beacon Project Harnessing Genomics Programme Slide from Muffy Calder, Glasgow Now largest EU project in the Life Sciences – see Walter Kolch

eDiaMoND – Compute Mammograms have different appearances, depending on image settings and acquisition systems Standard Mammo Format Standard Mammo Format Temporal mammography Computer Aided Detection 3D View Provided by eDiamond project: Prof. sir Mike Brady et al.

Automatic registration technology Rigid registration of MR and CT images of the head Inter-subject image warping Provided by IXI project: Prof. Derek Hill et al.

e-Science Institute Figures for 3 Years We have run just under 7 per month (up from just over 6 at last Review) 19,456 delegate days 248 events 8,329 delegates (many ‘repeats’) 421 event days (in  750 working days) Further statistics exclude GGF5, as we did not handle registration so cannot do a detailed analysis.

Events held in the 3 rd Year (from 1 Aug 2003 to 31 Jul 2004) We had 114 (86,48) events: (Year 2 & 1 figures in brackets) 7 project meetings ( 11, 4) 8 research meetings ( 11, 7) 34 workshops (25, 18) 2 schools(2, 0) 18 training sessions(15, 8) 26 outreach events(12, 3) 6 international meetings(5,1) 4 conferences (0,1) 9 e-Science management meetings (5, 7)

Attendance from different countries Involvement in EGEE reflected in increase in EU participation

Take home messages E-Science is for everybody & every discipline Environment, health, safety, design, science, humanities To enable it Build “people grids” And “institution e-Infrastructures” The Technology Will support useful work now But still too hard to use & hard to sustain Work on the Technology Middleware, Portals, Security, Networks collaboratively