1. Ischia, Italy - 9-21 July 20061 Session 1 Second Part Day 1 Monday 10 th July Malcolm Atkinson

2. Ischia, Italy - 9-21 July 20062

3. 3 Introduction to Grids History of Distributed Computing Challenges of Distributed Computing Driving Forces & Motivation for Grids Collaboration Data Deluge Computational Roadmap A history of Grids

4. Ischia, Italy - 9-21 July 20064 What is e-Science? Goal: to enable better research in all disciplines Method: Develop collaboration supported by advanced distributed computation –to generate, curate and analyse rich data resources From experiments, observations and simulations Quality management, preservation and reliable evidence –to develop and explore models and simulations Computation and data at all scales Trustworthy, economic, timely and relevant results –to enable dynamic distributed collaboration Facilitating collaboration with information and resource sharing Security, trust, reliability, accountability, manageability and agility Our challenge is to develop an integrated approach to all three

5. Ischia, Italy - 9-21 July 20065 Distributed Systems History 19601970198019902000 Bespoke pioneering distributed systems, e.g. SABRE & SAGE IBM CICS Linklider proposes shared multi-site computing Dozens of academic networks Many incompatible protocols ARPA net CORBA & DCOM IP-based Internet Academic & Research WWW Ethernet TCP

6. Ischia, Italy - 9-21 July 20066 Distributed Systems to Grids 19601970198019902000 Bespoke pioneering distributed systems IBM CICS Linklater proposes shared multi-site computing Dozens of academic networks Two dominant protocols ARPA net CORBA & DCOM IP-based Internet Academic & Research WWW Condor I-way Globus Starts Unicore Web Services Many research grids Using many protocols & M/W stacks D-Grid starts Collaboration via shared bio/chem/medical “DBs” EDGEGEE EGEE II

7. Ischia, Italy - 9-21 July 20067

8. 8 A Grid Computing Timeline I-Way: SuperComputing ‘95 1995’96’97’98’992000’01’02’03’04’052006 US Grid Forum forms at SC ‘98 Grid Forums merge, form GGF OGSA-WG formed OGSA v1.0 “Anatomy” paper “Physiology” paper European & AP Grid Forums UK e-Science programme starts DARPA funds Globus Toolkit & Legion EU funds UNICORE project US DoE pioneers grids for scientific research NSF funds National Technology Grid NASA starts Information Power Grid DARPA funds Globus Toolkit & Legion EU funds UNICORE project US DoE pioneers grids for scientific research NSF funds National Technology Grid NASA starts Information Power Grid Today: Grid solutions are common for HPC Grid-based business solutions are becoming common Required technologies & standards are evolving Today: Grid solutions are common for HPC Grid-based business solutions are becoming common Required technologies & standards are evolving Japan government funds: Business Grid project NAREGI project Japan government funds: Business Grid project NAREGI project Source: Hiro Kishimoto GGF17 Keynote May 2006 GGF & EGA form OGF

9. Ischia, Italy - 9-21 July 20069 What is a Grid? License Printer A grid is a system consisting of −Distributed but connected resources and −Software and/or hardware that provides and manages logically seamless access to those resources to meet desired objectives A grid is a system consisting of −Distributed but connected resources and −Software and/or hardware that provides and manages logically seamless access to those resources to meet desired objectives R2AD Database Web server Data CenterCluster HandheldSupercomputer Workstation Server Source: Hiro Kishimoto GGF17 Keynote May 2006

10. Ischia, Italy - 9-21 July 200610 Source: Hiro Kishimoto GGF17 Keynote May 2006 Grid & Related Paradigms Utility Computing Computing “services” No knowledge of provider Enabled by grid technology Utility Computing Computing “services” No knowledge of provider Enabled by grid technology Distributed Computing Loosely coupled Heterogeneous Single Administration Distributed Computing Loosely coupled Heterogeneous Single Administration Cluster Tightly coupled Homogeneous Cooperative working Cluster Tightly coupled Homogeneous Cooperative working Grid Computing Large scale Cross-organizational Geographical distribution Distributed Management Grid Computing Large scale Cross-organizational Geographical distribution Distributed Management

11. Ischia, Italy - 9-21 July 200611 How Are Grids Used? High-performance computing Collaborative data-sharing Collaborative design Drug discovery Financial modeling Data center automation High-energy physics Life sciences E-Business E-Science Source: Hiro Kishimoto GGF17 Keynote May 2006

12. Ischia, Italy - 9-21 July 200612 Grids In Use: E-Science Examples Data sharing and integration −Life sciences, sharing standard data-sets, combining collaborative data-sets −Medical informatics, integrating hospital information systems for better care and better science −Sciences, high-energy physics Data sharing and integration −Life sciences, sharing standard data-sets, combining collaborative data-sets −Medical informatics, integrating hospital information systems for better care and better science −Sciences, high-energy physics Capability computing −Life sciences, molecular modeling, tomography −Engineering, materials science −Sciences, astronomy, physics Capability computing −Life sciences, molecular modeling, tomography −Engineering, materials science −Sciences, astronomy, physics High-throughput, capacity computing for −Life sciences: BLAST, CHARMM, drug screening −Engineering: aircraft design, materials, biomedical −Sciences: high-energy physics, economic modeling High-throughput, capacity computing for −Life sciences: BLAST, CHARMM, drug screening −Engineering: aircraft design, materials, biomedical −Sciences: high-energy physics, economic modeling Simulation-based science and engineering −Earthquake simulation Simulation-based science and engineering −Earthquake simulation Source: Hiro Kishimoto GGF17 Keynote May 2006

13. Ischia, Italy - 9-21 July 200613

14. Ischia, Italy - 9-21 July 200614 Grids: integrating & providing homogeneity (Potentially) Generic & Industry Supported Mechanism for combining many heterogeneous resources so they can be used remotely –Data resources –Computation resources –Instruments –Research processes & procedures Restricting choices as to how it may be done –Harder for provider to make localised decisions –Deployment can be challenging Providing more homogeneity through virtualisation –Should be easier to compose services –More opportunity to amortise costs A component of e-Infrastructure Deliberately choosing consistent interfaces, protocols & management controls across a set of compatible services

15. Ischia, Italy - 9-21 July 200615 Grids as a Foundation for Solutions The grid per se doesn’t provide –Supported e-Science methods –Supported data & information resources –Computations –Convenient access Grids help providers of these –International & national secure e-Infrastructure –Standards for interoperation –Standard APIs to promote re-use But Research Support must be built –What is needed? –Who should do it? Much to be done by developers of applications & services and by resource providers

16. Ischia, Italy - 9-21 July 200616 Grids as a Foundation for Solutions The grid per se doesn’t provide –Supported e-Science methods –Supported data & information resources –Computations –Convenient access Grids help providers of these –International & national secure e-Infrastructure –Standards for interoperation –Standard APIs to promote re-use But Research Support must be built –What is needed? –Who should do it? Much to be done by developers of applications & services and by resource providers Therefore must support many categories of user: Application & Service Developers Deployers & Operations teams Higher-level abstraction builders & gateway providers

17. Ischia, Italy - 9-21 July 200617

18. Ischia, Italy - 9-21 July 200618 Why use / build Grids? Research Arguments –Enables new ways of working –New distributed & collaborative research –Unprecedented scale and resources Economic Arguments –Reduced system management costs –Shared resources  better utilisation –Pooled resources  increased capacity –Load sharing & utility computing –Cheaper disaster recovery

19. Ischia, Italy - 9-21 July 200619 Why use / build Grids? Computer Science Arguments –New attempt at an old hard problem –Frustrating ignorance existing results –New scale, new dynamics, new scope Engineering Arguments –Enable autonomous organisations to Write complementary software components Set up run & use complementary services Share operational responsibility General & consistent environment for Abstraction, Automation, Optimisation & Tools Generally available code mobility

20. Ischia, Italy - 9-21 July 200620 Why use / build Grids? Political & Management Arguments –Stimulate innovation –Promote intra-organisation collaboration –Promote inter-enterprise collaboration

21. Ischia, Italy - 9-21 July 200621

22. Ischia, Italy - 9-21 July 200622 Drivers for Grids Collaboration –Expertise is distributed –Necessary to achieve critical mass of effort –Necessary to raise sufficient resources Computational Power –Rapid growth in number of processors –Powered by Moore’s law + device roadmap –Challenge to transform models to exploit this Deluge of Data –Growth in scale: Number and Size of resources –Growth in complexity –Policy drives greater availability

23. Ischia, Italy - 9-21 July 200623

24. Biomedical Research Informatics Delivered by Grid Enabled Services Synteny Grid Service blast + Portal http://www.brc.dcs.gla.ac.uk/projects/bridges/

25. Overview of e-Infrastructure 25 eDiaMoND: Screening for Breast Cancer 1 Trust  Many Trusts Collaborative Working Audit capability Epidemiology Other Modalities -MRI -PET -Ultrasound Better access to Case information And digital tools Supplement Mentoring With access to digital Training cases and sharing Of information across clinics Letters Radiology reporting systems eDiaMoND Grid 2ndary Capture Or FFD Case Information X-Rays and Case Information Digital Reading SMF Case and Reading Information CADTemporal Comparison Screening Electronic Patient Records Assessment/ Symptomatic Biopsy Case and Reading Information Symptomatic/Assessment Information Training Manage Training Cases Perform Training SMF CAD 3D Images Patients Provided by eDiamond project: Prof. Sir Mike Brady et al.

26. climateprediction.net and GENIE Largest climate model ensemble >45,000 users, >1,000,000 model years 10K 2K Response of Atlantic circulation to freshwater forcing

27. 27 Courtesy of David Gavaghan & IB Team Integrative Biology Tackling two Grand Challenge research questions: What causes heart disease? How does a cancer form and grow? Together these diseases cause 61% of all UK deaths Will build a powerful, fault-tolerant Grid infrastructure for biomedical science Enabling biomedical researchers to use distributed resources such as high-performance computers, databases and visualisation tools to develop complex models of how these killer diseases develop.

28. 28 Courtesy of David Gavaghan & IB Team IB Partners

29. Ischia, Italy - 9-21 July 200629 Foundations of Collaboration Strong commitment by individuals –To work together –To take on communication challenges –Mutual respect & mutual trust Distributed technology –To support information interchange –To support resource sharing –To support data integration –To support trust building Sufficient time Common goals Complementary knowledge, skills & data Can we predict when it will work? Can we find remedies when it doesn’t?

30. Ischia, Italy - 9-21 July 200630 Grid & Collaboration Questions Without collaboration little is achievable But must collaboration precede successful grid applications? Or will persistently and pervasively available grids stimulate collaborations? If we deliver support for collaborative teams, will we also support the individual researcher? Can we use grids to democratise computation?

31. Slide 31 CARMEN - Scales of Integration resolving the ‘neural code’ from the timing of action potential activity determining ion channel contribution to the timing of action potentials examining integration within networks of differing dimensions Understanding the brain may be the greatest informatics challenge of the 21 st century

32. Slide 32 CARMEN Consortium Leadership & Infrastructure Colin Ingram Paul Watson Leslie SmithJim Austin

33. Slide 33 CARMEN Consortium International Partners Daniel Gardner (Cornell) Lead for the US NIH, Neuroscience Information Framework and Brain ML Shiro Usui (RIKEN Brain Science Institute) Lead for the Japan Node of the International Neuroinformatics Coordinating Facility Sten Grillner (Karolinska Institute) Chairman of the OECD, International Neuroinformatics Coordinating Facility Ad Aertsen (Freiburg) Neural network modelling and large-scale simulations George Gerstein (Pennsylvania) Analysis of spike pattern trains

34. Slide 34 CARMEN Consortium Commercial Partners - applications in the pharmaceutical sector - interfacing of data acquisition software - application of infrastructure - commercialisation of tools

35. 16 th March 2006 NanoCMOSgriD Meeting the Design Challenges of Nano-CMOS Electronics The Challenge Ischia, Italy - 9-21 July 2006 Toshiba 04 Device diversification 90nm: HP, LOP, LSTP 45nm: UTB SOI 32nm: Double gate

36. 16 th March 2006 NanoCMOSgriD Meeting the Design Challenges of Nano-CMOS Electronics Advanced Processor Technologies Group (APTGUM) Device Modelling Group (DMGUG) Electronic Systems Design Group (ESDGUS) Intelligent Systems Group (ISGUY) National e-Science Centre (NeSC) Microsystems Technology Group (MSTGUG) Mixed-Mode Design Group in IMNS (MMDGUE) e-Science NorthWest Centre (eSNW) University Partners Ischia, Italy - 9-21 July 2006

37. 16 th March 2006 NanoCMOSgriD Meeting the Design Challenges of Nano-CMOS Electronics Industrial Partners Global EDS vendor and world TCAD leader 600 licences of grid implementation, model implementation UK fabless design company and world microprocessor leader Core IP, simulation tools, staff time UK fabless design company and world mixed mode leader Additional PhD studentship for mixed mode design Global semiconductor player with strong UK presence Access to technology, device data, processing Global semiconductor player with strong UK presence Access to technology, device data, processing Global semiconductor player with UK presence CASE studentship, interconnects Trade association of the microelectronics industry in the UK Recruiting new industrial partners and dissemination

38. Ischia, Italy - 9-21 July 200638

39. Ischia, Italy - 9-21 July 200639 Grids in context Part of a long-term drive for distributed computing –A new and ambitious form Search for trade-offs & multiple uses –Leads to many varieties –Multiple stake holders Many good reasons for building & using grids Question –Will we have many grids or a consistent general purpose “foundation” grid? What are the minimum standards across the grids Collaboration is a key driver & enabler

40. Ischia, Italy - 9-21 July 200640 Minimum Grid Functionalities Supports distributed computation –Data and computation –Over a variety of hardware components (servers, data stores, …) Software components (services: resource managers, computation and data services) –With regularity that can be exploited By applications By other middleware & tools By providers and operations –It will normally have security mechanisms To develop and sustain trust regimes

41. Ischia, Italy - 9-21 July 200641 After the break Distributed system challenges Service Oriented Architectures Examples of the basic architecture

42. Ischia, Italy - 9-21 July 200642