1. Grid Computing and the Gridbus Middleware: Making the Global Cyberinfrastructure for e-Science and e-Business Applications a Reality Dr. Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software Engineering The University of Melbourne, Australia www.buyya.com www.gridbus.org www.buyya.com www.gridbus.org

2. 2 GRIDS Lab @ Melbourne Youngest and one of the rapidly growing research labs in our School/University: Founded in 2002 Houses: Research Fellows (3) Research Programmers (3) PhD candidates (10) Honours/Masters students (5+) Funding National and International organizations Australian Research Council Many industries (Sun, StorageTek, Microsoft, IBM, Microsoft) University-wide collaboration: Faculties of Science, Engineering, and Medicine Many national and international collaborations. Academics Industries Software: Widely in academic and industrial users. Publication: My research team over 20% of our Dept’s research output. EducationR & D + Community Services: e.g., IEEE TC for Scalable Computing

3. 3 Books at a Glance: Co-authored & edited

4. 4 Agenda Introduction Utility Networks and Grid Computing Application Drivers and Various Types of Grid Services Global Grids and Challenges Security, resource management, pricing models, … Service Oriented Grids and Grid Economy SOGA, Grid Market Directory, Grid Bank, Broker Grid Service Broker Architecture, Design and Implementation Performance Evaluation: Experiments in Creation and Deployment of Applications on Global Grids A Case Study in High Energy Physics Summary and Conclusion

5. 5 4 Essential Utilities and Delivery Networks (2) Electricity (3) Gas(1) Water Water Distribution Network (4) Telephone Telecom Networks

6. 6 (5) Computing Grid: Delivery IT services as the 5 th utility (Power Grid inspiration) eScience eBusiness eGovernment eHealth Multilingual eEducation …

7. 7 Power Grid Inspiration: Seamlessly delivering electricity as a utility to users

8. 8 Why Grid Computing Now? Let us look at the Evolution of ICT

9. 9 Computing and Communication Technologies Evolution & Timeline * Sputnik 19601970197519801985199019952000 * ARPANET * Email * Ethernet * TCP/IP * IETF * Internet Era* WWW Era * Mosaic * XML *PC Clusters *Crays *MPPs *Mainframes * HTML * W3C *P2P *Grids *XEROX PARC worm COMPUTING Communication * Web Services * Minicomputers *PCs *WS Clusters *PDAs *Workstations *HTC 2010 * e-Science * Computing Utility * e-Business * SocialNet Control Centralised Decentralised

10. 10 Powerful ICT Elements Availability: Defining the growth rate of network & computing speed, and their value. Moore’s Law. Transistors on a single chip doubles ~ every 18–24 months. Gilder’s Law. Aggregate bandwidth triples ~ every year. Metcalfe’s Law. The value of a network may grow exponentially with the number of participants. Source: Cambridge Energy Resource Associates

11. 11 2100 Personal DeviceSMPs or SuperComputers Local Cluster Global Grid S E R V I C E S + P E R F O R M A N C E Inter Planet Grid Individual Group Department Campus State National Globe Inter Planet Universe Administrative Barriers Enterprise Cluster/Grid Computing is Scaling: Towards Inter-Planetary Level

12. 12 What is Grid? (there are several academic definitions, here is ours) A type of parallel and distributed system that enables the sharing, exchange, selection, & aggregation of geographically distributed “autonomous” resources: Computers – PCs, workstations, clusters, supercomputers, laptops, notebooks, mobile devices, PDA, etc; Software – e.g., ASPs renting expensive special purpose applications on demand; Catalogued data and databases – e.g. transparent access to human genome database; Special devices/instruments – e.g., radio telescope – SETI@Home searching for life in galaxy. People/collaborators. depending on their availability, capability, cost, and user QoS requirements. Wide area

13. 13 How does Grids look like? A Bird Eye View of a Global Grid Grid Resource Broker Resource Broker Application Grid Information Service Grid Resource Broker database R2R2 R3R3 RNRN R1R1 R4R4 R5R5 R6R6 Grid Information Service

14. 14 Classes of Grid Services / Types of Grids Computational Services – CPU cycles Pooling computing power: SETI@Home, TeraGrid, AusGrid, ChinaGrid, IndiaGrid, UK Grid,… Data Services Collaborative data sharing generated by instruments, sensors, persons: LHC Grid, Napster Application Services Access to remote software/libraries and license management—NetSolve Interaction Services eLearning, Virtual Tables, Group Communication (Access Grid), Gaming Knowledge Services The way knowledge is acquired, processed and managed—data mining. Utility Computing Services Towards a market-based Grid computing: Leasing and delivering Grid services as ICT utilities. Computational Grid Data Grid ASP Grid Interaction Grid Knowledge Grid Utility Grid infrastructure Users

15. 15 How Are Grids Used? High-performance computing Collaborative data-sharing Collaborative design Drug discovery Financial modeling Data center automation High-energy physics Life sciences E-Business E-Science Natural language processing & Data Mining Utility computing

16. 16 1. [Grid Use in Science] Online Medical Instrumentation and Neuroscience Osaka Univ. Hospital Osaka Univ. DV transfer Life-electronics laboratory, AIST Data Analysis Provision of MEG Provision of expertise in the analysis of brain function Cybermedia Center Data Generation Analysis Results A Virtual Laboratory for medicine and brain science Knowledge sharing MEG sharing? Data Sharing

17. 17 2. [Grid Use in Business] Enterprise Computing Application Traditional Model Grid-based Model Email server Web server Database server Apps server Upgrade to a new server to handle more users Utilise IT infrastructure effectively Service Virtualization Layer & Load Balancing

18. 18 Agenda Introduction Utility Networks and Grid Computing Application Drivers and Various Types of Grid Services Global Grids and Challenges Security, resource management, pricing models, … Service Oriented Grids and Grid Economy SOGA, Grid Market Directory, Grid Bank, Broker Grid Service Broker Architecture, Design and Implementation Performance Evaluation: Experiments in Creation and Deployment of Applications on Global Grids A Case Study in High Energy Physics Summary and Conclusion

19. 19 Some Characteristics of Grids Numerous resources Different security requirements & policies Resources are heterogeneous Geographically distributed Different resource management policies Connected by heterogeneous, multi-level networks Owned by multiple organizations & individuals Unreliable resources and environments Slide by Hiro

20. 20 Grid Challenges Security Resource Allocation & Scheduling Data locality Network Management System Management Resource Discovery Uniform Access Computational Economy Application Construction

21. 21 Some Grid Initiatives Worldwide Australia Nimrod-G Gridbus DISCWorld GrangeNet. APACGrid ARC eResearch Brazil OurGrid, EasyGrid LNCC-Grid + many others China ChinaGrid – Education CNGrid - application Europe UK eScience EU Grids.. and many more... India Garuda  Japan NAGERI Korea... N*Grid Singapore NGP USA Globus GridSec AccessGrid TeraGrid Cyberinfrasture and many more... Industry Initiatives IBM On Demand Computing HP Adaptive Computing Sun N1 Microsoft -.NET Oracle 10g Infosys – Enterprise Grid Satyam – Business Grid StorageTek –Grid.. and many more Public Forums Global Grid Forum Australian Grid Forum Conferences: CCGrid Grid HPDC E-Science http://www.gridcomputing.com 1.3 billion – 3 yrs 1 billion – 5 yrs 450million – 5 yrs 486million – 5 yrs 1.3 billion (Rs) 27 million 2? billion 120million – 5 yrs

22. 22 Open-Source Grid Middleware Projects

23. 23 The Gridbus Project @ Melbourne: Enable Leasing of ICT Services on Demand WWG Pushes Grid computing into mainstream computing Gridbus

24. 24

25. 25 Why Grid Economy for Gridbus?: (1) Sustained Resourced Sharing and (2) Effective Management of Shared Resources Grid Economy

26. 26 Agenda Introduction Utility Networks and Grid Computing Application Drivers and Various Types of Grid Services Global Grids and Challenges Security, resource management, pricing models, … Service Oriented Grids and Grid Economy SOGA, Grid Market Directory, Grid Bank, Broker.. Grid Service Broker Architecture, Design and Implementation Performance Evaluation: Experiments in Creation and Deployment of Applications on Global Grids A Case Study in High Energy Physics Summary and Conclusion

27. 27 Grid Node N A Reference Service-Oriented Architecture for Utility Grids Grid Consumer Programming Environments Grid Resource Broker Grid Service Providers Grid Explorer Schedule Advisor Trade Manager Job Control Agent Deployment Agent Trade Server Resource Allocation Resource Reservation R1R1 Misc. services Information Service R2R2 RmRm … Pricing Algorithms Accounting Grid Node1 … Grid Middleware Services … … Health Monitor Grid Market Services JobExec Info ? Secure Trading QoS Storage Sign-on Grid Bank Applications Data Catalogue

28. 28 Gridbus and Complementary Technologies – realizing Utility Grid AIX Solaris WindowsLinux.NET Grid Fabric Software Grid Applications Core Grid Middleware User-Level Middleware (Grid Tools) Grid Bank Grid Exchange & Federation JVM Grid Brokers: X-Parameter Sweep Lang. Gridbus Data Broker MPI CondorSGETomcatPBS Alchemi Workflow IRIXOSF1 Mac Libra GlobusUnicore … … Grid Market Directory PDBCDB Worldwide Grid Grid Fabric Hardware … … PortalsScienceCommerceEngineering … … Collaboratories … … Workflow Engine Grid Storage Economy Grid Economy NorduGridXGrid ExcellGrid Nimrod-G GRIDSIMGRIDSIM Gridscape

29. 29 On Demand Assembly of Services: Putting Them All Together ASP Catalogue Grid Info Service Grid Market Directory GSP (Accounting Service) Gridbus GridBank GSP (e.g., UofM) PE GSP (e.g., VPAC) PE GSP (e.g., IBM) CPU or PE Grid Service (GS) (Globus) Alchemi GS GTS Cluster Scheduler Job 8 Grid Resource Broker 2 Visual Application Composer Application Code Explore data 1 36 45 Results 97 Results+ Cost Info 10 11 Bill 12 Data Catalogue

30. 30

31. 31 Alchemi:.NET-based Enterprise Grid Platform & Web Services Internet Alchemi Worker Agents Alchemi Manager Alchemi Users Web Services SETI@Home like Model General Purpose Dedicated/Non-dedicate workers Role-based Security.NET and Web Services C# Implementation GridThread and Job Model Programming Easy to setup and use Widely in use!

32. 32 Some Users of Alchemi Tier TechnologiesTier Technologies, USA Large scale document processing using Alchemi framework CSIROCSIRO, Australia Natural Resource Modeling The Friedrich Miescher Institute (FMI) for Biomedical ResearchThe Friedrich Miescher Institute (FMI) for Biomedical Research, Switzerland Patterns of transcription factors in mammalian genes Satyam Computers Applied Research LaboratorySatyam Computers Applied Research Laboratory, India Micro-array data processing using Alchemi framework The University of Sao PauloThe University of Sao Paulo, Brazil The Alchemi Executor as a Windows Service stochastix GmbHstochastix GmbH, Germany Serving clients in International Banking/Finance sector Many users in Universities: See next for an example.

33. 33 Students' project gives old computers new life - 1/25/2005

34. 34 Agenda Introduction Utility Networks and Grid Computing Application Drivers and Various Types of Grid Services Global Grids and Challenges Security, resource management, pricing models, … Service Oriented Grids and Grid Economy SOGA, Grid Market Directory, Grid Bank, Broker.. Grid Service Broker Architecture, Design and Implementation Performance Evaluation: Experiments in Creation and Deployment of Applications on Global Grids A Case Study in High Energy Physics Summary and Conclusion

35. 35 A resource broker for scheduling task farming data Grid applications with static or dynamic parameter sweeps on global Grids. It uses computational economy paradigm for optimal selection of computational and data services depending on their quality, cost, and availability, and users’ QoS requirements (deadline, budget, & T/C optimisation) Key Features A single window to manage & control experiment Programmable Task Farming Engine Resource Discovery and Resource Trading Optimal Data Source Discovery Scheduling & Predications Generic Dispatcher & Grid Agents Transportation of data & sharing of results Accounting Grid Service Broker (GSB)

36. 36 Gridbus Broker Architecture Grid Middleware Gridbus Client Gribus Client Grid Info Server Schedule Advisor Trading Manager Gridbus Farming Engine Record Keeper Grid Explorer GE GIS, NWS TM TS RM & TS Grid Dispatcher RM: Local Resource Manager, TS: Trade Server G G C U Globus enabled node. A L Alchemi enabled node. (Data Grid Scheduler) Data Catalog Data Node Unicore enabled node. $ $ $ App, T, $, Opt (Bag of Tasks Applications)

37. 37 Gridbus Broker and Remote Service Access Enablers Alchemi Gateway UnicoreData Store Access Technology Grid FTP SRB -PBS -Condor -SGE Globus Job manager fork()batch() Gridbus agent Data Catalog -PBS -Condor -SGE -XGrid SSH fork() batch() Gridbus agent Credential Repository MyProxy Home Node/Portal Gridbus Broker fork() batch() -PBS -Condor -SGE -Alchemi -XGrid Portlets

38. 38 Gridbus Services for eScience applications Application Development Environment: XML-based language for composition of task farming (legacy) applications as parameter sweep applications. Task Farming APIs for new applications. Web APIs (e.g., Portlets) for Grid portal development. Threads-based Programming Interface Workflow interface and Gridbus-enabled workflow engine. Resource Allocation and Scheduling Dynamic discovery of optional computational and data nodes that meet user QoS requirements. Hide L ow-Level Grid Middleware interfaces Globus (v2, v4), SRB, Alchemi, Unicore, and ssh-based access to local/remote resources managed by XGrid, Condor, SGE.

39. 39 Discover Resources Distribute Jobs Establish Rates Meet requirements ? Remaining Jobs, Deadline, & Budget ? Evaluate & Reschedule Discover More Resources Compose & Schedule Adaptive Scheduling Steps

40. 40 Deadline (D) and Budget (B) Constrained Scheduling Algorithms AlgorithmExecution Time (D) Execution Cost (B) Compute Grid Data Grid Cost OptLimited by DMinimize Yes Cost-Time OptMinimize if possible Minimize Yes Time OptMinimizeLimited by B Yes Conservative- Time Opt MinimizeLimited by B, jobs have guaranteed minimum budget Yes

41. 41

42. 42 Figure 3 : Logging into the portal. Drug Design Made Easy! Click Here for Demo

43. 43 Excel Plugin to Access Gridbus Services Excel ExcelGrid Add-In ExcelGrid Runner ExcelGridJob ExcelGrid MiddlewareGridbus BrokerEnterprise Grid 210 0

44. 44 Agenda Introduction Utility Networks and Grid Computing Application Drivers and Various Types of Grid Services Global Grids and Challenges Security, resource management, pricing models, … Service Oriented Grids and Grid Economy SOGA, Grid Market Directory, Grid Bank, Broker.. Grid Service Broker Architecture, Design and Implementation Performance Evaluation: Experiments in Creation and Deployment of Applications on Global Grids A Case Study in High Energy Physics Summary and Conclusion

45. 45 Case Study: High Energy Physics and Data Grid The Belle Experiment KEK B-Factory, Japan Investigating fundamental violation of symmetry in nature (Charge Parity) which may help explain “why do we have more antimatter in the universe?”. Collaboration 1000 people, 50 institutes 100’s TB data currently

46. 46 Case Study: Event Simulation and Analysis B0->D*+D*-Ks Simulation and Analysis Package - Belle Analysis Software Framework (BASF) Experiment in 2 parts – Generation of Simulated Data and Analysis of the distributed data  Analyzed 100 data files (30MB each) that were distributed among the five nodes within Australian Belle DataGrid platform.

47. 47 Australian Belle Data Grid Testbed VPAC Melbourne

48. 48 Belle Data Grid (GSP CPU Service Price: G$/sec) NA G$4 Data node G$6 VPAC Melbourne G$2

49. 49 Belle Data Grid (Bandwidth Price: G$/MB) NA G$4 Data node G$6 VPAC Melbourne G$2 34 31 38 31 30 33 36 32

50. 50 Deploying Application Scenario A data grid scenario with 100 jobs and each accessing remote data of ~30MB Deadline: 3hrs. Budget: G$ 60K Scheduling Optimisation Scenario: Minimise Time Minimise Cost Results:

51. 51 Time Minimization in Data Grids 0 10 20 30 40 50 60 70 80 123456789101112131415161718192021222324252627282930313233343536373839404142 Time (in mins.) Number of jobs completed fleagle.ph.unimelb.edu.aubelle.anu.edu.aubelle.physics.usyd.edu.aubrecca-2.vpac.org

52. 52 Results : Cost Minimization in Data Grids 0 10 20 30 40 50 60 70 80 90 100 13579111315171921232527293133353739414345474951535557596163 Time(in mins.) Number of jobs completed fleagle.ph.unimelb.edu.aubelle.anu.edu.aubelle.physics.usyd.edu.aubrecca-2.vpac.org

53. 53 Observation Organization Node detailsCost (in G$/CPU-sec)Total Jobs Executed TimeCost CS,UniMelbbelle.cs.mu.oz.au 4 CPU, 2GB RAM, 40 GB HD, Linux N.A. (Not used as a compute resource) -- Physics, UniMelbfleagle.ph.unimelb.edu.au 1 CPU, 512 MB RAM, 40 GB HD, Linux 23 94 CS, University of Adelaide belle.cs.adelaide.edu.au 4 CPU (only 1 available), 2GB RAM, 40 GB HD, Linux N.A. (Not used as a compute resource) -- ANU, Canberrabelle.anu.edu.au 4 CPU, 2GB RAM, 40 GB HD, Linux 42 2 Dept of Physics, USyd belle.physics.usyd.edu.au 4 CPU (only 1 available), 2GB RAM, 40 GB HD, Linux 472 2 VPAC, Melbournebrecca-2.vpac.org 180 node cluster (only head node used), Linux 623 2

54. 54 Agenda Introduction Utility Networks and Grid Computing Application Drivers and Various Types of Grid Services Global Grids and Challenges Security, resource management, pricing models, … Service Oriented Grids and Grid Economy SOGA, Grid Market Directory, Grid Bank, Broker.. Grid Service Broker Architecture, Design and Implementation Performance Evaluation: Experiments in Creation and Deployment of Applications on Global Grids A Case Study in High Energy Physics Summary and Conclusion

55. Alessandro Volta in Paris in 1801 inside French National Institute shows the battery while in the presence of Napoleon I Fresco by N. Cianfanelli (1841) (Zoological Section "La Specula" of National History Museum of Florence University)

56. 56 ….and in the future, I imagine a Worldwide Power (Electrical) Grid …... What ?!?! This is a mad man… Oh, mon Dieu !

57. 57 2006 - 1801 = 205 Years (Recent R&D: Delivering Internet services via Electric cables).

58. 58 When is we going get IT as the 5 th utility? (water, electricity, gas, telephone, IT) eScience eBusiness eGovernment eHealth Multilingual eEducation …

59. 59 Summary and Conclusion Grids exploit synergies that result from cooperation of autonomous entities: Resource sharing, dynamic provisioning, and aggregation at global level  Great Science and Great Business! Grids have emerged as enabler for Cyberinfrastructure that powers e-Science and e-Business applications. Grids allow users to dynamically lease Grid services at runtime based on their quality, cost, availability, and users QoS requirements. Delivering ICT services as computing utilities. Grids offer enormous opportunities for realizing e-Science and e-Business at global level. Use our Gridbus technology to realise this and make money!

60. 60 Thank you & Any Questions ? Web - http://www.gridbus.orghttp://www.gridbus.org

61. 61 Further References

62. Grid Computing and the Gridbus Middleware: Making the Global Cyberinfrastructure for e-Science and e-Business Applications a Reality Dr. Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software Engineering The University of Melbourne, Australia www.buyya.com www.gridbus.org www.buyya.com www.gridbus.org

63. Backup Slides

64. 64 Three Laws of Computing Performance: Defining the growth rate of network & computing speed, and their value. Moore’s Law. Transistors on a single chip doubles ~ every 18–24 months. Gilder’s Law. Aggregate bandwidth triples ~ every year. Metcalfe’s Law. The value of a network may grow exponentially with the number of participants. Source: Cambridge Energy Resource Associates

65. 65 Resources Used and their Service Price Organization Node detailsRoleCost (in G$/CPU-sec) CS,UniMelbbelle.cs.mu.oz.au 4 CPU, 2GB RAM, 40 GB HD, Linux Broker host, Data host, NWS server N.A. (Not used as a compute resource) Physics, UniMelbfleagle.ph.unimelb.edu.au 1 CPU, 512 MB RAM, 40 GB HD, Linux Replica Catalog host, Data host, Compute resource, NWS sensor 2 CS, University of Adelaide belle.cs.adelaide.edu.au 4 CPU (only 1 available), 2GB RAM, 40 GB HD, Linux Data host, NWS sensor N.A. (Not used as a compute resource) ANU, Canberrabelle.anu.edu.au 4 CPU, 2GB RAM, 40 GB HD, Linux Data host, Compute resource, NWS sensor 4 Dept of Physics, USyd belle.physics.usyd.edu.au 4 CPU (only 1 available), 2GB RAM, 40 GB HD, Linux Data host, Compute resource, NWS sensor 4 VPAC, Melbournebrecca-2.vpac.org 180 node cluster (only head node used), Linux Compute resource, NWS sensor 6

66. 66 Network Cost (in Grid $/Currency!)

67. 67 What is Grid? (It means different things to different people) IBM On Demand Computing Microsoft.NET Oracle 10g Sun N1 HP Adaptive Enterprise United Devices and related companies: Harvesting Unused Desktop resources

68. 68 Grid & Related Paradigms Utility Computing Computing “services” No knowledge of provider Enabled by grid technology Utility Computing Computing “services” No knowledge of provider Enabled by grid technology Distributed Computing Loosely coupled Heterogeneous Single Administration Distributed Computing Loosely coupled Heterogeneous Single Administration Cluster Tightly coupled Homogeneous Cooperative working Cluster Tightly coupled Homogeneous Cooperative working Grid Computing Large scale Cross-organizational Geographical distribution Distributed Management Grid Computing Large scale Cross-organizational Geographical distribution Distributed Management

69. 69

70. 70 2. Respiratory Treatment Planning System (Integration and Workflow) Surface Extraction (SJTU) Grid GenerationExperiment (CSIRO) MRI Scans VR Visualization CFD SimulationComparison Virtual Treatment

71. 71

72. 72 A Typical e-Science Scenario