1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte

2 Grid Computing Using geographically distributed and interconnected computers together for computing and for resource sharing.

3 “The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks

4 Need to harness computers Original driving force behind grid computing the same as behind the early development of networks that became the Internet: –Connecting computers at distributed sites for high performance computing.

5 Virtual Organization Usually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment. Geographically distributed grid computing team called a virtual organization. The resources shared include software and experimental data. Crosses multiple administrative domains.

6 Resource sharing and collaborative computing Grid computing is about collaborating and resource sharing as much as it is about high performance computing. Can share much more than just computers: –Storage –Sensors for experiments at particular sites –Application Software –Databases –Network capacity, …

7 Applications Originally e-Science applications –Computational intensive Not necessarily one big problem but a problem that has to be solved repeatedly with different parameters. –Data intensive. –Experimental collaborative projects Now also e-Business applications to improve business models and practices.

8 Interconnections and Protocols Usually grid computing employs the Internet to interconnect the computers. Standard Internet protocols are used. Focus now on using standard Internet protocols and technology, i.e. HTTP, SOAP, web services, etc.

9 Web Services-Based Grid Computing Grid Computing now strongly based upon web services. Large number of newly proposed grid computing standards: –WS-Resource Framework (WSRF) –WS-Addressing –etc., etc. …..

10 History Began in mid 1990’s with experiments using computers at geographically dispersed sites. Seminal experiment – “I-way” experiment at 1995 Supercomputing conference (SC’95), using 17 sites across the US running: –60+ applications. –Existing networks (10 networks).

Distributed computing Remote Procedure calls (RPC) Concept of service registry Beginnings of service oriented architecture Object oriented approaches Java Remote Method Invocation (RMI) CORBA (Common Request Broker Architecture) Cluster computing Software Techniques: Computing platforms: Parallel computers Geographically distributed computers (Grid computing in the broadest sense) Web services SC’95 experiment

12 Computational Grid Applications Biomedical research Industrial research Engineering research Studies in Physics and Chemistry

NSF Network for Earthquake Engineering Simulation (NEES) Transform our ability to carry out research vital to reducing vulnerability to catastrophic earthquakes I. Foster

14 Earth System Grid I. Foster

15 Grid networks for collaborative grid computing projects Grids have been set up at the local level, national level, and international level throughout the world, to promote grid computing

16 Close to home: From “Grid Computing in the Industry” by Wolfgang Gentzsch, presentation to Fall 2004 grid computing course. Full set of slides on course home page.

17 TeraGrid Funded by NSF in 2002 to link 5 supercomputer sites with 40 Gb/s links

18 National Grids Many countries have embraced grid computing and set-up grid computing infrastructure: UK e-Science grid Grid-Ireland NorduGrid DutchGrid POINIER grid (Poland) ACI grid (France) Japanese grid etc, etc., …

19 UK e-Science Grid

20 Globus Project Open source software toolkit developed for grid computing. Roots in I-way experiment. Work started in Four versions developed to present time. Reference implementations of grid computing standards. Defacto standard for grid computing.

21 GSI (Grid Security Infrastructure) –Grid security. MDS (Monitoring and discovery Service) –Interface to system and service information. GRAM (Grid Resource Allocation Manager) –Remote job submission and control. GridFTP –Secure data transfer. Globus Key Components

22 Globus Toolkit: Recent History GT2 (2.4 released in 2002) –GRAM, MDS, GridFTP, GSI. GT3 (3.2 released mid-2004): redesign –OGSA (Open Grid Service Architecture)/OGSI (Open Grid Services Infrastructure) based. –Introduced “Grid services” as an extension of web services. –OGSI now abandoned. GT4 (released April 2005): major redesign –WSRF (Web service Resource Framework) based. –Grid standards merged with Web services.

23 Grid Computing Course Instructors: Barry Wilkinson and Clayton Ferner Several faculty and students significantly helped at various sites – “virtual organization” In Fall 2004, 43 students took course at 8 institutions Fall 2004 Participating Sites (Fall 2005)

24 Fall 2004 Guest Speakers Professor Daniel A. Reed, Chancellor's Eminent Professor, Vice Chancellor for IT and CIO, UNC-Chapel Hill: –“Grid computing: 21st Century Challenges.” Dr. Wolfgang Gentzsch, Managing Director, MCNC Grid Computing and Networking Services: –“Grid Computing in the Industry” Chuck Kesler, Director, Grid Deployment and Data Center Services, MCNC: –“Security Policy, Legal, and Regulatory Challenges in Grid Computing Environments” Professor Ian Foster : Ian Foster, Argonne National Laboratory and University of Chicago: –“The Grid: Beyond the Hype” Taped presentation (originally given at Duke University, Sept. 14, 2004).

25 Fall 2005 Grid Computing Course Currently being taught with 12 institutions participating. About 40 students.

26 Course virtual organization Current list of sites receiving course: Appalachian State University Elon University Lenoir Rhyne College NC State University University of North Carolina at Asheville University of North Carolina at Charlotte University of North Carolina, Chapel Hill (grad student, not for credit) University of North Carolina at Pembroke University of North Carolina at Wilmington Wake Technical Community College (Faculty in attendance) Western Carolina University Winston-Salem State University

27 Fall 2005 Guest speakers Lavanya Ramakrishnan, The Renaissance Computing Institute (RENCI), University of North Carolina at Chapel Hill, North Carolina State University, and Duke University. Team from SURAGrid, a working grid with more than 19 institutions across the country. Details of presentation being worked out.

28 Fall 2005 Course grid structure with Certificate Authorities WCU UNC-C UNC-ANCSU ASU MCNC CA

29 Users certified by a local CA UNC-C CA

30 CA’s with Mutual Trust UNC-C CA NCSU CA

31 More information on course Course home page

32 Acknowledgements Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grants and (with supplementary funding) and by two grants from University of North Carolina, Office of the President. One of these grants provided computing equipment at 9 sites, including UNC-C