1. outline.1 Grid Computing Fall 2011 Tuesday/Thursday 9:30 am - 10:45 pm Instructors © 2011 B. Wilkinson/Clayton Ferner. Modification date: Aug 22, 2011 Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of North Carolina Charlotte

2. outline.2 Grid Computing Using geographically distributed and interconnected computers together for computing and for resource sharing. “The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks

3. outline.3 Virtual Organization Usually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment. The geographically distributed grid computing team and their resources is called a virtual organization. The resources shared include software and experimental data.

4. outline.4 Interconnections Usually grid computing employs the Internet to interconnect the computers. Standard Internet protocols are used.

5. Grid Course Rather unique - combine distance learning techniques with distributed computer systems creating both a virtual organization of students and a distributed Grid computing platform. Provides hands-on experiences of Grid computing software and the underlying techniques outline.5

6. Student Learning Outcomes (What you will know or be able to do at the end of the semester) 1.Students gain knowledge of the concepts of Grid computing including: job management, security, certificates and digital signatures, scheduling, web and grid services, index services, notification, and workflow management and portal tools. 2.Students gain knowledge of the infrastructure and mechanics of the software that implements a Grid. 3.Students implement algorithms in grid services. 4.Students implement a solution to a problem that requires the use of multiply Grid resources at multiply sites.

7. outline.7 Course credit This course can be taken by students at any university connected to the NCREN, for credit at their institution. Course number assigned by the institution. Listed as an undergraduate course but can be taken for graduate credit with approval of your institution. More expected from graduate students.

8. outline.8 Course virtual organization Six sites: Appalachian State University East Carolina University University of North Carolina, Ashville University of North Carolina, Charlotte University of North Carolina, Wilmington Winston-Salem State University

9. outline.9 Course grid structure - primary sites UNC-WUNC-C Course portal (on coit-grid02.uncc.edu) torvalds.cis.uncw.edu coit-grid01.uncc.edu coit-grid02.uncc.edu coit-grid03.uncc.edu coit-grid04.uncc.edu coit-grid05.uncc.edu coit-grid06.uncc.edu coit-grid07.uncc.edu Certificate Authority on both UNCC cluster and UNCW cluster (see later)

10. coit-grid01-4: Each two Xeon processors (3.4Ghz) 8GB main memory coit-grid05: Dell R900, four quad-core Xeon processors (2.93Ghz) 64GB main memory 1.2 TB disk coit- grid01 switch coit- grid05 coit- grid03 coit- grid02 coit- grid04 All user’s home directories on coit-grid05 (NFS) UNCC cluster coit-grid01.uncc.edu – coit-grid7.uncc.edu coit- grid06 NVIDIA Tesla GPU (448 core Fermi) Login from within the campus only Login from on-campus or off-campus Use coit-grid01.uncc.edu coit- grid07 NVIDIA Tesla GPU (448 core Fermi) coit-grid07: GPU server, X5560 2.8GHz quad- core Xeon processor with NVIDIA 2050 GPU, 12GB main memory

11. Six Dell PowerEdge 1850 Servers 2.8 Ghz quad-core processors Nine Sunfire X4100 servers 2.6 Ghz quad- core processors UNCW cluster torvalds.cis.uncw.edu

12. outline.12 Class schedule Each university has its own class schedule, see: http://www.cs.uncc.edu/~abw/ITCS4146F11/ academiccalender.html Classes will start on Tuesday August 23, 2011 and will end on Tuesday Dec 6, 2011. to accommodate different schedules.

13. outline.13

14. outline.14 Prerequisites Programming skills as acquired by typical junior/ senior undergraduate Computer Science student. Programs either (simple) C programs or (simple) Java programs depending upon context. It is expected that you have a computer (PC or mac)! Some work best done on your own computer. Grid computing platform is a Linux system. You will need to be able to perform (simple) Linux system commands. We provide documentation.

15. outline.15 Course Home Page http://www.csc.uncw.edu/~cferner/ITCS4146F11/ index.html or http://www.cs.uncc.edu/~abw/ITCS4146F11 for announcements, slides, assignments, reading materials, tests dates, etc. Visit regularly.

16. outline.16 http://www.cs.uncc.edu/~abw/ITCS4146F11

17. outline.17 Course Text Grid Computing: Techniques and Applications Barry Wilkinson University of North Carolina, Charlotte Chapman & Hall/CRC Taylor and Francis Group LLC, 2009 ISBN: 978-1-4200-6953-2 http://coitweb.uncc.edu/~abw/GridComputingBook/index.html

18. outline.18 Outline of Topics Introduction to distributed/Grid computing Job management, schedulers Workflow Grid computing system infrastructure design Grid computing security Portal software design Grid-enabling applications Grid computing using pattern-programming (new for 2011) HPC cloud computing (new for 2011) More details of course home page

19. outline.19 Assignments and Grading 7-8 assignments covering: –Job submission, thro portal, command line –Job scheduling –Workflow editor –Grid services –Portlet design –Possibly assignment on new 2011 materials Each assignment 1-2 weeks. Detailed assignment write-ups, see course home page. Class tests/on-line quizzes (2)‏ Final test/on-line quiz Small print: Subject to change. The instructor reserves the right to change the assignments and the grading to make it easier or harder. 60% 25% 15% Small print

20. outline.20 Prewritten Programming Assignments Detailed instructions provided on achieving a task (creating a grid/web service, running a GT 4 job, etc.)‏ Simply follow instructions. At end, typically asked to extend the work – e.g. add functionality to a service. Write a report of what you did and submit through Moodle, see later for details.

21. outline.21 Systems and Software Two types of systems used: Grid computing servers -Will be used for some assignments, most notably to schedule and run jobs. -Access: Through a web-based portal, or Though an ssh connection. depending upon assignment

22. outline.22 Lab or personal PCs Will be used for some assignments. Require specific open-source software packages installed. Packages can easily be downloaded and installed on your own PC, so that you can do the work at home. Ideally students should install these software packages on their own system as directed in assignments to do assignments. You will learn so much!

23. outline.23 Instructors details UNC-Charlotte Barry Wilkinson Department of Computer Science University of North Carolina, Charlotte Home page: http://www.cs.uncc.edu/~abw Email: abw@uncc.edu Office Hours Tuesday/Thursday: 11:00 am to 12:30 pm

24. outline.24 Instructors details UNC-Wilmington Clayton Ferner Department of Computer Science University of North Carolina Wilmington Home page: http://people.uncw.edu/cferner Email: cferner@uncw.edu Office Hours MW: 8:30 am to11:00 am

25. outline.25 Expectations Read all materials provided. Read slides before class. Take additional notes during class Ask questions during class and participate in class discussion.

26. outline.26 NCREN facility (North Carolina Research and Education Network)‏ Site interaction Each site will be using their NCREN facility, which provides microphones for individuals to speak. Please feel fee to speak at suitable times but remember that NCREN needs to be able to recognize the site and speaker, so first announce your institution and name.

27. outline.27 NCREN facility continued Since most microphones are turned on all the time, any sound will be heard across all sites unless a site turns their microphones off, so try to avoid unnecessary sounds. Fans from a laptop can be especially disturbing, so move laptop away from a microphone. Turn cell phones off.

28. outline.28 NCREN Video Class Recording The lectures are available after 24 hours. Details to be provided.

29. outline.29 Acknowledgements Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grants #0410667/0533334 and #0737318/0737269/0737208 and by University of North Carolina, Office of the President. Their support is gratefully acknowledged. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

30. Questions outline.30

31. Questions What is Grid Computing? a)Using geographically distributed and interconnected computers together for computing and for resource sharing b)Using the Internet c)Using distance computers d)Using computers geographically distributed outline.31

32. outline.32 Questions What is a virtual organization? a)A grid computing team and their resources b)A geographically distributed team c)The geographically distributed grid computing team and their resources d)A geographically distributed set of resources

33. outline.33 Questions What should you do if you miss a class? a)Drop the course b)Forget about it c)Ask a classmate what you missed d)View the video of the lecture