1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday March 12, 2010 Dr. Barry Wilkinson University of North Carolina Charlotte Dr. Clayton Ferner University of North Carolina Wilmington © 2010 B. Wilkinson/Clayton Ferner SIGCSE 2010 Workshop 20 session4.ppt Modification date: Feb 27, 2010 Session 4: Overview of other assignments 9:15 pm - 9:40 pm

Condor scheduler assignment Assignment installing GT4 core, creating, deploying, and testing a GT4 Web service GridSphere portlet design assignment Session 4: Overview of other assignments 2

Condor Scheduler Assignment Tasks: Issue various Condor commands Submit jobs to Condor Manage jobs in job queue C and Java programs Vanilla and Java universes Job and resource ClassAds for matching jobs to resources Using DAGMAN to create workflows Assignment done on severs coit-grid03.uncc.edu and coit-grid05.uncc.edu 3

Systems used for assignment coit-grid01.uncc.edu – coit-grid05.uncc.edu coit-grid01 Users (:8080) Portal Dual Xeon processors Four quad-core Xeon processors, 64GB memory, 1.2 TB RAID disk coit- grid04 switch coit- grid05 coit- grid02 coit- grid03 CA User access User’s home directory (/nfs-home) shared across system External interfaces Used in Condor assignment as written 4

5 Name OpSys Arch State Activity LoadAv Mem ActvtyTime LINUX X86_64 Unclaimed Idle :25:04 LINUX X86_64 Unclaimed Idle :53:00 LINUX X86_64 Unclaimed Idle :29:17 LINUX X86_64 Unclaimed Idle :32:14 LINUX X86_64 Unclaimed Idle :59:18 LINUX X86_64 Unclaimed Idle :59:19 LINUX X86_64 Unclaimed Idle :59:20 LINUX X86_64 Unclaimed Idle :59:21 LINUX X86_64 Unclaimed Idle :59:22 LINUX X86_64 Unclaimed Idle :59:23 LINUX X86_64 Unclaimed Idle :59:16 LINUX X86_64 Unclaimed Idle :10:04 LINUX X86_64 Unclaimed Idle :12:43 LINUX X86_64 Unclaimed Idle :59:19 LINUX X86_64 Unclaimed Idle :59:20 LINUX X86_64 Unclaimed Idle :59:21 LINUX X86_64 Unclaimed Idle :59:22 LINUX X86_64 Unclaimed Idle :59:23 LINUX X86_64 Unclaimed Idle :59:16 LINUX X86_64 Unclaimed Idle :59:17 Total Owner Claimed Unclaimed Matched Preempting Backfill X86_64/LINUX Total Check Condor pool status: condor_status.

6 Submitting a job Create a job description file Submit job with condor_submit hostname_test1 Output: condor_submit condor_test1 Submitting job(s). Logging submit event(s). 1 job(s) submitted to cluster 73. Contents of hostname_test1 : # comment Universe = vanilla Executable = /bin/hostname Output = hostname.out Error = hostname.error Log = hostname.log Should_transfer_files = YES When_to_transfer_output = ON_EXIT Queue

Can query status of Condor queue with: condor_q Get output of form: Queue -- Submitter: coit-grid02.uncc.edu : : ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD abw 5/23 17: :00:00 I uptime 16 jobs; 1 idle, 0 running, 15 held Status: H (hold), R (running), I (idle, waiting for machine), C (Completed), U (unexpanded, never being run) or X (removed). Monitoring 7

8 Managing job  Set up notifications Different Condor universes  Write and submit C program to compute pi by Monte Carlo method  Rewrite in Java and submit to Java universe ClassAd Job/resource matching  Examine resource ClassAds of computers to find out Java version, memory and performance  Add job ClassAd to job description to make job run only on computer with specific version number, memory and performance Other tasks

Condor’s ClassAd Matchmaking Mechanism Fig 3.14 Include in submit description file Held in assessible file on system 9

10 Condor’s workflow scheduler DAGMAN (Directed Acyclic Graph Manager ) Example # diamond.dag Job A a.sub Job B b.sub Job C c.sub Job D d.sub Parent A Child B C Parent B C Child D Job A Job CJob B Job D Start with: condor_submit_dag diamond.dag

11 Some assignment tasks with DAGMAN Write program to compute π -- specifying different random sequences for each of three instances and then construct a DAG as shown below Job CJob B Job A Job D Compute π Compute average

This assignment is based upon a GT4 service described in the book Globus Toolkit 4 Programming Java Services by Borja Sotomayor and Lisa Childers, All the code comes from this book. The book is based upon the on-line tutorial available at Assignment -- Installing GT4 core, creating, deploying, and testing a GT4 Web service 12

Assignment Goals Show how stateful WSRF Web services can be created and deployed in Globus 4.0. Assignment is to be done on one’s own computer (or a lab computer). Requires one to install Globus 4.0 core and associated software – all available for download. 13

Testing installation Start Container Command: globus-start-container -nosec -nosec specifies “no security”, which simplifies assignment (no need for user certificates) Will display list of deployed services. 14

Standard list of deployed services in core Fig 7.7

Purpose of Service To store an integer called value, acted upon by three methods to: Add a to value Subtract a from value Get value Methods given. Further methods will be implemented. Service is stateful (value retained between accesses). public interface Math { public void add(int a); public void subtract(int a); public int getValueRP(); } 16

Math Web Service Resource Resource properties “value” (integer) “ last operation performed” (string) Client Resource Properties Code provided actually two resource properties 17

Steps in Assignment Preliminary set-up - Install GT4 and associated software Download provided files:  WSDL service interface file  Math web service code (in Java)  WSDD Deployment Descriptor file  Client code (Java) to exercise service Build Math service Deploy Math service into GT 4 container Write and compile the client Start container and execute client. Add functionality to service 18

GT4 container Mathservice After Service Deployed

To learn how to deploy portlets within the Gridsphere Grid portal but on your own computer. Fully understand the underlying software structure of JSR 168 grid portals. Design portlets as front-ends to Grid services and applications. GridSphere portlet design assignment 20

Portlets Fig

Fig 8.15 JSR 168 portlet 22

Step 1: Download and Install Tomcat Step 2: Download and Install Gridsphere

Creating your own portlet Goal Create and deploy a portlet that will accept one number and say whether it is odd or even (“oddeven” portlet) The code for this portlet is given. You simply have to deploy it. Later you will to ceate your own portlets. 24

11a.25 Final portlet displayed in GridSphere

26 Make a portlet that allows a user creates a portlet that can add, subtract, multiply and divide two numbers Developing your own portlet Example

Portlet acting as a front-end to a Web service 27

11.28 More Information on Gridsphere See the links on the Gridsphere portal page