1. 1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE 2010 - The 41st ACM Technical Symposium on Computer Science Education Friday March 12, 2010 Dr. Barry Wilkinson University of North Carolina Charlotte Dr. Clayton Ferner University of North Carolina Wilmington © 2010 B. Wilkinson/Clayton Ferner SIGCSE 2010 Workshop 20 jobsub.ppt Modification date: March 6, 2010 Session 2: Using a command line to execute jobs on a Grid platform 7:40 pm - 8:20 pm

2. Presentation (10 mins) Hands-on experience accessing a Grid platform through a command line (30 mins) 2 Session 2: Using a command line to execute jobs on a Grid platform

3. 3 Remote connection to servers You will need an ssh client to make a secure shell connection. For Windows, more than one option: Putty ssh client WinSCP sftp client (also includes restricted console interface and simple text editor) Linux already has an ssh client and command.

4. Traditional way from a Windows system is to use PuTTY for a command line remote access. PuTTY coit-grid01.uncc.edu or torvalds.uncw.edu depending upon context Select ssh Can save entry and reload http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html 4

5. WinSCP http://winscp.net/eng/index.php 5 Commands

6. All files are provided for the workshop but you will need an editor such as nano below to edit the files in Task 4. Control key commands: - Control-O to save, Control-X to exit 6

7. Each user needs a certificate issued (signed) by a “certificate authority” (CA). A certificate authority is set up on coit- grid02.uncc.edu. Uses Globus simpleCA package. In the student assignment, students learn how to get and store their signed certificates and private key in their account (.globus directory) For Session 2, as with Session 1, we will use the myProxy server that more conveniently holds users credentials for the user. User “certificates” 7

8. Now need to get a proxy certificate to delegate authority. For session 2, we will obtain a proxy from the myProxy server by issuing the command: myproxy-logon -s coit-grid02.uncc.edu You will be prompted for a passphase, which will be the same as your portal password. Can check that you got a proxy with the command: grid-proxy-info which will show the proxy subject and time left. Getting a proxy 8

9. Task 1 Submit a simple job to the local machine Asks you to submit a job (hostname) using the –c option (to specify a binary executable and –s option to specific streaming output back to the console: globusrun-ws -submit -F localhost:8440 -s -c /bin/hostname This should simply work. You are asked to check the output. 9

10. Task 2 Submit a simple job to remote machine Asks you to submit job to a remote machine: globusrun-ws -submit -F torvalds.uncw.edu -s -c /bin/hostname This should simply work. You are asked to check the output. 10

11. Next you are asked to submit the mulch job from Session 1 but using commands and XML job description files. 11 Task 3 Submit a job with a job description document Compute area of flower bed torvaldscoit-grid01 area_ output Compute volume and cost of mulch globus-url-copy mulch_ output globus-url-copy mulch_ output area_ output

12. /usr/local/java/bin/java ${GLOBUS_USER_HOME} myIntegral 0 5 10000 ${GLOBUS_USER_HOME}/area_output ${GLOBUS_USER_HOME}/area_error 1 12 Java program to execute myIntegral job description file

13. Submit job using: globusrun-ws -submit -F localhost:8440 -f myIntegral.xml 13 Submit a job with a job description document

14. Transfer the output to torvalds Use globus-url-copy command: globus-url-copy file:///nfs-home/ /area_output gsiftp://torvalds.uncw.edu/home/grid/ / 14

15. 15 myMulch job description /usr/local/java/bin/java ${GLOBUS_USER_HOME} myMulch area_output ${GLOBUS_USER_HOME}/mulch_output ${GLOBUS_USER_HOME}/mulch_error 1 Java program to execute

16. Next step is run second program, myMulch.java, from coit-grid01 but to run on remote machine torvalds.cis.uncw.edu Command: globusrun-ws -submit -F torvalds.uncw.edu -f myMulch.xml 16 Submit a job to run on a different computer

17. 17 Task 4 File staging (if there is time) Modify job description file to include moving area file to torvalds and moving result back automatically rather than use globus-url-copy, and also add file clean-up