1. 159.735 Parallel Computing Globus Toolkit – Grid Ayaka Ohira

2. Overview Grid computing Globus toolkit GT4 architecture GT4 projects How to run a simple program

3. Grid computing “A Grid is a system that coordinates resources that are not subject to centralized control using standard, open, general-purpose protocols and interfaces to deliver nontrivial qualities of service.” - Ian Foster A kind of distributed computing Enables large scale calculations and simulations. http://www.fraunhofer.de/fhg/Images/grid %20computing_kl_tcm6-71852.jpg

4. Globus Toolkit Developed by Globus Allience De facto standard for grid computing Open source Heterogeneous A set of software and services to solve general grid problems.

5. Globus toolkit 1998: Globus toolkit version 1 2002: Globus toolkit 2 2003: Globus toolkit 3 2006: Globus toolkit 4

6. Globus Toolkit 4 (GT4) Extensive use of Web Services Web Services are flexible, loosely coupled and platform and language independent Based on OGSA standard Implemented on Web Service Resource Framework (WSRF)

7. WSRF specification WS-ResourceProperties WS-ResourceLifetime WS-ServiceGroup WS-BaseFaults WS-Notification WS-Addressing

8. GT4 architecture http://www-unix.globus.org/toolkit/about.html

9. Common runtime components (C WS Core) Provide a set of libraries and tools that allows services to be platform independent Tested platforms for C WS Core: IA32/Linux/gcc32 IA64/Linux/gcc64 x86_64/Linux/gcc64 SPARC/Solaris 9/vendorcc32 PowerPC/AIX 5.2/vendorcc32 Mac/OS X/gcc32

10. Security Grid Security Infrastructure (GSI) Provides fundamental security services needed to support grids Message-level security X.509 (Public Key Cryptography) Transport-level security HTTPS (Hyper Text Transport Protocol Secure)

11. Data Management Manages data movement and replication Data transfer: GridFTP Reliable File Transfer (RFT) Data replication Replica Location Service (RLS)

12. Information Services Monitoring and Discovery Service (MDS4) Enable projects to discover needed data from services to make job submission Index service Trigger service

13. Execution Management Grid Resource Allocation Management (GRAM) Provides secure, reliable and sound job execution services Enables users to locate, submit, monitor and cancel remote jobs on Grid-based compute resources Not a job scheduler!

14. Globus toolkit advantage Why is the globus toolkit de facto standard? It is not a solution to grid computing.

15. Grid projects using GT4 NASA Information Power Grid Earth System Grid TeraGrid Laser Interferometer Gravitational Wave Observatory (LIGO) project Open Science Grid Cancer Bioinformatics Grid UK National Grid Service China Grid http://www-unix.globus.org/alliance/impact/

16. Common steps to submit a job Install and configure a grid http://www.globusconsortium.org/tutorial/ 1.Start Globus Toolkit 2.Write RSL (Resource Specification Language) for your program 3.Submit a job

17. Common steps to submit a job...cont Start Globus toolkit /etc/init.d/globus-4.0.1 start RSL file example /your/directory/name hello hello.out hello.err

18. Submit the job globusrun-ws –submit –F [protocol://]{hostname|hostaddr}[:port][/service] -f yourrslfile.rsl Copy a file from a remote server globus-url-copy gsiftp://remote.host.edu/path/to/file file://path/on/local/host Common steps to submit a job...cont

19. Hello world using MPICH-G2 #include int main(int argc, char **argv) { #if defined(GLOBUS_CALLBACK_GLOBAL_SPACE) globus_module_set_args(&argc, &argv); #endif globus_module_activate(GLOBUS_DUROC_RUNTIME_MODULE); globus_duroc_runtime_barrier(); globus_module_deactivate(GLOBUS_DUROC_RUNTIME_MODULE); printf("hello, world\n"); }

20. Further readings Tutorial on how to set up GT4 using PBS and SGE job scheduler http://www.globusconsortium.org/tutorial/ MPICH-G2 website http://www3.niu.edu/mpi/ Globus allience official website http://www-unix.globus.org/

21. Thank you Questions?