1. 4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b

2. 4b.2 Globus Version 4 A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this infrastructure Version 4 is web-services based Some non-web services code exists from earlier versions (legacy) or where not appropriate (for efficiency, etc.).

3. 4b.3 Globus Toolkit Five parts: Common Runtime –GT Core for building new services Security –To provide secure access. Based upon Grid Security Infrastructure (GSI) Execution management –Initiation, monitoring, management, scheduling and coordination of executable programs (jobs) Data management –Discover, transfer, and access large data Information services –Discover & monitor dynamic services

4. 4b.4 Each part comprises a set of web services and/or non-web service components. Some built upon earlier versions of Globus.

5. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries GT2GT2 WS Authentication Authorization Reliable File Transfer OGSA-DAI [Tech Preview] Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Community Authorization Service GT3GT3 Replica Location Service XIO GT3GT3 Credential Management GT4GT4 Python WS Core [contribution] C WS Core Community Scheduler Framework [contribution] Delegation Service GT4GT4 Globus Open Source Grid Software I Foster

6. 4b.6 Java Services in Apache Axis Plus GT Libraries and Handlers Your Java Service Your Python Service Your Java Service RFT GRAM Delegation Index Trigger Archiver pyGlobus WS Core Your C Service C WS Core RLSPre-WS MDS CAS Pre-WS GRAM SimpleCAMyProxy OGSA-DAI GTCP GridFTP C Services using GT Libraries and Handlers SERVER CLIENT Interoperable WS-I-compliant SOAP messaging Your Java Client Your C Client Your Python Client Your Java Client Your C Client Your Python Client Your Java Client Your C Client Your Python Client Your Java Client Your C Client Your Python Client X.509 credentials = common authentication Python hosting, GT Libraries Another view of GT4 Components I Foster

7. 4b.7 GT Core Provides the ability to create services running inside the GT 4 container. Assignment 2 requires you to create a service inside GT 4 container and exercise it with a client.

8. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries GT2GT2 WS Authentication Authorization Reliable File Transfer OGSA-DAI [Tech Preview] Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Community Authorization Service GT3GT3 Replica Location Service XIO GT3GT3 Credential Management GT4GT4 Python WS Core [contribution] C WS Core Community Scheduler Framework [contribution] Delegation Service GT4GT4 Java WS Core Used in assignment 2

9. 4b.9 Custom Web Services WS-Addressing, WSRF, WS-Notification Custom WSRF Web Services GT4 WSRF Web Services WSDL, SOAP, WS-Security User Applications Registry Administration GT4 Container GT4 Web Services Core I Foster

10. 4b.10 Execution Management Key component GRAM ( Grid Resource Allocation Manager) For submitting executable jobs Used in Assignment 3 to submit and execute jobs. May interface to a local job scheduler Local job scheduler used in assignment 4

11. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries GT2GT2 WS Authentication Authorization Reliable File Transfer OGSA-DAI [Tech Preview] Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Community Authorization Service GT3GT3 Replica Location Service XIO GT3GT3 Credential Management GT4GT4 Python WS Core [contribution] C WS Core Community Scheduler Framework [contribution] Delegation Service GT4GT4 GRAM ( Grid Resource Allocation Manager) Used in assignment 3

12. 4b.12 GRAM services GT4 Java Container GRAM services Delegation RFT File Transfer request GridFTP Remote storage element(s) Local scheduler User job Compute element GridFTP sudo GRAM adapter FTP control Local job control Delegate FTP data Client Job functions Delegate Service host(s) and compute element(s) GT4 GRAM Structure: Sun Grid Engine used in assignment 4 Data management components I Foster

13. 4b.13 Security Components Addresses the security requirements of grid computing. Three important factors are: Authorization –Process of deciding whether a particular identity can access a particular resource Authentication –Process of deciding whether a particular identity is who he says he is (applies to humans and systems) Delegation (somewhat specific to grid computing) –Process of giving authority to another identity (usually a computer/process) to act on your behalf.

14. 4b.14 Security continued Security aspects complicated by the fact that virtual organization members and resources can be in different administrative domains.

15. 4b.15 GT 4 Security Provides: Control access to shared services –Addresses different policy in different work-groups Support multi-user collaborations –Federate through mutually trusted services –Local policy authorities rule –Personal collection of resources working together based on trust of user

16. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries GT2GT2 WS Authentication Authorization Reliable File Transfer OGSA-DAI [Tech Preview] Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Community Authorization Service GT3GT3 Replica Location Service XIO GT3GT3 Credential Management GT4GT4 Python WS Core [contribution] C WS Core Community Scheduler Framework [contribution] Delegation Service GT4GT4 Security

17. 4b.17 GT4’s Use of Security Standards I Foster

18. 4b.18 GT4 Data Management Move large data to/from nodes Replicate data for performance & reliability Locate data of interest Provide access to different data sources –File systems, parallel file systems, hierarchical storage (GridFTP) –Databases (OGSA DAI)

19. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries GT2GT2 WS Authentication Authorization Reliable File Transfer OGSA-DAI [Tech Preview] Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Community Authorization Service GT3GT3 Replica Location Service XIO GT3GT3 Credential Management GT4GT4 Python WS Core [contribution] C WS Core Community Scheduler Framework [contribution] Delegation Service GT4GT4 GridFTP and Reliable File Transfer

20. 4b.20 GridFTP Built on FTP using separation of data and control channels Provides features for –Large data transfers –Secure transfers –Fast transfers –Reliable transfers –Third party transfers Not a web service –RTF (Reliable File Transfer) service provided WS- level interface

21. 4b.21 Third party transfers PI = FTP Protocol Interpreter DTP= FTP Data Channel Process PI DTP PI Client Server Control channels Data channel

22. 4b.22 Performing a third-party transfer 1. Client establishes control channel with server 2. Using control channel, client sets up transfer parameters and requests data channel creation 3. Data channel established, 4. Client sends transfer command over control channel, 5. Data transfer starts through data channel. Either client or server can send.

23. 4b.23 Parallel transfers and striping Using multiple (virtual) connections for transfer –Same external network –Speed improvement possible, but limited by network card Striping – a version of parallel transfers that can use separate hardware interfaces –Implemented in GT 4.

24. 4b.24 GridFTP and RFT WS Client RFT service (Java) Client API (Java) XIO based (C) Control channel Data channel Control channel GridFTP server From Gridwise

25. 4b.25 GT 4 Replica Location Service Identify location of files via logical to physical name map Distributed indexing of names, fault tolerant update protocols Index I Foster

26. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries GT2GT2 WS Authentication Authorization Reliable File Transfer OGSA-DAI [Tech Preview] Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Community Authorization Service GT3GT3 Replica Location Service XIO GT3GT3 Credential Management GT4GT4 Python WS Core [contribution] C WS Core Community Scheduler Framework [contribution] Delegation Service GT4GT4 Monitoring and Discovery

27. 4b.27 Monitoring and Discovery WSRF provides common mechanisms for monitoring and discovering a service: GT4 “aggregator” services within MDS: –MDS-Index: collects state information from registered resources and makes it available as XML document –MDS-Trigger: passes this information to an executable –MDS-Archive: archives state information (awaiting implementation) Every GT 4 is discoverable

28. 4b.28 Acknowledgement Slides numbers marked with “I Foster” have been selected from presentations made by Ian Foster: Enabling eScience: Grid Technologies Today & Tomorrow American Association for the Advancement of Science Annual Meeting, Washington, DC, February 21 2005. Globus: Bridging the Gap Keynote Talk, GlobusWORLD, Boston, Mass., February 8, 2005. The Grid: Reality, Technologies, Applications Distinguished Lecture, McGill University, Montreal, Canada, January 21 2005. used for educational purposes only.