Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization

2 Grid Infrastructure Application Information Services Execution Management Data Management Security

3 Globus Toolkit: Basic Grid Services l Globus Toolkit Core u Infrastructure for building Grid services u Uniform, standard, WS-based protocols u Implementations in Java, C, Python, WSRF.NET l Information Services u Discover & monitor dynamic services l Execution Management u Provision environments, execute jobs, manage instruments l Data management u Discover, transfer, & access large data l Security u Authentication & Authorization u Credential management tools

Data MgmtSecurity Common Runtime Execution Mgmt Info Services Non-WS Components Pre-WS Authentication Authorization GridFTP C Common Libraries From Globus Toolkit version 2 (GT2) Grid Resource Alloc. Mgmt (GRAM) Monitoring & Discovery (MDS) Web Services Components

Data MgmtSecurity Common Runtime Execution Mgmt Info Services Web Services Components Non-WS Components Pre-WS Authentication Authorization GridFTP Pre-WS Grid Resource Alloc. & Mgmt Pre-WS Monitoring & Discovery C Common Libraries Authentication Authorization Reliable File Transfer Data Access & Integration Grid Resource Allocation & Management Index Java WS Core Community Authorization Replica Location eXtensible IO (XIO) Credential Mgmt Community Scheduling Framework Delegation To Globus Toolkit version 4 (GT4) Data Replication Trigger C WS Core Python WS Core WebMDS Workspace Management Grid Telecontrol Protocol Contrib/ Preview Core Depre- cated

6 Java Services in Apache Axis Plus GT Libraries and Handlers Your Java Service Your Python Service Your Java Service RFT GRAM Delegation Index Trigger Archiver pyGlobus WS Core Your C Service C WS Core RLS Pre-WS MDS CAS Pre-WS GRAM SimpleCAMyProxy OGSA-DAI GTCP GridFTP C Services using GT Libraries and Handlers SERVER CLIENT Interoperable WS-I-compliant SOAP messaging Your Java Client Your C Client Your Python Client Your Java Client Your C Client Your Python Client Your Java Client Your C Client Your Python Client Your Java Client Your C Client Your Python Client X.509 credentials = common authentication Python hosting, GT Libraries GT4 Components

7 Globus Toolkit 4 l Standard protocol base u Consistent with latest WS standards (WS-*, WSRF, WS-N, etc.) and Apache platform l New components u Such as Reliable File Transfer, Delegation, Community Authorization, Workspace Service.. l Significant improvements in usability, reliability & scalability u Web service components have quality equal or superior to pre-WS components u Documentation is very significantly improved l New platforms & languages u And links to larger Globus ecosystem l Final release available since April 29, 2005

8 Working with GT4 l Download and use the software, and provide feedback u Join mail list l Review, critique, add to documentation u Globus Doc Project: l Tell us about your GT4-related tool, service, or application u

9 Globus Future l Building on the powerful WS base l What to look out for: u Security: attribute assertions and authorization framework l Gridshib, VOMS, SAML, etc. u Managed services l Common policies: persistence, throttling u Advance reservations u Replication service and policy support in data services l Moving towards virtualization and policy-driven resource management

10 Working in the Grid Today Application

11 Virtualization in the Grid Application Virtual Grid

12 Building Blocks: Virtual Workspaces l A description of a Grid environment l Many implementations u Dynamic accounts u Virtual machines l Workspaces can be deployed on resources l Workspaces can be managed & refined l Jobs can be deployed in workspaces Resource allocation properties Software configuration properties Capability Isolation & enforcement properties Dynamic Accounts Xen VMwarevServer UML Workspace Description

13 Workspace Implementations l Dynamic accounts u Dynamically created or account pools u Weak enforcement & isolation properties: quota, limits, etc. u Software configuration via Pacman, SoftEnv, etc. u Low acceptance barrier, familiar concept l Virtual Machines u Excellent isolation & enforcement capabilities u Highly customizable software configuration u Pausing, serialization, migration u New concept u Performance: LXVU SPEC INT2000 (score) LXVU Linux build time (s) LXVU OSDB-OLTP (tup/s) LXVU SPEC WEB99 (score)

14 Using Workspaces GRAM Workspace Service Client Lifetime Access policy Management policy (1) Deploy workspace service (2) Manage workspace service (3) Start job in workspace l Moving towards controlled use of resources: advance reservations and enforcement

15 Workspace Service Status l Workspace service u Dynamic account implementation l Released as GT4 technology preview, deployed by EGEE l Creates a Unix account and provides management for it l Two backend implementations: adduser & account pools l Uses VOMS credentials for authorization and customization l u Virtual Machine implementation l Prototype implementation based on the Xen VM l Pilot projects with OSG, TeraGrid and other communities l Limited functionality tech preview expected within a few months l Much research is being done on security, networking, enforcement

16 Grid as a “Virtual Playground” overlay networks VW Virtual storage virtual clusters

17 Parting Thoughts l GT4: significant progress u Web Service protocol base u But also significant improvements in usability, reliability & scalability u Provides a stable base on which to build higher-level services l We are moving towards a more seamless Grid model u Virtual workspaces and virtual Grids u Promising solution to providing Quality of Service in the Grids l Descriptions and protocols l Enforcement capabilities u Also promising with respect to providing Quality of Life in the Grids! u Improving usability, utilization, and generally more flexible ways of using the Grid l For questions mail