1. Workspace Management Services Kate Keahey keahey@mcs.anl.gov Argonne National Laboratory

2. 06/01/05Open Science Grid Applications Meeting Requirements l We need to be able to dynamically create a customized execution environment on remote resources u Isolation and Enforcement (Quality of Service) u Configuration Aspects (Quality of Life) Ideal environment is deployed in just the right place Dream up an ideal environment magic happens run jobs

3. 06/01/05Open Science Grid Applications Meeting What are Virtual Workspaces? l A description of an execution environment u Basic workspace: a Unix account on a remote machine u Aspects of a more complex workspace l Software configuration requirements u OSG worker node, submit node for a Grid3 cluster l Resource allocation requirements u Use exactly X memory, at least X disk space, Z bandwidth… l Sharing and isolation properties u Unix account, sandbox, various kinds of virtual machines … l And others… l Workspace can be managed and refined u Manage lifetime u Allow others to manage a workspace l A workspace can be deployed on a resource l A workspace can have various implementations

4. 06/01/05Open Science Grid Applications Meeting VW Services Client request VW EPR inspect and manage deploy & suspend use existing VW Create VW VW Factory VW Repository VW Manager create new VW Resource VW start program

5. 06/01/05Open Science Grid Applications Meeting VW Implementations: Unix Accounts l Dynamically created Unix Accounts l Software configuration: u take advantage of existing configuration u use Pacman, SoftEnv or other systems l Weak enforcement properties: quota, limits, etc. l Weak isolation properties l Low acceptance barrier l Well-understood, familiar concept, many tools and general support already exist

6. 06/01/05Open Science Grid Applications Meeting VW Implementations: Virtual Machines l Customizable software configuration u Library signature, OS, 64/32-bit architectures l Excellent enforcement potential u Enforcement on a sandbox rather than process level l Excellent isolation u Generally enhanced security, audit forensics l Pausing, serialization, and migration u VM images (include RAM), can be copied l Common concern: performance u Working with Xen VM: outstanding performence l Relatively new to Grid computing u Developing Grid infrastructure working with VMs

7. 06/01/05Open Science Grid Applications Meeting The Need for Speed LXVU SPEC INT2000 (score) LXVU Linux build time (s) LXVU OSDB-OLTP (tup/s) LXVU SPEC WEB99 (score) 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 1.1 Benchmark suite running on Linux (L), Xen (X), VMware Workstation (V), and UML (U)

8. 06/01/05Open Science Grid Applications Meeting DRAG Benchmark Results l DRAG suite: FFT-based benchmark l Comparison (by Xuehai Zhang, UC): u Linux: machine runs native 2.6 Linux. u Dom0: machine runs Xen and domain 0. u DomU: machine runs Xen, domain 0 and a user domain. l Similar performance as native Linux u <3% degradation, but sometimes better l More details at http://people.cs.uchicago.edu/~hai/vm1/drag/.

9. 06/01/05Open Science Grid Applications Meeting Deployment Concerns l Available implementations u Open source (Xen, UML) l Visible effects of open source community at work u Commercial (VMware) l Also, support for Xen from XenSource and many other Linux distributors: Fedora, Debian, SUSE, Gentoo, Mandrake, etc. l Distribution/Installation u Para-virtualization requires kernel modifications l Yes, but … everything else stays the same l Work in progress on making Xen part of Linux kernel l Support from many Linux distributors u Privilege l Xen (root, patch kernel, domain 0 privileges setup) l VMware Workstation (root, installation only)

10. 06/01/05Open Science Grid Applications Meeting Virtual Workspaces: Status l Dynamic account workspace service u Release information l Released with GT4 as technology preview l Deployed by EGEE l Prototype integration with OSG (Markus Lorch) l www.mcs.anl.gov/workspace www.mcs.anl.gov/workspace u A basic workspace – creates a dynamic account and provides a management interface for it u Works with VOMS credentials l Uses attirbutes for authorization as well as customization u Backend implementations: l Truly dynamic accounts: “adduser” command l Leasing: account pools

11. 06/01/05Open Science Grid Applications Meeting Virtual Workspaces: Status (cntd) l Virtual Machines u GT4 implementation l Service interfaces shared with the dynamic account implementation (includes VOMS credential processing etc.) l Implementation based mainly on Xen u Ongoing work: l virtual cluster workspaces (virtual OSG cluster) l networking l Security: how can we make l Virtual playgrounds u Deployment and integration with different communities l First experiments with GADU toolkit last summer l TG “science gateway” (also OSG/TG gateway) l OSG applications and infrastructure

12. 06/01/05Open Science Grid Applications Meeting Conclusions l Virtual workspaces u An abstraction of an environment u Virtual machines are a particularly promising implementation u But a simple account is often necessary and sufficient u Nested abstraction: COD, VMs, accounts.. l Past, Present and Future u First release: GT4 u Current work focused on virtual machines u Agreement-based deployment