© 2002 IBM Corporation Grid Computing: Technology Team Update Mark Cathcart, IBM Distinguished Engineer On Demand Architecture and Design IBM's Vision for the Next Generation Data Center Enabled by Commercial Grids May 2003

Responsive Variable Focused Resilient Open Integrated Virtualized Autonomic Flexible Variable Managed Optimized Computing Environment Business Design Financial & Delivery Models What Do You Need To Become an On Demand Business?

Improve working capital and asset utilization Create business flexibility by integrating disparate, unconnected business and IT processes Business Transformation On Demand Business Reduce costs and increase business responsiveness through IT and business linkage Requires an On Demand Operating Environment On Demand Operating Environment

IBM On Demand Operating Environment Delivers Unique Value Assets used efficiently based on business requirements Business policies drive IT resource allocation Flexible, dynamic business processes Resources allocated and managed dynamically without intervention

On Demand Operating Environment Business Objectives and Policies Open Standards-based Transactional Processes Application Development, Deployment & Maintenance Collaboration Information Management Integration of People – Business Process – Information Anywhere, any time, from any device AvailabilityProvisioning Optimization Systems and Policy Management Security Pools of Virtual Resources StorageServersDistributed Systems

Transactional Processes Application Development, Deployment & Maintenance Collaboration Information Management Integration of People – Process – Information Anywhere, any time, from any device On Demand Operating Environment

Transactional Processes Application Development, Deployment & Maintenance Collaboration Information Management Integration of People – Process – Information Anywhere, any time, from any device SecurityOptimization Provisioning Policy-based Orchestration Availability On Demand Operating Environment

Transactional Processes Application Development, Deployment & Maintenance Collaboration Information Management Integration of People – Process – Information Anywhere, any time, from any device Virtualization Engine StorageServers Distributed Systems Network SecurityOptimization Provisioning Policy-based Orchestration Availability On Demand Operating Environment

Delivering the Operating Environment Based on an evolving set of components that simplify development, deployment and maintenance Shared components Integrated system console Security and identity Choreography Transaction coordination Data persistence Workload management Collaboration Application connectivity Configuration tool Based on open standards XML Web services J2EE Open Grid Services Architecture Common Information Model

e-business on demand Offerings Simple and easy approach to acquiring capabilities Based on experience from customer engagements Built around simple, incremental, modular roadmaps Exploits capabilities from across IBM Enables the IBM and Business Partner channels to capitalize on opportunities

Incorporating key technology initiatives…

e-business on demand Operating Environment Application Environment An integrated platform, based on open standards, to enable rapid deployment and integration of business applications and processes Systems Environment An environment that allows true virtualization and automation of the infrastructure and enables delivery of IT capability and service level on demand

…with a sophisticated on demand Operating Environment that is… … approachable, adaptive, integrated and reliable infrastructure delivering on demand services for on demand business operations … Virtualized Autonomic IntegratedOpen

CRMERPFinance PeopleSoft SAP Siebel Software: Monolithic SunHP Dell IBM Processors: Single purpose Internet WAN LAN Network: Fragmented The Problem: IT in Vertical Fragments Storage: Isolated EMC Hitachi NetApp

Virtualized Storage Applications Processing Operating System Data I/O Distributed Computing Over a Network, Using Heterogeneous Resources and Enabled by Open Standards Middleware

A full range of delivery models to bring e-business on demand utility offerings to clients… Internal Utility A client operated IT utility using dedicated, client owned assets Private Utility A client specific utility using dedicated assets, but construction and management of these services is provided by an external provider Hybrid Utility A mixture of client specific utility services using dedicated resources, and shared use of some public utility services with other subscribers Public Utility A set of IT utility services shared across multiple subscribers Client Benefits Control Dedicated resources Client Benefits Control Dedicated resources Assisted management Client Benefits Control for key functions Dedicated resources for some assets Progressively enter public arena as services mature Client Benefits Full provisioning of IT in a utility mode, giving a comprehensive usage and cost profile Cost efficiencies Shared risk

Operating Environment Pain Points Insufficient Performance Hardware and systems are quickly outdated Difficult to manage systems to an end-to-end QOS Unable to adapt to change in demand Not able to dynamically adjust to fluctuations in load Cant share capacity across applications Unable to adapt to changes in applications and infrastructure Each new component causes significant integration challenges Interfaces are not based on open standards Fragile Single points of failure are prevalent Failover and business continuity requires expensive, custom solutions

Applications Middleware Systems Management and Automation Workload / Performance Management Security Availability / Service Management Logical Resource Management Clustering Services Connectivity Management Physical Resource Management OS Open Services Architecture

Exploiting Grid standards in Enterprise Computing Virtualise Data Center Consolidate logically Business Rules managed provisioning, performance, workloads Heterogeneous Clustering X-Platform Automation, backup, disaster recovery, workload management Integrated Infrastructure Autonomic discovery and provisioning Common Services Bus Interface Coherent, consistent infrastructure Based on open standards (OGSA, OGSI, Web Services, XML, SOAP, HTTP etc.) Accessed via Web Services interface

Grid Services Structure Professional Services Network OGSA Enabled Storage OGSA Enabled Servers OGSA Enabled Messaging OGSA Enabled Directory OGSA Enabled File Systems OGSA Enabled Database OGSA Enabled Workflow OGSA Enabled Security OGSA Enabled Web Services OGSI – Open Grid Services Infrastructure Grid Services System Management Sevices Open Grid Services Architecture (OGSA) Applications Autonomic Capabilities

Meta-OS Services OGSA: policy repository, data replication, security, problem determination, resources instrumentation, logging, basic provisioning Grid Service Infrastructure OGSI: discovery, lifecycle, registry, manageability factory, handlemapper, notification, install Management Functions Utility Enablement Billing, Metering, Subscription, Identification, Disaster Recovery Autonomic I/T Resources Grid Computing Architecture Workload Management, Clustering, Job & Service Scheduling, Automated Server Recovery, Distributed e-business Workflow, Provisioning, Data Federation, File System Federation

Solaris & HP/UX Linux zSeriespSeriesiSeriesz,p,i,xSeriesxSeries Sun & HP Dell Compaq... New classes of applications enabled Windows Common GUI IBM Platforms QoS Enablers/Optimizers S&TC eCommerce xSP etc... Storagez/OSWindowsLinuxAIXOS/400 WebServices Run-time Open Grid Services Architecture Autonomic Functions & Management Middleware eLiza eServer Foundation Dell Compaq... Architecture Framework

OGSA Enabled Messaging OGSA Enabled Directory OGSA Enabled File Systems OGSA Enabled Database OGSA Enabled Workflow OGSA Enabled Security OGSA Enabled OGSI – Open Grid Services Infrastructure Grid Services System Management Sevices Autonomic Capabilities OGSA IBM Global Services software IBM TotalStorage

On Demand Business Goal On Demand Operating Environment Critical Attribute PCs & Mobile Lightly Managed Distributed Systems Traditional Data Centers and Managed, Distributed Systems Infrastructure Elements Foundation Technologies Web Services Grid Autonomic eUtility, Provisioning, Utility Management Infrastructure Schematic for On Demand

OGSA Service Model Provides capabilities essential to distributed / Grid computing Builds on Web Services technology...current and planned A component model extension for Web Services All OGSA services adhere to specified service interfaces and behaviours (some required and some optional) Factory, registry, discovery, lifecycle, query service data, notification, reliable invocation Provides reliable / secure preservation of distributed state Supports dynamic late-binding and creation of distributed resource groups Supports the creation of virtual resources as stateful OGSA service instances Location transparent deployment

OGSA Mapping

Resources expressed as OGSA Services: The next level of virtualization Hardware OS Middleware Application Network Service interface separate from access and implementation Service interaction with underlying resource can be local or remote Abstract representation of logical IT resource (node, process, disk, file system, IP address, XML database, Security service, Commerce Server) described as a web services interface (WSDL) Common operations to configure and monitor resource details. Provide common behavior for lifecycle, discovery, events. Adapter/Connector can push down onto multiple underlying resource instrumentations such as CIM or SNMP or RMC OGSA Common Resource Model Architecture

OGSA and non- OGSA Resource Managers New and existing Java/J2EE Apps New and existing Non-Java Apps How will this get deployed ? OGSA Full OGSA NGCM App OGSA and non- OGSA Resource Managers Full OGSA NGCM App Location Independent Could be Centralised Decentralised Both Applies to both enabled and existing applications Exploits Pegasus CIM arechitecture Exposed via OGSI web svc

Utility Services Bus Separates business logic from infrastructure services Infrastructure services run within the Service Bus Not invoked by business logic Services required to do business with web services Metering, billing (related to contracts) Monitoring, load balancing (related to QoS mgmt, SLAs) Directory, reputation identification, logging, non-repudiation Bus provides plug-in points for infrastructure services Does not expect to provide all the services On-ramp, just after application invokes service Off-ramp, just before bus passes control to service Configurable Infrastructure Tooling to connect services and applications to bus

Wider than an enterprise

Business Continuity and Automated Operations zSeries cluster pSeries cluster xSeries cluster Sun or HP Cluster ISV Cluster IBM Server Appliances Linux cluster iSeries cluster

On Demand Systems Environment Bigger, More Value-rich than just Utility Services Pools of Virtual Resources Blades Partitioning Storage Virtualization Business Processes & Applications Virtualize Systems Integration Clustering, Policy Repository, Security, Problem Determination, Logging, Integrated Systems Mgmt, WLM, Provisioning, Scalability, Security, Network Mgmt, Storage Mgmt, CUOD Automate Workload Mgmt. Provisioning Billing/Metering… HP Physical Resources Islands of Heterogeneous Resources

Phase 1 (enable) Phase 2 (exploit) IT Optimization Scorpion Assess Applications Exploit OGSA via Webservices/Websphere Exploit On Demand Technologies eWLM eAutomation eDisaster Recovery Tivoli Storage Tank Next Steps for Customers dynamic business process integration billing metering distributed scaling distributed resource management V V V V Consolidate & Virtualize Software Enable Storage/Servers/Density LPAR/IRD/VMWare IBM Director/Blade Center Appropriate OS levels Systems Mgmt (Tivoli) Grid (Globus Toolkit)

Level of integration Full Silos Level of automation Labor-intensive Autonomic Leverage open standards Application Environment Leverage virtualization Systems Environment Toward an On Demand Operating Environment

e-business on demand: The New Agenda Variable Responsive Resilient Focused Integrated Open Virtual Autonomic on demand business on demand operating environment new financial models If you are open, integrated, autonomic and virtualised, you are On Demand!

e-Business on Demand: Operating Environment Systems Environment Utility Services Application Environment Business Transformation Operating Environment