Click to edit Master title style WSDM A Web Services Stack for Management Composing WS Standards Heather Kreger

Agenda n An Industry View: The Management Roadmap n WSDM Motivation n Web Services Foundation for WSDM l WS-Addressing l WS-Resource Framework l WS-Notification n WSDM Overview l Architectural concepts l Management Using Web Services l MUWS Capabilities l Management of Web services

Management Using Web Services: Roadmap, Strategy and Architecture Paper authored by IBM, HP and CA and published on June 2, 2005 n Characterizes challenges facing the IT systems management community  Aligning IT resources management with Business Objectives  Managing the increasing complexity of IT environment with solutions from many vendors  Increasing the agility of the IT infrastructure and processes  Leverage automation of management processes – minimize costs n Defines a architecture and roadmap for the evolution of management systems to address and support the challenges of emerging business environments.

Customer Challenges Tivoli Storage Manager recovery OpenView topology BMC Database Manager system Application Operating system Application Server database system Application Operating system Application Server database system Application Operating system Application Server database System Application Operating system Application Server Database HPUX Linux Windows AIX zOS HP Dell pSeries zSeries Sybase Oracle DB2 Bank HR NYSE CRM/SAP Invest CIM Novell Cisco Zone IBM “IF my Banking application is down, then kill off HR and bring up banking” Config Files OV Plugin IP SNMP JBoss.net BEA WebSphere Tibco TEC JMX SNMP CIM Logs router ATM Home banking Teller Tivoli Event Console Event Correlation NetWeaver SNMP firewall

Grids system Application database system Application database system Application database router firewall system Application database system Application database system Application database router firewall system Application database system Application database system Application database router firewall system Application database system Application database system Application database router firewall Multiply the diversity of systems Multiply the diversity of managers Add Firewall and Security Issues Add legal issues And what manager can span all of this?

Foundation - Web Services Architecture Common approach for manageability to simplify the integration of management solutions for existing systems and systems based upon emerging Service-Oriented Architectures (SOA) Web services based architecture that supports, integrates, and unifies several management models and technologies in a way to manage any IT resource in a platform and language-neutral manner Management is a Web services application, like other business applications – Management Integration

Foundation - Web Services Architecture HTTP XML WS-Security WS-RM WS-Security Policy XML Schema WSDL WS-Addr WS-Policy BPEL WS-MetadataExch WS-Coordination WS-Atomic Trans WS-Res Properties WS-Service Group WS-Notification Examples of standards and specifications in progress

Resources CIM TMF OMA SNMP … WSDM Identity WSDM Metrics WSDM Configuration WSDM State WSDM OpStatus WSDM Relationships … DMTF WS-CIM WSDM MOWS … Standards already in progress, More will evolve…

Managers Monitor Provision Metering Monitoring Svcs Event Mediators Metric Mediators Inv.Scanning Policy Enforcers Policy Mgrs Configuration Examples of what may evolve in managers, what standards are needed is to be determined

Management Roadmap - Architecture

Roadmap Summary n Provides a vision and architectural foundation for solving the needs of our customers to simplify the management of heterogeneous environments today and advanced management in the future  Leveraging technology and standards for increased IT agility, reduce IT complexity, and automation of IT management processes.  Web services as a technology foundation for management n Outlines a Journey  Implementations based on web services standards are beginning to emerge  Call to action for the Management Community n Engage in the development and standardization of the architectural components n Provide feedback on the paper including new ideas and technologies needed to make the strategy complete n For more information visit  mroadmap/  

Agenda n An Industry View: The Management Roadmap n WSDM Motivation n Web Services Foundation for WSDM l WS-Addressing l WS-Resource Framework l WS-Notification n WSDM Overview l Architectural concepts l Management Using Web Services l MUWS Capabilities l Management of Web services

What motivated WSDM development? n Compelling customer need for Management software interoperability l Among management software l With resources l With business applications and processes n Basis for advances in enterprise management l Examples include Grid workload balancing, SLM, and policy-based management, … n Management interoperability milestone: l OASIS WSDM 1.0 standard approved

A Common Platform for Management Web Services & Management Requirements DMTF access to CIM resource models description of CIM resource models Focus on resource models Multiple management standards communities need a common management platform of Web Services to access resources in a common way. GGF access to virtual resources description of virtual resources Focus on grid application OASIS WSDM access to manageable resources description of manageable resources Focus on manageability

Agenda n An Industry View: The Management Roadmap n WSDM Motivation n Web Services Foundation for WSDM l WS-Addressing l WS-Resource Framework l WS-Notification n WSDM Overview l Architectural concepts l Management Using Web Services l MUWS Capabilities l Management of Web services

Web Services Platform Standards n XML Schema – captures information model n SOAP – XML messaging n WSDL – describes message exchanges (e.g. operations) n WS-ResourceProperties l Discover resource properties l Get/set resource properties l Value change notifications n WS-ResourceLifetime l Know when a resource is/will be destroyed l Destroy a resource n WS-ServiceGroup l Query a group of resources l Register a resource n WS-BaseNotification l Subscribe to notifications l Notify message wrapper n WS-Topics – description of notification messages and topic classification

Management Roadmap, WSDM, and Grid WSDM MUWS WSDM MOWS (Web Service) CIM Model WS-CIM WS-Notification WS-RF Resource Properties WS-Addressing WSDL SOAP XML Grid Services

WS-Addressing Web Service endpoint messages w/ WSA & other information in the headers EPR refers to Web services Application known to

Web services access to Resources Resource endpoint XML Representation John Doe … … Policies Schemas WSDL messages with WSA & other information in the headers EPR refers to Web services Application known to WS-Resource

A WS-Resource C A B xclock Suspended Ready 2824 Red … 09 Nov :45:29 GMT <wsdl:portType name="Process" wsrf-rp:ResourceProperties="process:ProcessProperties"> … WS-Resource C C

WS-RF Overview n Defines open framework for modelling and accessing stateful resources using Web services. l An XML document describes the properties of a WS-Resource. n A WS-Resource is a Web service that has an associated ResourceProperties document. l WSDL messages are defined as a standard means through which properties are accessed. l WS-Addressing EndpointReference is a means through which WS-Resources are referenced.

WS-RF outputs n A family of documents and specifications n Specifications l WS-Resource l WS-ResourceProperties l WS-ResourceLifetime l WS-BaseFaults l WS-ServiceGroup l WS-ResourceMetadata n Non-normative: l WS-RF Requirements l WS-RF Primer l WS-RF AppNotes WS-Service Groups WS-BaseFaults WS-Resource Metadata WS-Resource framework (WS-RF) WS-Resource Lifetime WS-Resource Properties

WS-Resource Framework Captures Common Patterns l Referencing resources l Accessing properties of a resource l Destroying a resource l Grouping services l Registering for later notifications

WS-ResourceProperties n Offers a view of the properties of the resource n Presented via Web service as an XML document (accessible through various query types) n Properties document type associated with PortType DrivesRUs

ResourceProperties Document and WSDL n ResourceProperties document is associated with the WSDL portType: <wsdl:portType name="Process" wsrp:ResourceProperties="process:ProcessProperties"> … … provides meta-data to assist developers and tooling

WS-ResourceProperties Operations process:handle GetResourceProperty (required) Simple single resource property element getter 1577 process:handle process:executionState GetMultipleResourceProperties (optional) More sophisticated multiple property value retrieval 1577 Suspended Ready <wsrp:QueryExpression Dialect=" boolean(/*/*[MemUsage<1024]) QueryResourceProperties (optional) Execute an expression on the resource properties document true

WS-ResourceLifetime Specify how WS-Resources are destroyed n Immediate Destruction n Scheduled Destruction n Standard notification of resource destruction

WS-ServiceGroup n A service group maintains information about a group of Web services (may be WS-Resources) n Not necessarily of the same type n No implied relationship n Can be extended to invoke operations on members of the group n Leverages WS-ResourceProperties n Allows expression of membership constraints

WS-BaseFault Adds structure to WSDL error messages Defines mapping to SOAP 1.2 faults xsd:dateTime wsa:EndpointReference ? xsd:string ? xsd:string * wsbf:BaseFault *

WS-RF Status n Latest working drafts available from TC home page: l n Committee drafts anticipated mid 2005 for: l WS-Resource l WS-ResourceProperties l WS-ResourceLifetime l WS-BaseFaults

WS-Notification: WS-BaseNotification Three roles n Subscriber n Producer n Consumer Two ways to send notifications n “Raw messages” (based on policy) n “Notify” wrapper (default) Three interfaces n NotificationProducer n NotificationConsumer n SubscriptionManager (subscription is a WS-Resource)

Base notification: subscribe message wsa:endpointReference {any} xsd:boolean ? wsrp:QueryExpression ? {any} ? xsd:dateTime ?

WS-BrokeredNotification n Broker (intermediary) permits decoupling Publisher and Subscriber n Publisher need NOT be a Web service n Transparently reuses WS-BaseNotification interfaces and adds new ones: l NotificationBroker (just one new property) l RegisterPublisher

WS-Topics n Topics are used to represent and categorize items of interest for notifications n WS-Topics defines three topic expression dialects l Simple Topic Expression (tns:t1) l Concrete Topic Path Expression (tns:t1/t3) l Full Topic Path Expression (tns:t1/*) <wstop:topicSpace name="TopicSpaceExample1"

WSN Status n Latest working drafts available from TC home page: l n Committee drafts anticipated mid 2005 for: l WS-BaseNotification l WS-Topics

Agenda n An Industry View: The Management Roadmap n WSDM Motivation n Web Services Foundation for WSDM l WS-Addressing l WS-Resource Framework l WS-Notification n WSDM Overview l Architectural concepts l Management Using Web Services l MUWS Capabilities l Management of Web services

Membership and History n WSDM charter in February 2003 n Broad representation by member companies n WSDM 1.0 approved March 2005 n Internal Interop April 2005 n Public Demonstration June 2005

Web Services Distributed Management Missions n Use Web Services as the distributed computing platform to enable interoperability between managers and manageable resources n Management USING Web Services (MUWS) l Web services to describe and access manageability of resources l Management applications use Web services just like other applications use Web services n Management OF Web Services (MOWS) l An application of Management Using Web Services for the Web Service as the IT resource

What is WSDM? n Leverage Web services foundation to enable interoperability between managers and manageable resources n Management USING Web Services (MUWS) l Web services to describe and access manageability of resources l Management applications use Web services just like other applications use Web services n Management OF Web Services (MOWS) l An application of Management Using Web Services for the Web Service as the IT resource

Scenario: Acme Manufacturing Systems Management  Using WSDM and WS Resource Framework Service Group, ACME managers discover manageable resources, introspect the resources.  WSDM and WS Resource Framework Lifetime support managers executing deploy and redeploy of services to other servers upon failure.  WSDM and WS Resource Properties enable standard expression of, introspection of, and access to metrics, configuration and operational state properties for services.  WSDM and WS Notification enable standard event messages in notifications when state changes that require action by managers Supplier A Supplier B Supplier C Manager ServerUK ServerLA ServerNY svc Manager discovers and introspects ACMEs IT manageable resources Manager subscribes to resources for WSDM state changes Server fails and WSDM Management Event Format notification is sent to Manager for state change (failed server) Manager redeploys service to an under utilized server that is a member of the candidate server group Acme svc

Focus on Resources Isolation from implementation choices WSDM Architecture Principles

WSDM: Composability

WSDM: Effects of composability

A Manager’s View Policies SLAs WSDM Web Service Manageability Endpoint Manager CIM or SNMP Manager Registry Web Service Printer System Application Server Agent

Management Using Web Services n Profile on use of WS-Resource Framework and WS-Notification n Resource management model agnostic n Advice on advertising and discovering WSDM manageable resources n Standard management event format n Resource Identification n Captures common resource management aspects from models

Management Using Web Services (MUWS) n Management Foundations l Meta information n Additional descriptive information about interfaces n resources, properties, operations, notifications l Relationships n Association between two IT resources n Relationship expression schema and property l Management Event Format n XML format, carry events from any source l Discovery n Creating manageable resources from traditional discovery engines n Finding resources n Introspection of manageability capabilities

Management Using Web Services n Manageable Resource: l Is a Web Service n Described by WSDL, WS-Resource Properties, Meta information, Policies, l Is a WS-RF WS-Resource l MUST support WSDM’s Identity capability with properties (ResourceID). l Advertises the properties/operations (message exchanges) of the resource to be managed

Management Using Web Services n Capabilities - Set of descriptions to enable a management task n WSDL, WS-Resource documents, Meta Information, Policies, Notification topics l Identity, Description l ManageabilityCharacteristics l Metrics l Operational Status, State l Configuration l Correlatable Names l Relationships

Capabilities n Identity l Defines standard means to determine if two resources are ‘the same’ n If same then resources are the same n If different then resources are probably different, but may be the same, revert to correlatable properties l Properties: ResourceId n Description l Description of resource being managed l Properties: Caption, Description, Version n ManageabilityCharacteristics l Describes management abilities of resources l Properties: ManageabilityCapabilities URIs

Capabilities – Correlatable Properties n Describes how to compare the properties of two resources to determine if the resources are ‘the same’, dialects incl. xpath & pbm. n Properties: CorrelateableProperties <muws-p1-xs:CorrelatableProperties Dialect=” print:IPAddress foo:Name print:PrinterModel print:Location print:Owner

Capabilities - Metrics n Defines expression of standard metric types/behaviors (heavily influenced by DMTF Metrics WG) n Each metric contains its Type, Time scope, LastUpdatedAt, ResetAt l IntegerMetric l DurationMetric n Properties: CurrentTime Resource specific metrics n Events: on metric changes (WSRP:ResourceChangeEvent wrapped in a WEF)

Capabilities – State n Defines how to indicate the current state and state transitions of a resource n Properties: Current State URI, Time Entered, State Model URI n Events when state transitions on state topic n Resource model defines the resource specific state models and semantics n May be several State capabilities extensionts n Future exploration: l Tying Operations to state changes is being explored l Mechanisms to convey the state model

Capabilities – Operational Status n Defines high level resource health indicator. n Properties: OperationalStatus - limited values for interop across models: Available, Unavailable, PartiallyAvailable, Unknown n Status transition Events when status changes on status topic n Resources responsible for expressing correct status according to how State maps to Operational Status

Capabilities – Configuration n Defines the properties which are settable and together compose a resource’s configuration n Properties: resource specific properties n Operations: from WS- ResourceProperties, setResource n Events: Property change event wrapped in WEF on Configuration topic.

Capabilities – Relationships n Defines schema to describe relationships and access relationships as resources when they have properties and behavior. l Name, Type, Particpant (EPR, ID, Role) l Access Endpoint Reference n Properties: Relationship n Operations:QueryByType n Events: Relationship created, Relationship deleted

Advertising n Defining standard events for resource factories to emit when resources are created or destroyed n Registry Advisory: If you have a manageable resource registry then you should expose them using Services Group interfaces with ResourceId and ManageabilityCapabilities content model n Listen for Advertisement and destruction events n Follow relationships on known resources Discovery

WSDM Event Format n Defining extensible, standard format for management events, passed using WS- Notification n Contains common information fields: l ReportTime, EventId l Source – ResourceId, ComponentAddress l Reporter – ResourceId, ComponentAddress l Situation – SituationCategory, SuccessDisposition, Situation Time, Severity, Priority, Message, MessageId

Management Of Web Services n Simplification l Use Web services for management of same n Unification l Of manageability and operational capabilities n Definition and usability n Composability of management and operational sides n Integration of management and business l Management gains visibility into business l Business applications and processes can leverage manageability capability n Management model l Identity, links to the managed service and managers, metrics, status, and request processing observations

WSDM: Resources as Web services

WSDM: “Where is your manager?”

Where are going n WSDM MUWS and MOWS V1 l March 2005 n WSDM Next Gen line items being discussed now in WSDM TC l Standard Versions of WS-RF / WS- Notification / WS-Addressing l Reverse Protocol? l Policy? l Others?

Implementations are appearing l Open Source Apache Implementation from HP and Globus n l HP, SOA Manager n l IBM, ETTK supporting WSDM 0.5 (April 2004) n n Update coming in ETTK 2.3 supporting WSDM 1.0 (April 2005) l CA, CA WSDM n

Relationship to Other Standards Work n W3C l WS Description WG l WS Arch WG n DMTF l WIP and its WS-CIM subgroup l Utility WG l State and Behavior WG n GGF l OGSA Common Manageability Model WG n OASIS l Web Services Resource Framework l WS-Notification l WS-Security

Resources n WSDM Specifications: open.org/apps/org/workgroup/wsdm/documents.php open.org/apps/org/workgroup/wsdm/documents.php n OASIS – n DMTF – n GGF – n W3C – n Blackberry Demo –

Come to the Demo at 2pm! n HP/IBM interoperability demonstration of WSDM MUWS specification n 3 different stacks! Apache MUSE, IBM ETTK, J2ME/ETTK n 2 Demos! l Blackberry (automation ready in 102K!) l Weather Station Web services, (Managers on MUSE and ETTK interop with Web services on MUSE and ETTK)

Q&A