Presentation is loading. Please wait.

Presentation is loading. Please wait.

Promoting and Standardizing Grid Computing Defining the Grid: Open Grid Services Architecture Current and Future Generation Grid Technology Summer School.

Similar presentations


Presentation on theme: "Promoting and Standardizing Grid Computing Defining the Grid: Open Grid Services Architecture Current and Future Generation Grid Technology Summer School."— Presentation transcript:

1 Promoting and Standardizing Grid Computing Defining the Grid: Open Grid Services Architecture Current and Future Generation Grid Technology Summer School th - 28th July, Bonn (Germany) Hiro Kishimoto, Ph.D. OGF OGSA-WG, co-chair Research Fellow, Fujitsu Visiting Professor, National Institute of Informatics OGSA is a trademark of the Open Grid Forum

2 July 24, 2006 Open Grid Forum - Agenda Open Grid Services Architecture Overview A Closer Look at OGSA OGSA and the Standards Landscape The OGSA Working Group Summary

3 July 24, 2006 Open Grid Forum - The Open Grid Services Architecture

4 Open Grid Forum - July 24, 2006 Three Generations of Grid Source: Charlie Catlett Standardization is key for third-generation grids! Local metacomputers –Distributed file systems –Site-wide single sign-on "Metacenters" explore inter-organizational integration Totally custom-made, top-to-bottom: proofs of concept Local metacomputers –Distributed file systems –Site-wide single sign-on "Metacenters" explore inter-organizational integration Totally custom-made, top-to-bottom: proofs of concept Utilize software services and communications protocols developed by grid projects: –Condor, Globus, UNICORE, Legion, etc. Need significant customization to deliver complete solution Interoperability is still very difficult! Utilize software services and communications protocols developed by grid projects: –Condor, Globus, UNICORE, Legion, etc. Need significant customization to deliver complete solution Interoperability is still very difficult! Common interface specifications support interoperability of discrete, independently developed services Competition and interoperability among applications, toolkits, and implementations of key services Common interface specifications support interoperability of discrete, independently developed services Competition and interoperability among applications, toolkits, and implementations of key services We are here!

5 Open Grid Forum - July 24, 2006 The Open Grid Services Architecture An open, service-oriented architecture (SOA) Resources as first-class entities Dynamic service/resource creation and destruction Built on a Web services infrastructure Resource virtualization at the core Build grids from small number of standards-based components Replaceable, coarse-grained e.g. brokers Customizable Support for dynamic, domain-specific content… …within the same standardized framework

6 Open Grid Forum - July 24, 2006 Logical view of capabilities Relatively coarse-grained functions Reusable and composable behaviors Encapsulation of complex operations Naturally extendable framework Platform-neutral –machine and OS Why Use an SOA?

7 Open Grid Forum - July 24, 2006 SOA & Web Services: Key Benefits SOA Flexible Locate services on any server Relocate as necessary Prospective clients find services using registries Scalable Add & remove services as demand varies Replaceable Update implementations without disruption to users Fault-tolerant On failure, clients query registry for alternate services SOA Flexible Locate services on any server Relocate as necessary Prospective clients find services using registries Scalable Add & remove services as demand varies Replaceable Update implementations without disruption to users Fault-tolerant On failure, clients query registry for alternate services Web Services Interoperable Growing number of industry standards Strong industry support Reduce time-to-value Harness robust development tools for Web services Decrease learning & implementation time Embrace and extend Leverage effort in developing and driving consensus on standards Focus limited resources on augmenting & adding standards as needed Web Services Interoperable Growing number of industry standards Strong industry support Reduce time-to-value Harness robust development tools for Web services Decrease learning & implementation time Embrace and extend Leverage effort in developing and driving consensus on standards Focus limited resources on augmenting & adding standards as needed

8 Open Grid Forum - July 24, 2006 Virtualizing Resources Resources Web services Access Storage Sensors Applications Information Computers Resource-specific Interfaces Common Interfaces Type-specific interfaces

9 Open Grid Forum - July 24, 2006 A Service-Oriented Grid Virtualized resources Grid middleware services Brokering Service Registry Service Data Service CPU Resource Printer Service Job-Submit Service Compute Service Notify Advertise Application Service

10 July 24, 2006 Open Grid Forum - A Closer Look at OGSA

11 Open Grid Forum - July 24, 2006 OGSA Capabilities Security Cross-organizational users Trust nobody Authorized access only Security Cross-organizational users Trust nobody Authorized access only Information Services Registry Notification Logging/auditing Information Services Registry Notification Logging/auditing Execution Management Job description & submission Scheduling Resource provisioning Execution Management Job description & submission Scheduling Resource provisioning Data Services Common access facilities Efficient & reliable transport Replication services Data Services Common access facilities Efficient & reliable transport Replication services Self-Management Self-configuration Self-optimization Self-healing Self-Management Self-configuration Self-optimization Self-healing Resource Management Discovery Monitoring Control Resource Management Discovery Monitoring Control OGSA OGSA profiles Web services foundation

12 Open Grid Forum - July 24, 2006 CDL 3. Select from or deploy required resources Execution Management The basic problem Execute and manage jobs/services in the grid Select from or provision required resources The basic problem Execute and manage jobs/services in the grid Select from or provision required resources 2. Submit the job 1. Describe the job JSDL Job 4. Manage the job

13 Open Grid Forum - July 24, 2006 Describing a Job Submission: JSDL Job Submission Description Language (JSDL) A language for describing the requirements of jobs for submission Declarative description A JSDL document describes the job requirements Job identification information Application (e.g., executable, arguments) Required resources (e.g., CPUs, memory) Input/output filesJob IT Infrastructure JSDL

14 Open Grid Forum - July 24, 2006 Configuration & Deployment: CDL Prepare the infrastructure so that the job can execute Provide a right-shaped slot to fit the job Main parts: Configuration Description Language (CDL) provides declarative definition of system configuration Deployment service carries out configuration requests to deploy and configure the system IT Infrastructure CDL Prepare

15 Open Grid Forum - July 24, 2006 Issues Find Describe Access Data Formats Protocols Use cases Data Move/Copy/Replicate Metadata Data Manage Common access Data Services The basic problem Manage, transfer and access distributed data services and resources The basic problem Manage, transfer and access distributed data services and resources Derived dataCatalog SensorData stream Text file Relational database

16 Open Grid Forum - July 24, 2006 Basic Data Services Data Resources Managed Storage Data Resources Transfer Protocols Storage Managemen t Data Managemen t Other Data Services Transfer Registries Other OGSA services and non-OGSA client APIs Service interface Resource interface

17 Open Grid Forum - July 24, 2006 Data Services Data Service n Data Service 1 Data Service 2 Composite Data Services Replication Cache Federation

18 Open Grid Forum - July 24, 2006 Basic Data Interfaces Storage Management e.g. Storage Resource Management (SRM) Storage Management e.g. Storage Resource Management (SRM) Data Access ByteIO Data Access & Integration (DAI) Data Access ByteIO Data Access & Integration (DAI) Data Transfer Data Movement Interface (DMI) Protocols (e.g. GridFTP) Data Transfer Data Movement Interface (DMI) Protocols (e.g. GridFTP) Replica management Metadata catalog Cache management Replica management Metadata catalog Cache management

19 Open Grid Forum - July 24, 2006 Resource Management Provides a framework to integrate resource management functions interfaces, services, information models, etc. Enables integrated discovery, monitoring, control, etc. Provides a framework to integrate resource management functions interfaces, services, information models, etc. Enables integrated discovery, monitoring, control, etc. High-level management services (GGF) Domain-specific capabilities OGSA Access to manageability (OASIS, DMTF) Information models (DMTF, SNIA, etc.) Resources WSDM, WS-Management WSRF/WSN, WS-Transfer/Eventing Data services Security services Execution Management services Application- specific

20 Open Grid Forum - July 24, 2006 Self-Management Monitoring Projection Analysis Action Policy SLA Self-configuration: Automatically adapt to changes in the environment : e.g. Deploy/undeploy resources as load changes Self-configuration: Automatically adapt to changes in the environment : e.g. Deploy/undeploy resources as load changes Self-optimization: Automatically tune system to best meet user or business needs Uses service-level agreements (SLAs) Self-optimization: Automatically tune system to best meet user or business needs Uses service-level agreements (SLAs) Self-healing: Automatically detect & correct problems Component failures Security violations etc. Self-healing: Automatically detect & correct problems Component failures Security violations etc.

21 Open Grid Forum - July 24, 2006 Information Services Execution management Resource reservation Problem determination Accounting Application monitoring Load balancing Service discovery Consumers Information Services Reliable Secure Efficient Provide management and access facilities for information about applications and resources in the grid environment Producers Asynchronous notification Retrieval Registry Logger

22 Open Grid Forum - July 24, 2006 Security Services Authorization, roles, and access privileges Locally (site) managed Based on SAML and XACML security standards Implementations provide credential mapping Working with GGF Security Area groups Authorization attributes for grids Developing OGSA basic security profiles PKI certificate WS-Security WS-Addressing OGSA security profiles

23 Open Grid Forum - July 24, 2006 OGSA Profiles The normative definition of OGSA Styled on WS-I profiles to promote interoperability Define specific usage patterns e.g. execution management Basis for claims of conformance My scheduler conforms to the OGSA Execution Management Profile… Include specifications developed by OGF and by other bodies Issue: How mature and widely adopted? OGSA Profile Definition document provides guidelines In the futureEarly stagesIn the pipeline Data Profile OGSA WSRF Basic Profile OGSA Basic Security Profile – Core OGSA Basic Security Profile – Secure Channel Execution Mgmt Profile Others… HPC Profile

24 July 24, 2006 Open Grid Forum - OGSA and the Standards Landscape

25 Open Grid Forum - July 24, 2006 Specifications Landscape: July 2006 SYSTEMS MANAGEMENT UTILITY COMPUTING GRID COMPUTING Core Services Web Services Foundation WS-Addressing Privacy WS-BaseNotification CIM/JSIM WSRF-RAP WSDM WS-Security Naming OGSA-EMSOGSA Self Mgmt GFD-C.16 GGF-UR Data Model HTTP(S)/SOAP Discovery SAML/XACML WSDL WSRF-RL Trust WS-DAI VO Management Information Distributed query processing ASP Data Centre Use Cases & Applications CollaborationMulti MediaPersistent Archive Data Transport WSRF-RP X.509 StandardEvolvingGapHole Warning: Volatile data!

26 Open Grid Forum - July 24, 2006 Related Standards Bodies OGF (Open Grid Forum) Overall architecture for grid computing OGSA, CDDLM, WS-Agreement, … OASIS (Organization for the Advancement of Structured Information Standards) Middleware/Web services focused WSRF, WS-Notification, WSDM, WS-Security… DMTF (Distributed Management Task Force) Management and Information models (CIM) Server management WS-Management WS-CIM W3C (WWW Consortium) WS-Addressing WS-Policy Not a complete list! Logos are trademarks or service marks of their respective owners.

27 Open Grid Forum - July 24, 2006 OGF SCRM-WG Formed at GGF14 Online reference guide of standards Taxonomy Glossary Live wiki document available SDOs Collaboration on networked Resourced Management- WG DMTF

28 July 24, 2006 Open Grid Forum - Making It Happen: The OGSA Working Group

29 Open Grid Forum - July 24, 2006 The OGSA Working Group History Established September 2002 Declared OGFs flagship architecture March 2004 Getting it done Over 300 mailing-list subscribers Twice-weekly teleconferences Regular face-to-face meetings (at least 3+3 per year) Collaboration with other working groups and standards organizations Contributors Industry Government Academia

30 Open Grid Forum - July 24, 2006 Aims & Perspective Goals Interoperable solutions for grid-based applications Addressing loosely coupled distributed computing Approach Standardization at the architectural level Understand & describe the elements of grid systems and models Develop architectural framework for standards in service-oriented grids Similar to profiling Use existing standards and technology where possible Validate current standards for applicability in grids Use case-driven gap analysis – gaps filled proactively Provide direction/motivation for new standards activity Leverage & collaborate with other standards organizations

31 Open Grid Forum - July 24, 2006 The OGSA Process Use case-driven 21 detailed use cases Design team working model Facilitate cross-fertilization within and outside OGF Focus mind-share (the most valuable commodity!) e.g. DAIS and OGSA-Data working groups Design teams: Execution Management, Resource Management, Security OGSA fellow WGs Formal independent OGF WG with OGSA- prefix Work on some particular service interface Design teams may move up to OGSA fellow WGs Tightly collaborate and synchronize with OGSA-WG Iterative refinement Abstract service evolving to concrete specifications

32 Open Grid Forum - July 24, 2006 OGSA Document Structure OGSA Roadmap OGSA Architecture OGSA Use Cases Scenario Service Description Candidate Profile Profile Actual specs consistent inform and guide inform and guide feedback refer Proposed recommendation Informational OGSA-WG documents Documents produced by other OGF WGs or other SDOs Base document Information models Modeling guidelines Profile Definition Guidelines

33 Open Grid Forum - July 24, 2006 OGSA and Fellow WGs OGSA debut WSRF TC WSRF WSRF 1.0 Arch 1.0 WSRF BP 1.0 OGSA-Naming WG OGSA-BES WG OGSA-ByteIO WG OGSA-RSS WG OGSA-WG OGSA-AuthZ WG Arch 1.5 OGSA-Data WG OGSA-DMI WG OGSA-HPCP WG OGSI 1.0 OGSI-WG Roadmap 1.0 Use Cases Roadmap 1.1

34 Open Grid Forum - July 24, 2006 Published OGSA Documents Base document Service description Profile Specification 2004 Architecture V1.0 (GFD-I.30) Glossary V1.0 (GFD-I.44) Resource Management (GFD-I.45) Architecture V1.0 (GFD-I.30) Glossary V1.0 (GFD-I.44) Resource Management (GFD-I.45) Use Cases (GFD-I.29) Roadmap (GFD-I.53) JSDL (GFD-R-P.56) Profile Definition (GFD-I.59) Guideline

35 Open Grid Forum - July 24, 2006 OGSA Schedule EMS arch scenarios HPC Profile ByteIO Basic Execution Service Architecture V1.5 Glossary V1.5 Roadmap V1.1 Base document Service description Profile Specificatio n Guideline Modeling guideline WS-Naming Public comment start GFD publication Data architecture WSRF Basic Profile Basic Security Profiles Container info-model

36 Open Grid Forum - July 24, 2006 The OGSA Roadmap Defines OGSA as: An architectural process A set of specifications & profiles OGSA software For each OGSA-related document: Schedule Dependencies Publication: v1.0 published September 05 (GFD.53) Next version v1.1 in progress and plan to publish Jan. 2007

37 Open Grid Forum - July 24, 2006 OGSA-Based Open-Source Grids Numerous grid projects are implementing OGSA components

38 Open Grid Forum - July 24, 2006 Summary An open, service-oriented architecture Built on a Web services infrastructure Virtualize resources to hide complexity An open, service-oriented architecture Built on a Web services infrastructure Virtualize resources to hide complexity Interoperability is key! OGSA is defining a set of core services Designed to work together… …but with implementation flexibility Interoperability is key! OGSA is defining a set of core services Designed to work together… …but with implementation flexibility The current set of services is not the end of the road – just the beginning!

39 Open Grid Forum - July 24, 2006 More materials Architecture and Glossary v1.5 https://forge.gridforum.org/sf/go/doc13553?nav=1 https://forge.gridforum.org/sf/go/doc13555?nav=1 OGSA-WG project page OGSA-WG mailing list Send to with the body text "subscribe

40 Open Grid Forum - July 24, 2006 Acknowledgement With special thanks to Jem Treadwell, Andrew Grimshaw, Jay Unger, Andreas Savva, David Snelling, Tom Maguire, Dave Berry, Chris Jordan, Frank Siebenlist, Fred Maciel, Michael Behrens, Allen Luniewski, Andrea Westerinen, and other OGSA-WG members

41 Open Grid Forum - July 24, 2006 OGF Full Copyright Notice Copyright (C) Open Grid Forum (2005, 2006). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. However, this document itself may not be modified in any way, such as by removing the copyright notice or references to the OGF or other organizations, except as needed for the purpose of developing Grid Recommendations in which case the procedures for copyrights defined in the OGF Document process must be followed, or as required to translate it into languages other than English. The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assigns. This document and the information contained herein is provided on an "AS IS" basis and THE OPEN GRID FORUM DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE."


Download ppt "Promoting and Standardizing Grid Computing Defining the Grid: Open Grid Services Architecture Current and Future Generation Grid Technology Summer School."

Similar presentations


Ads by Google