7-2.1 Additional Features of WSRF/GT4 Services A brief outline © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification date:

Slides:



Advertisements
Similar presentations
Introduction to Java 2 Programming Lecture 3 Writing Java Applications, Java Development Tools.
Advertisements

GT4 WS Core Tutorial Sam Meder Jarek Gawor 6/11/04.
A3.1 Assignment 3 Simple Job Submission Using GT 4 GRAM.
BiodiversityWorld GRID Workshop NeSC, Edinburgh – 30 June and 1 July 2005 Resource wrappers, web services, grid services Jaspreet Singh School of Computer.
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
WS-Resource Framework Adam Belloum Computer Architecture & Parallel Systems group University of Amsterdam
Reza Gorgan Mohammadi AmirKabir University of Technology, Department of Computer Engineering & Information Technology Advanced design.
Building Services in WSRF Ben Clifford GGF Summer School July 2004.
4d.1 Grid Computing, B. Wilkinson, 2005 Web Service Resource Framework Notes on “sticky note” assignment.
4a.1 Grid Computing Standards ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4a.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
Copyright W. Howden1 Lecture 19: Intro to O/O Components.
Building services in WSRF Ben Clifford Draft For GGF summer school, July 2004.
4c1 GT 4 grid services and their implementation Advanced features: An overview Topics: Resource home Singleton resource Multiple resources Notifications.
4c1 GT 4 Services Advanced features: A very brief overview Topics: Resource home Singleton resource Multiple resources Notifications Lifecycles Copyright.
Grid Computing, B. Wilkinson, 20046c.1 Globus III - Information Services.
GT4 Introductory and Advanced Practicals Rachana Ananthakrishnan, Charles Bacon, Lisa Childers Argonne National Laboratory University of Chicago.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
1 Modeling Stateful Resources with Web Services ICE Ph.D lecture Byung-sang Kim.
Web Services (tying it all together) and Introduction to Grid Services Concepts These slides are adapted from course material developed by Barry Wilkinson,
GT3 Tutorial Chapter 5, 6, and 7 Lecture for Cluster and Grid Computing, CSCE 490/590 Fall 2004, University of Arkansas, Dr. Amy Apon
Grid Computing Grid computing is all about achieving greater performance and throughput by pooling resources on a local, national, or international level.
T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
4c.1 Grid Computing, B. Wilkinson, 2005 Web Service Resource Framework Creating Globus 4 services.
OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
1 Stateful Session Beans Stateless Session Beans Michael Brockway Sajjad Shami Northumbria University School of Computing, Engineering & Information Sciences.
LiveCycle Data Services Introduction Part 2. Part 2? This is the second in our series on LiveCycle Data Services. If you missed our first presentation,
WSRF & WSRF’s Application in VO-DAS Haijun Tian ChinaVO
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
XML Registries Source: Java TM API for XML Registries Specification.
Application code Registry 1 Alignment of R-GMA with developments in the Open Grid Services Architecture (OGSA) is advancing. The existing Servlets and.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
This product includes material developed by the Globus Project ( Exercise 6 Discovery: Find a File.
Chapter 6 Server-side Programming: Java Servlets
The Anatomy of the Grid Introduction The Nature of Grid Architecture Grid Architecture Description Grid Architecture in Practice Relationships with Other.
REST - Introduction Based on material from InfoQ.com (Stefan Tilkov) And slides from MindTouch.com (Steve Bjorg) 1.
Shannon Hastings Multiscale Computing Laboratory Department of Biomedical Informatics.
Introduce Grid Service Authoring Toolkit Shannon Hastings, Scott Oster, Stephen Langella, David Ervin Ohio State University Software Research Institute.
Grid Services I - Concepts
Topic 1 Object Oriented Programming. 1-2 Objectives To review the concepts and terminology of object-oriented programming To discuss some features of.
Information Services Andrew Brown Jon Ludwig Elvis Montero grid:seminar1:lectures:seminar-grid-1-information-services.ppt.
Jini Architecture Introduction System Overview An Example.
Web Service Resource Framework WSMO Presentation Jos de Bruijn Digital Enterprise Research Institute http ://
Transaction Processing CS409 Application Services Even Semester 2007.
On Using BPEL Extensibility to Implement OGSI and WSRF Grid Workflows Aleksander Slomiski Presented by Onyeka Ezenwoye CIS Advanced Topics in Software.
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
Steve Graham WS-ResourceFramework Modeling Stateful Resources With Web services OASIS WSRF TC F2F Wednesday, April 28th, 2004.
Office of Science U.S. Department of Energy Globus World Python WS Core Joshua R. Boverhof Lawrence Berkeley National Laboratory.
© 2004 IBM Corporation WS-ResourceFramework Service Groups Tom Maguire.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
GT3 Index Services Lecture for Cluster and Grid Computing, CSCE 490/590 Fall 2004, University of Arkansas, Dr. Amy Apon.
Copyright © 2004, Keith D Swenson, All Rights Reserved. OASIS Asynchronous Service Access Protocol (ASAP) Tutorial Overview, OASIS ASAP TC May 4, 2004.
10 th Lecture COP 4991 Component-Based Software Development Instructor: Masoud Sadjadi
This product includes material developed by the Globus Project ( Exercise 8 Transience: Create and Destroy FileShares.
DEVELOPING WEB SERVICES WITH JAVA DESIGN WEB SERVICE ENDPOINT.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
© 2005 Global Grid Forum The information contained herein is subject to change without notice Leading the pervasive adoption of grid computing for research.
Database (Microsoft Access). Database A database is an organized collection of related data about a specific topic or purpose. Examples of databases include:
ISC321 Database Systems I Chapter 2: Overview of Database Languages and Architectures Fall 2015 Dr. Abdullah Almutairi.
Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,
WS-Resource Framework University of Amsterdam
Event Sources and Realtime Actions
OGSA Data Architecture Scenarios
Additional Features of WSRF/GT4 Services
Presentation transcript:

7-2.1 Additional Features of WSRF/GT4 Services A brief outline © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification date: July 20, 2011 Note: Globus version 5 does not include any GT4 web service components and this section may be less important in the future.

7-2.2 Stateful GT 4 Grid Services Review “Pure” Web services are stateless. Stateful web services required for Grid computing. WSRF provides stateful web services by having a Web service as a front-end to a stateful “resource.”

7-2.3 GT 4 services Key aspect is separation of (Web) service and a resource – conceptually if not actually. Provides ability to have “state” without altering the statelessness of Web service.

7-2.4 Web Service Resource Resource properties Client Web Service Resource Framework (WSRF)‏ Holds information retained between accesses.

Resource properties Name given to data items in the resource Can consist of: –Data values about current state of service (results of calculations etc.)‏ –Metadata: Information about data –Information about whole resource: Termination time, etc

7-2.6 Combining Service Code and Resource Simplest arrangement is to have both the service code and resource code were held in a single file. Ideally, we would like to have multiple resources for a Web service Having one file not the preferred way except for simple service examples.

7-2.7 Separate Resource More generally, resource is a (stateful) class. End Point Reference (EPR) is an XML document that has URL of service and possibly a resource identification (key)‏ Classes provided for different arrangements: ReflectionResourceProperty class can be used when service code and resource in one file.

7-2.8 Resource Home Resources are managed by Resource Home's Provides resource management functions –for adding resources –for removing resources

7-2.9 Resource Home Client Web Service Resource home Resource Manages Methods operate on resources properties create/ find resource Client only interacts with stateless web service

Service and resource code Client Web Service Resource home Resource Manages add() and subtract() methods operate on resource properties create/ find resource void add(int a)‏ void subtract (int a)‏ int value String lastOP

Resource Home Client Web Service Resource home Resource If service and resource in one file, resource limited to one resource using a Globus supplied resource home called ServiceResourceHome

Service and resource code Client Web Service Resource home “ServiceResourceHome” Resource add() and subtract() methods operate on resource properties create/ find resource void add(int a)‏ void subtract (int a)‏ int value String lastOP ServiceResourceHome returns service object

Separate Service, Resource & Resource Home files Singleton Resources (Single resource)‏ Client Web Service Resource home Resource Three files: the service, the resource home, and the resource. void add(int a)‏ void subtract (int a)‏ int value String lastOP

Multiple Resources Suppose there are multiple resources that a service might interact with: Client Web Service Resources

Creating Resources WS-Resource Factory Pattern Traditional object-oriented approach to creating resources is to use a “factory” service: Factory service responsible for creating instances of resources. Each resource assigned a unique “key”, which together with service URI identifies WS-resource pair. (Endpoint Reference)‏

Client “Instance” Service Resources WS-Resource Factory Pattern Factory service Request resource creation Request operation on resource Create Perform operation Return WS- Resource EPR

Relationship with Resource Home Client Service instance Resource Home Resource Manages Methods operate on resources properties Find resource Factory Service Request resource creation Use Resource Home to create resource Request operation

Factory service Create Resource operation endpointReference createResource()‏ Returns an EPR to the newly created WS- Resource. “Fully qualified” EPR to include URI of service and key of resource Client needs to know location of factory service.

Question Q: Why would one want to have multiple resources for a Web service?

Lifecycle Management Lifecycle mechanisms available in WSRF. GT4 provides mechanisms to specify when a resource is automatically destroyed. Immediately by invoking destroy operation through a Web service Scheduled some time in the future Leased-based lifecycle management

Immediate Destruction Command line: globus-wsrf-destroy -e EPR1234.epr Destruction can be requested through a Web service by a client: math.destroy(new Destroy()); Notice - factory responsible for creating resource, but service instance destroys it. File containing EPR of resource

Scheduled Termination Time Termination time exposed as a resource property. Can be set with GT4 command: wsrf-set-termination-time Example wsrf-set-termination-time -e EPR1234.epr 100 File containing EPR of resource Termination time in seconds

Question Q: Why would one want to have a termination time set for a resource?

Lease-based Lifetime In lease-based model, resources must be kept alive by interested parties, otherwise resource dies. A lifetime for a service is set after which the service is destroyed. Interested parties (clients) must renew the lease (reset the termination time) or it will be destroyed. Clean up without having to use a destroy operation explicitly.

Notifications Notifying clients when something interesting happens. Example might be when a resource property reaches a certain value Could use polling but this is very inefficient. WS-notification defines mechanisms.

Resource property changes Examples: –Changes to resource property values. –Methods added –Methods removed –Resources destroyed

Subscribe for notifications Need client to “subscribe” to receive notifications. Subscriptions are for a particular topic. Resource implemented with GT 4 classes that provide for automatic notifications whenever property changes.

Automatic notifications Fig 7.8

GT 4 Information Services Monitoring and Discovery Services (MDS) Principal components: Index service Trigger service WebMDS

Index service WebMDS Trigger service Information services

Globus core does not include information services such as index services. When installed, would see it in list of services, e.g.: Index service Trigger service Fig 7.9

Container Index service (resources with resource properties)‏ Index Service GT 4 provided with an index service that can maintain a list of available resources.

Index service Fig Note -- index service does not act as a local service registry listing the services — it act as a registry for the resources.

“add” method of ResourceHome used to create resource. Override method to include registering resource with index service.

Querying Index Service wsrf-query Browse index service with the GT4 command: wsrf-query which will list resource properties in an XML format.

Example wsrf-query –s DefaultIndexService '/*' which will list resource properties in an XML format. Result might be: 234

An index service can be browsed with the GT4 command such as: wsrf-query –s \ '/*' which will list all the resource properties and their values in an XML format, where index service located at XPath expressions can be used to select specific resource properties.

“ Community” Index Service A remote index service that holds all the index services of the “virtual organization.” For example a community index service might be at: services/DefaultIndexService

Fig 7.12

Local Index service Resources Service Client Local Index service Resources ServiceClient Student 1 Index entry Student 2 Index entry Student 1 container Only container and GT 4 core needed at each site to handle services. Student 2 container Community index service

Querying Community Index Service Have Community Index Service running. Use wsrf-query command: $GLOBUS_LOCATION/bin/wsrf-query -s ices/DefaultIndexService '/*' Should see contents of all local index services.

Resource Discovery The local and community index services can be searched for a particular resource property. Since Resources properties are XML, can use “XPath” queries for searching and retrieval.

XML Path Language (XPath)‏ W3C recommendation, 1999 A query language for search XML documents. Queries formed by identifying a route to the desired data. For details:

MDS4 Trigger Service Subscribes to a set of resource properties Evaluate that data against a set of pre- configured conditions (triggers) When a condition matches, action occurs – is sent to pre-defined address –Website updated From: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf, Sept 11, 2006

WebMDS Web-based interface to display resource property information. Front-end to index services. Sample: webmds?info=indexinfo&xsl=servicegroupxsl

More Information Book Globus Toolkit 4 Programming Java Services Borja Sotomayor and Lisa Childer Morgan Kaufmann, On-line GT4 services:

What is a (WS) notification in Grid services? (a) A mechanism of the GGF committee to inform the community of changes to the (WS) standard (b) A mechanism for client to inform a Grid service of its existence (c) A mechanism to inform a client of changes in the service or resource (d) A final demand to pay your taxes SAQ 7-4

What is the purpose of the Globus index service? (a) To hold index variables for arrays (b) To operate on an array of functions (c) To maintain a list of available services (d) To maintain a list of available resources FAQ 7-11

Questions