1. © 2006 Open Grid Forum BES, HPC, JSDL and GLUE Profiling OGF 23, Barcelona, Tuesday 16 October 2007

2. © 2006 Open Grid Forum 2 OGF IPR Policies Apply “ I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy. ” Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the OGF plenary session, any OGF working group or portion thereof, the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, the ADCOM, or any member thereof on behalf of the ADCOM, any OGF mailing list, including any group list, or any other list functioning under OGF auspices, the OGF Editor or the document authoring and review process Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions. Excerpt from Appendix B of GFD-C.1: ” Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non- discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification. ” OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.

3. © 2006 Open Grid Forum 3 Scope of The Session BES, HPC Basic Profile and JSDL are proposed recommendations GLUE 2.0 spec is in public comment Approved by GFSG, 1 June 2008 Identify the missing integration points for these specifications Define a roadmap for a profile definition

4. © 2006 Open Grid Forum 4 JSDL JSDL: Job Submission Description Language It describes the requirements of computational jobs for submission to Grids and other systems A JSDL document describes job requirements What to do, not how to do it JSDL does not define a submission interface what the results of a submission look like how resources are selected

5. © 2006 Open Grid Forum 5 OGSA-BES Basic Execution Service It defines a Web Services interface for creating, monitoring and controlling “Activities” such as OS processes, service instances or parallel programs Extensible state model for modeling the life- cycle of Activities Temporary information model for the BES container itself and for the Activities it manages

6. © 2006 Open Grid Forum 6 HPC Basic Profile defines how to combine JSDL and OGSA- BES for batch job submission on homogeneous cluster with shared file system The HPC Profile purposefully reduces the scope of JSDL and BES in order to ensure base line interoperability by clarifying ambiguities

7. © 2006 Open Grid Forum 7 GLUE GLUE: An information model for describing characteristics and status of Grid resources It enables to describe relevant characteristics required for resource selection and high-level management GLUE 2.0 covers main entities, computing entities and storage entities We want to use together with: OGSA-BES services to expose resource properties JSDL documents to express requirements on resources

8. © 2006 Open Grid Forum 8 Integration Points (preliminary list) GLUE/JSDL Integration 1.How to express requirements based on GLUE concepts in JSDL GLUE/BES Integration 1.How to expose GLUE information from BES 2.How to query GLUE information from BES 3.How to select a Computing Share when submitting an activity to BES 4.How staging areas published in GLUE are connected to data staging capabilities?

9. © 2006 Open Grid Forum Expressing Requirements in JSDL using GLUE

10. © 2006 Open Grid Forum 10 Sample Scenario and GLUE Concepts

11. © 2006 Open Grid Forum 11 JSDL Given a GLUE-based description of Grid resources made available by the information service Given a JSDL-based job submission request How can we express requirements in the JSDL doc so that they can be matched against GLUE-based description of resources? How can a matchmaker evaluate the suitability of a resource for a certain job request?

12. © 2006 Open Grid Forum 12 JSDL 1.0 JSDL Resource Elements are limited compared to GLUE 2.0 Computing Entities Mapping JSDL Resource Elements into GLUE 2.0 seems not viable There are plans to extend JSDL to support XQuery expressions What can we do today with JSDL 1.0? Use extensibility? How?

13. © 2006 Open Grid Forum 13 How to Extend JSDL Descriptive Approach E.g.: JSDL 1.0 RangeValue_Type and its matching semantics Exact, upperBoundedRange, LowerBounded(, but using GLUE vocabulary but using GLUE vocabulary Declarative Approach Via query language e.g., XPath/XQuery expression using GLUE 2.0 terms|

14. © 2006 Open Grid Forum 14 How to Smoothly Handle Updates of GLUE? When new version of GLUE will be available, how to avoid breaking working JSDL descriptions? A possible solution: Resource requirements in JSDL refer to a certain namespace GLUE udpates depolyed in parallel to existing version Wait for migration before drop old GLUE

15. © 2006 Open Grid Forum Exposing GLUE from BES

16. © 2006 Open Grid Forum 16 What Sits Behind BES? BES is a standard interface to computing resources How can I get the knowledge of the characteristics of the resources sitting behind a BES endpoint? Proposed solution: BES should expose GLUE-based description

17. © 2006 Open Grid Forum 17 BES Operations Where GLUE Can Be Used BES-Factory Port-type GetActivityStatuses GetActivityDocuments GetFactoryAttributesDocument BES-Management Port-type No hooks BES-Activity Port-type Undefined

18. © 2006 Open Grid Forum 18 BES-Factory::GetActivityStatuses Add GLUE Computing Activity Fragment

19. © 2006 Open Grid Forum 19 BES-Factory::GetActivityDocuments “The ActivityDocument element is used to describe either the desired or the actual representation of a single activity and has the following structure” ? At the moment, we don’t add any GLUE info in this message; when we will define how JSDL can contain requirements on GLUE attributes, then we can discuss it again

20. © 2006 Open Grid Forum 20 BES-Factory::GetFactoryAttributesDocument GetFactoryAttributesDocument no input parameter, while the output is an XML document compliant to the XSD complex type: bes-factory:BESResourceAttributeDocumentType Add Computing Service Description Without Activities

21. © 2006 Open Grid Forum 21 BES-Factory::GetFactoryAttributesDocument To profile what to do with mandatory attributes

22. © 2006 Open Grid Forum 22 How to Signal that We Want GLUE Information Should the GLUE information be returned by default? Or should it be returned upon an extra parameter in the request message which specify the GLUE version as well? E.g.: GetFactoryAttributesDocument could be extended to be able to request a document formatted according to a certain information model name/version

23. © 2006 Open Grid Forum Querying GLUE from BES

24. © 2006 Open Grid Forum 24 How to Query Information Exposed by BES? At the moment, you can ask for Activity status by job ID (EPR) Complete resouce description There is no way to specify query to be executed on the BES side How can we extend BES in order to provide query capabilities on the server side? Extra parameter in the GetFactoryAttributesDocument? Should we add a new operation? e.g.: GetDocument (Namespace,QueryLanguage,QueryExpression,DataFormat) What about WS-RF/WS-RT?

25. © 2006 Open Grid Forum Selecting a Computing Share from BES

26. © 2006 Open Grid Forum 26 Sample Scenario and GLUE Concepts

27. © 2006 Open Grid Forum 27 How to Select a Certain Share from BES? GLUE defines the concept of Computing Share In a cluster, many shares where Grid users can be mapped can be configured A single BES instance can place jobs on any of the available shares How does the BES client specify to which it wants to place the job? JSDL parameter BES URL parameter BES extra parameter in message? What about default shares?

28. © 2006 Open Grid Forum 28 What’s Next Which OGF group is the context for this work? GLUE or GIN? Who is willing to collaborate for the profile definition? Are there any other missing integration points? First profile draft for OGF24?

29. © 2006 Open Grid Forum 29 Full Copyright Notice Copyright (C) Open Grid Forum (2008). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees.