1. Building components for Grid Interoperability Stephen Brewer, Deputy Project Manager, OMII-Europe s.brewer@ecs.soton.ac.uk OGF 22 – Boston, MA

2. EU project: RIO31844-OMII-EUROPE 2 Outline What is OMII-Europe –Overview of the project –Vision and Objectives Approaches to Interoperability What OMII-Europe is Doing What can OMII-Europe do for you?

3. EU project: RIO31844-OMII-EUROPE 3 What is OMII-Europe OMII-Europe stands for –Open Middleware Infrastructure Institute for Europe It is an EU-funded project: FP6, RI It has an initial duration of 2 years May 2006 -> April 2008 It has been granted a contribution of 8M € It involves 16 partners –8 EU –4 USA –4 China

4. EU project: RIO31844-OMII-EUROPE 4 Partners FundedUnfunded University of Southampton (coordinator) UKUniversity of ChicagoUSA Fujitsu Laboratories EuropeUKNCSA, University of IllinoisUSA Kungl Tekniska HögskolanSwedenUniversity of Southern California, Los Angeles USA Istituto Nazionale di Fisica NucleareItalyUniversity of WisconsinUSA Poznan Supercomputing and Networking Center PolandBeihang UniversityChina Forschungszentrum Juelich (FZJ)GermanyChina Institute of Computing Technology, Beijing China University of EdinburghUKComputer Network Information Centre, Beijing China CERN, European Organisation for Nuclear Research SwitzerlandTsinghua UniversityChina

5. EU project: RIO31844-OMII-EUROPE 5 Project Structure and Effort Allocation Networking activities –Management, Outreach, Training –8% Person Effort Service Activities –Repository, QA, Support –25% Person Effort Joint Research Activities –Re-engineering, new services, integration, benchmarking –67% Person Effort

6. EU project: RIO31844-OMII-EUROPE 6 Vision “ e-Science having easy access and use of Grid resources in heterogeneous e-infrastructures crossing national, pan-European and global boundaries “

7. EU project: RIO31844-OMII-EUROPE 7 Mission “ Enabling of e-infrastructure interoperability by providing standards-based middleware components leveraging existing work and activities “

8. EU project: RIO31844-OMII-EUROPE 8 Focus Achieving interoperability through common standards –Common standards is the long term solution –Significant involvement and success in OGF and Oasis –Implementations of standards in tandem with standards development on all middleware platforms

9. EU project: RIO31844-OMII-EUROPE 9 Approaches to Interoperability Adapters-based: –The ability of Grid middleware to interact via adapters that translate the specific design aspects from one domain to another Standard-based: –the native ability of Grid middleware to interact directly via well-defined interfaces and common open standards * definition inspired by OGF GIN CG

10. EU project: RIO31844-OMII-EUROPE 10 Who Benefits from Interoperability? Grid Developers –A single standard set of services on all Grid middleware systems –Applications portable across different Grid middleware systems E-Science application users –Common ways for accessing any e-infrastructure resources –Potential access to a significantly larger set of resources E-resource owners –Reduced management overheads as only a single Grid middleware system needs deployment –Potential for greater resource utilisation “For the Grid to deliver on it’s promises interoperability needs to be taken for granted like network interoperability”

11. EU project: RIO31844-OMII-EUROPE 11 Participation in Middleware Standardisation Most project participants involved as member/observer in many OGF WG 11 project participant hold senior positions in –OGSA DAIS WG (Database Access and Integration Services) –OGSA RUS WG (Resource Usage Server) –OGSA BES WG (Basic Execution Service) –OGSA JSDL WG (Job Submission Description Language) –GIN CG (Grid Interoperability Now) –OGSA-AuthZ-WG (Authorization) –GLUE WG –GFSG WG (Grid File System) –RM WG (Reference Model) –OGSA Naming WG –Technical Standards Committee –GSA RG (Grid Scheduling Architecture) –GRAAP WG (Grid Research Agreement Allocation Protocol) –OGSA BYTE IO WG –OGSA D WG (Data) –OGSA DMI WG (Data Movement Interface)

12. EU project: RIO31844-OMII-EUROPE 12 OMII-Europe Guiding Principles Committed to standards process –Implementing established open standards –Providing feedback to the standards process (e.g. OGF) Quality Assurance –Published methodology and compliance test –All software components have public QA process and audit trail Impartiality –OMII-Europe is “honest broker” providing impartial advice/information on e-infrastructures

13. EU project: RIO31844-OMII-EUROPE 13 The Virtuous Cycle – Technology transfer with Grid projects and standards organisations Globus OMII-UK CROWN Components IN OUT JRA1 SA2 JRA4 JRA3 SA1 SA3 JRA2 New Components Standards Implementation Standards Compliance Testing and QA Benchmarking Integrated Components Supported Components on Eval. Infrastructure Repository

14. EU project: RIO31844-OMII-EUROPE 14 What OMII-Europe is Doing? Initial focus on providing common interfaces and integration of major Grid software infrastructures Common interoperable services: –Database Access –Virtual Organisation Management –Accounting –Job Submission and Job Monitoring Infrastructure integration –Initial gLite/UNICORE/Globus interoperability –Interoperable security framework –Access these infrastructure services through a portal

15. EU project: RIO31844-OMII-EUROPE 15 Job Submission Unify Job Submisson and Monitoring interface –Adoption of emerging OGSA- BES and JSDL standards Alpha BES and JSDL implementations for –UNICORE 6, gLite 3.1, Globus 4, OMII-UK, CROWNgrid Interoperability demonstrated through use of a BES compliant meta-scheduler

16. EU project: RIO31844-OMII-EUROPE 16 VO Management To provide a common Virtual Organisation (VO) management solution across middleware distributions Extend VOMS Interface to support emerging AuthZ standard –compliance with SAML Authorisation model Extension, not a replacement interface Public release of VOMS integrated with UNICORE

17. EU project: RIO31844-OMII-EUROPE 17 Accounting Unify accounting information across middleware distributions Provide standardized interfaces for accessing that information –Information standard: Usage Record Format (URF) –Service interface standard: Resource Usage Service (OGSA-RUS) Alpha versions RUS –gLite (DGAS) –Globus (SGAS) –UNICORE

18. EU project: RIO31844-OMII-EUROPE 18 Data Access Port OGSA-DAI 3.0 from Globus to other middleware distributions available throughout Europe and China –UNICORE –gLite –CROWN

19. EU project: RIO31844-OMII-EUROPE 19 Portal Deliver tools for developing Grid portals and support for key Web and Grid standards and technologies Objectives: –Develop gateway to OMII Evaluation Infrastructure –Develop tools for portal and grid software training –Explore new approaches for grid portal development

20. EU project: RIO31844-OMII-EUROPE 20 Repository of Open-Source Software Make available software reengineered within OMII- Europe and contributed by third parties –Single services/tools & complete distributions Provide an interface to select software from the repository based on user requirements –By capability/standards/provider/… Support the upload, download and installation of the software –Document platform portability & pre-requisites Verify the software through compliance & metrics tests

21. EU project: RIO31844-OMII-EUROPE 21 Behind the Repository Leverage existing infrastructure & projects –ETICS Capture build & test configuration data for repeatability –NMI Build & Test Framework Manage cross-platform environment for build & tests –Condor Underlying execution infrastructure Provides reports to be displayed within the portal –Builds: Pre-requisites & platforms –Testing: Conformance & Interoperability

22. EU project: RIO31844-OMII-EUROPE 22 Tests For Standards Conformance Job Submission and Job Monitoring –Job Submission Description Language (JSDL) –Basic Execution Service (BES) Accounting –Usage Record (UR) –Resource Usage Service (RUS) Database Access –WS-DAI, WS-DAIX, WS-DAIR (OGSA-DAI) Virtual Organisation Management –Move towards SAML2?

23. EU project: RIO31844-OMII-EUROPE 23 New Services Activity To identify capabilities which are missing from the OMII- Europe initial plans To identify priorities for the placement of such capabilities To work for the inclusion of the most relevant missing capability during the 2nd year of the project (May 2007-Apr 2008) To identify the challenges for further work

24. EU project: RIO31844-OMII-EUROPE 24 The First Missing Piece: a Community-agreed Information Model for Computing Resources OGSA-BES and JSDL are already considered by OMII-Europe They lack a common description of Grid resources suitable for discovery, monitoring and scheduling Many descriptions exist –e.g.: GLUE Schema, NorduGrid Schema Working on the definition of next- generation GLUE Information Model in the context of OGF GLUE WG and its implementationIt

25. EU project: RIO31844-OMII-EUROPE 25 What can you do Now… and Later… Now –Most products at Beta stage becoming publicly available –They provide basic interoperability of multiple grid middleware systems focusing on job execution –Available to early adopters working with OMII-Europe partners Spring 2008 (end of current project) –Further security integration work between different middleware platforms (SAML-VOMS, TLS (Transport level security)) –Completed QA’d services and demonstrated end-to-end solutions –Availability of GLUE 2 information model service implementations

26. EU project: RIO31844-OMII-EUROPE 26 Summary (1/2) OMII-Europe is a 24 Month EU funded project with 16 partners to establish grid infrastructure interoperability through implementing a set of agreed open standards on all middleware platforms OMII-Europe is implementing a number of components that will allow identically specified jobs to be run, managed and migrated to different middleware platforms Initial versions of BES, VOMS/SAML and security service have already enabled UNICORE and gLite managed resources to be used by the same job A complete set of fully interoperable services will be available in spring 2008

27. EU project: RIO31844-OMII-EUROPE 27 Summary (2/2) Users can try interoperability on the OMII-Europe evaluation infrastructure, or obtain services for installation on their own resources from the OMII-Europe repository We anticipate OMII-Europe services to be integrated into standard middleware distributions as well as deployed on large scale e-infrastructures such as EGEE and DEISA OMII-Europe requested continuing funding in the September EU call to support the existing services and provide further services in the areas of data and Grid management

28. EU project: RIO31844-OMII-EUROPE 28 Further Information http://omii-europe.org