The OMII Overview, Product and Roadmap. © University of Southampton omii OMII_1 Delivering a secure, reliable, web services infrastructure for grid applications.

Slides:



Advertisements
Similar presentations
Delivering User Needs: A middleware perspective Steven Newhouse Director.
Advertisements

Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.
The National Grid Service and OGSA-DAI Mike Mineter
Supporting the UK e-Science community and their international collaborators Steven Newhouse.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
VO Support and directions in OMII-UK Steven Newhouse, Director.
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
The UK OMII Context, Vision and Agenda An Institute of the University of Southampton.
Supporting education and research E-learning tools, standards and systems Sarah Porter Head of Development, JISC.
1 The IIPC Web Curator Tool: Steve Knight The National Library of New Zealand Philip Beresford and Arun Persad The British Library An Open Source Solution.
Intelligent Grid Solutions 1 / 18 Convergence of Grid and Web technologies Alexander Wöhrer und Peter Brezany Institute for Software.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
Thee-Framework for Education & Research The e-Framework for Education & Research an Overview TEN Competence, Jan 2007 Bill Olivier,
FREMA: e-Learning Framework Reference Model for Assessment David Millard Yvonne Howard IAM, DSSE, LTG University of Southampton, UK.
The OMII Position At the University of Southampton.
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
15th January, NGS for e-Social Science Stephen Pickles Technical Director, NGS Workshop on Missing e-Infrastructure Manchester, 15 th January, 2007.
1 OMII Release 1 Steven Newhouse, Peter Henderson Stephen Crouch & Karen Ng Presented by Mike Mineter for the NGS Induction Course
1 Globus Developments Malcolm Atkinson for OMII SC 18 th January 2005.
Globus 4 Guy Warner NeSC Training.
Hydra: future development A Hydra roadmap… Hydra Europe Symposium – Dublin – 7/8 April 2014 Richard Green.
The OMII Perspective on Grid and Web Services At the University of Southampton.
Possible Architectural Principles for OGSA-UK and other Grids UK e-Science Core Programme Town Meeting London Monday 31st January 2005 “Defining the next.
Database Taskforce and the OGSA-DAI Project Norman Paton University of Manchester.
What is OMII-Europe? Qin Li Beihang University. EU project: RIO31844-OMII-EUROPE 1 What is OMII-Europe? Open Middleware Infrastructure Institute for Europe.
User requirements for and concerns about a European e-Infrastructure Steven Newhouse, Director.
Software from Science for Science Steven Newhouse, Director.
The GRIMOIRES Service Registry Weijian Fang and Luc Moreau School of Electronics and Computer Science University of Southampton.
NGS in the future: emerging middleware.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Security Area in GridPP2 4 Mar 2004 Security Area in GridPP2 “Proforma-2 posts” overview Deliverables – Local Access – Local Usage.
DAIT (DAI Two) NeSC Review 18 March Description and Aims Grid is about resource sharing Data forms an important part of that vision Data on Grids:
London e-Science Centre GridSAM Job Submission and Monitoring Web Service William Lee, Stephen McGough.
1 27-Apr-2004AstroGrid Consortium Meeting - PL talk Agenda Tuesday status review / goals / science Lunch + AGLI Itn-05 review Dinner at Coton (share.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.
GridSAM - A Standards Based Approach to Job Submission Through Web Services William Lee and Stephen McGough London e-Science Centre Department of Computing,
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
OGSA-DAI.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
OGSA-UK: Putting the users first Steven Newhouse OMII Deputy Director.
Metadata Mòrag Burgon-Lyon University of Glasgow.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Next Steps.
Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
Registries, ebXML and Web Services in short. Registry A mechanism for allowing users to announce, or discover, the availability and state of a resource:
1 OGSA-DAI Status Report Neil P Chue Hong 20 th May 2005.
1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.
Testing Grid Software on the Grid Steven Newhouse Deputy Director.
Standards driven AAA for Job Management within the OMII-UK distribution Steven Newhouse Director, OMII-UK
An Introduction to UK e-Science Anne E Trefethen Deputy Director UK e-Science Core Programme.
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
INFSO-RI Enabling Grids for E-sciencE Web Services Mike Mineter National e-Science Centre, Edinburgh.
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
The National Grid Service Mike Mineter.
EGEE is a project funded by the European Union under contract IST Introduction to Web Services 3 – 4 June
DataGrid is a project funded by the European Commission EDG Conference, Heidelberg, Sep 26 – Oct under contract IST OGSI and GT3 Initial.
GridPP2 Data Management work area J Jensen / RAL GridPP2 Data Management Work Area – Part 2 Mass storage & local storage mgmt J Jensen
OGSA-DAI.
ETICS, EU-OMII and the Software Repository Andrea Caltroni, INFN Padova ETICS 1 st All-Hands Meeting, Budapest - May 29-31, 2006.
Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,
OMII-BPEL Grid Services Orchestration using the Business Process Execution Language (BPEL) Liang Chen Bruno Wassermann Project Inspector: Wolfgang Emmerich.
UK Grid: Moving from Research to Production
Grid Systems: What do we need from web service standards?
Status of Grids for HEP and HENP
Presentation transcript:

The OMII Overview, Product and Roadmap

© University of Southampton omii OMII_1 Delivering a secure, reliable, web services infrastructure for grid applications Easy to use, professionally tested, Accountable

© University of Southampton omii Presentation Contents OMII Overview The Need for the OMII OMII Remit OMII at Southampton OMII Software Product Product Info Product Timetable Customers OMII Roadmap Standards Future Managed Programme Software Repository International involvement

© University of Southampton omii The OMII in a nutshell Open Middleware Infrastructure Institute Established January 2004, initially 3 years with £6.5m Intention - To capitalise on existing e-science investment and produce high-quality, reusable grid middleware Rationale – much e-science invest in “proof of concept” and demonstrators – investigations into technology and approaches OMII should benefit from, re-use, reengineer, existing e-science work where appropriate

© University of Southampton omii The OMII Remit Key Goal is to produce usable and “used” grid middleware and services. Achieved through: OMII “In-house” development Explicit S/W Contracts OMII “managed programme” Success Criteria Number of software downloads Number of deployed systems Key academic and e-science projects use it Industry uptake Sustained through success UK research, JISC and DTI funding Industry support

© University of Southampton omii The OMII at Southampton Located on Southampton University Campus – dedicated, continuous open plan offices Currently 13 F/T staff, recruiting additional 4 to 6 Additional continuous space allocated in December

© University of Southampton omii OMII_1 Product Overview OMII_1 is a secure infrastructure that enables collaboration between users (clients) and providers of resource and applications Target Audience Grid resource users: User requesting services/resources through a command line interface or through application Service providers: Exposes resources or applications to known clients/users Application developers: Web-service developers who want to provide distributed, controlled and secure access to their applications

© University of Southampton omii OMII_1 Product Overview (2) Security X509 Authentication (AAA) with HTTPS message security Authorisation through account based system at service providers (AAA) Accounting (AAA) for resource/service use maintained by service provider and visible to client. Accounting can influence Authorisation Client/Service-provider Interaction Client submits resource request to service provider(s) Service provider(s) respond with a “quote” for job if the resource provider can meet required constraints and client account has sufficient credit Client selects a provider and submits job Client account is debited with estimated resources used for job On job completion client account is updated to actual resources used

© University of Southampton omii OMII_1 Product Components – (1) 4 packages Package 1 - Client download Command line client and Java library to interact with any OMII_1 service provider < 10 minutes to install and interact with servers at OMII Example client application program Supported on Windows and SUSE9 Linux No additional download for Grid “Users”

© University of Southampton omii OMII_1 Product Components – (2) Package 2 - OMII_1 Base and Extensions Server base providing Tomcat, Axis and WS-Security < 10 minutes for complete install Supported on SUSE9 Linux Package 3 - OMII_1 Services Initial basic services (Accounting service, resource Allocation Service, Data movement service, Job Submission service) Installed on Base and Extensions (SUSE9 Linux) Package 4 - OMII_1 Applications Sample application to demonstrate service provision Installed on OMII_1 Services Supported on Windows and SUSE9 Linux Service Providers require Packages 2 and 3 Application developers require all packages

© University of Southampton omii OMII_1 Associated Products OGSA-DAI Condor Interface PBS Interface

© University of Southampton omii OMII_1 Product License All OMII code distributed using BSD license Includes licensed components (Apache license and LGPL)

© University of Southampton omii OMII_1 Release Timetable Private pre- release OMII_1 Public pre- release OMII_1 Official OMII_1 release Developers refresh October 4 th 2004 October 25 th 2004 December 6 th 2004 End Jan 2005 Pre-releases targeted at early adopters to grid enable services Little change from OMII_1 pre-release to official release improved documentation, testing, platform support Developers Refresh Refresh base and services Update WS-Security in line with WS-I Re-factor extensions to base to allow selective install of services

© University of Southampton omii OMII_1 Customers Target E-science projects just starting EPSRC projects in discussion – Integrative Biology, GOLD BBSRC project possibilities – ComparaGRID, GridQTL, e-Fungi, ISPIDER, etc NERC, MRC, etc… Existing E-science projects Follow-on e-science projects MyGrid Nerc DataGrid E-materials project ServerGrid project Astrogrid – already use web services and OGSA-DAI Projects requiring a ready to use grid infrastructure including documentation, training courses, support Industrial Partners Managed programme partners

© University of Southampton omii OMII Roadmap - Position statement Committed to WS-I+ WS-I basic profile (SOAP, WSDL, UDDI) WS-I basic security profile (WS-Security) WS-Addressing, BPEL+, WS-Reliable Messaging/WS-Reliability Plans and timescales to deliver WS-I+ OMII intends to adopt WSRF as and when standardised and stable

© University of Southampton omii OMII Product Roadmap 2005 April 2005: 2 nd OMII Distribution Include WS-Addressing Interoperability with GT4 New services

© University of Southampton omii OMII Service Sets Roadmap In priority order, not delivery order Delivery dependent on managed programme Basic Service Set Job Submit File movement Database Access Authorisation Service Set 1 Workflow Registry Logging Accounting Session Management Service Set 2 Notification Reliable Messaging File management services (provenance, metadata, replica)

© University of Southampton omii Delivering OMII service sets All OMII distributions will contain the basic service set. Basic Service set will be revised & updated between distributions Delivery of service sets 1 and 2 are post April 2005, although some services from service set 1 will be in OMII Distribution 2 Service sets are subject to modification

© University of Southampton omii Managed Programme funding 2/3rds managed programme funding spent Projects funded: OGSA-DAI (Database service) JDML (Job submit service) BPEL (Workflow service) Grimoires (Registry service) FIRMS (Reliable messaging) FINS (Notification) GeodiseLab (Matlab toolbox) WSRF:lite integration Further contracts placed/calls in the next 6 months to address gaps Basic Service Set Service Sets 1 & 2

© University of Southampton omii Managed programme status All projects required to engage 3 test communities and use OMII distribution from outset Work negotiations complete Grid SAM and Geodise started 1 st September All others started in October Official kick-off meeting 21 st October in Southampton Introduction/discussion on OMII distribution and integration of managed programme output Standards, Documentation, OMII security,…

© University of Southampton omii External Contributions to OMII Major source through contracts and managed programme Primarily contributing to essential elements of OMII distributions Managed programme required to liaise with other middleware bodies (e.g., EGEE, Globus) Additional source from repository contributions Primarily end user services from e-science projects Generic service useful to others tested with OMII distribution that are optional to install Talk to OMII – we can help publicise your services and assist where appropriate with input to the repository

© University of Southampton omii International Relationships with other infrastructure providers-NMI Visited Condor group in June – identified 3 phases in collaboration OMII to use same test harness as NMI Link the OMII and NMI testing infrastructures Work with NMI to develop distributed testing framework Status Regular conference calls A non-interactive version of the OMII distribution is being integrated into the NMI build system Demonstration of OMII build in NMI scheduled for SC2004

© University of Southampton omii International Infrastructure Relationships (2) EGEE Specific integration with managed programme projects (Registry, Grid SAM) Further integration and interoperability to be investigated Q Globus Visited Globus June - discussed integration possibilites Security – possible re-use of SAML/PERMIS infrastructure from GT4 – common core with EGEE/GT4 Integration of GRIDFTP (dependent on delegation service) Joint requirements gathering

© University of Southampton omii International Relationships with Standards Organisations (3) GGF Indirect through managed programme – JSDL working group, GRID SAM; SAGA working group, Geodise Lab Requirements gathering presented last GGF EGA Member through core programme – no active communication Oasis member

© University of Southampton omii OMII International Profile We are expected to engage with the community standards, specifications, working with other people who are trying to achieve the same goal. OMII will take the lead on infrastructure integration OMII is working directly with NMI on Testing Globus and EGEE on integration at the level where services can be invoked across infrastructures The OMII success measure = customers