Introduction to WS-PGRADE and gUSE Tutorial Akos Balasko 04/17/2012 1

2 P-GRADE Portal software family P-GRADE Portal 2.4 NGS P-GRADE portal P-GRADE Portal 2.5 P-GRADE Portal 2.8 P-GRADE Portal WS-PGRADE Portal 3.1 WS-PGRADE Portal 3.2 GEMLCA Grid Legacy Code Arch. GEMLCA, storage concepts Basic concepts WS-PGRADE Portal 3.3 P-GRADE Portal 2.10 Open source from 2008 stats: 2011

Recent and planned WS-PGRADE releases Nov 2012: v3.4 with DCI Bridge Feb 2012: v3.4.1 with usage statistics portlet March 2012: v3.4.2 with support for new EMI release March 2012: v3.4.3 with support for Liferay 6.1 April 2012: v3.4.4 with SHIWA repository support May 2012: v3.4.5 with support for CloudBroker SaaS

4 P-GRADE Portals around the globe National Grid portals (UK, Ireland, Croatia, Turkey, Spain, Belgium, Malaysia, Kazakhstan, Switzerland, Australia, ClGrid, etc.) HP-SEE/SEE-GRID-SCI, BalticGrid US Open Science Grid, TeraGrid IDGF (International Desktop Grid Federation) SHIWA Simulation Platform Economy-Grid, Swiss BioGrid, Bio és Biomed Virtual Organisations, MathGrid, etc. HP-SEE

5 Motivations of creating gUSE To overcome (most of) the limitations of P-GRADE portal: To provide better modularity  to replace any service To improve scalability  to millions of jobs To enable advanced dataflow patterns To interface with wider range of resources To separate Application Developer view from Application User view WS-PGRADE (Web Services Parallel Grid Runtime and Developer Environment) and gUSE (Grid User Support Environment) architecture

6 gUSE and WS-PGRADE architecture (v3.3.x) Graphical User Interface: WS-PGRADE Workflow Engine Workflow storage File storage Application repository Logging gUSE information system Submitters Gridsphere  LIFERAY Large set of portlets Autonomous Services: high level middleware service layer Resources: middleware service layer Local resources, service grid VOs, Desktop Grid resources, Web services, Databases gUSE Meta-broker Submitters File storage Submitters

gUSE and WS-PGRADE architecture (v3.4.x)

WF Graph editor WEB-UI (HTML) Liferay WS- PGRADE portal Liferay WS- PGRADE portal Information System WF Storage File Storage Application Repository WF Interpreter Backend local submitter GT4 submitter Glite submitter ARC submitter Unicore submitter GMLCA submitter WS (Axis) submitter Glite Grid GMLCA Grid GT2 Grid Unicore Grid GT4 Grid LCG Grid ARC Grid WS DCI-Bridge Client machine Portal Server machine DCIs BES interface

9 WS-PGRADE/gUSE main features Creating complex workflow and parameter sweeps Seamless access to various types of resources clusters, service grids, desktop grids, databases. Scalable architecture Advanced data-flows and workflow concept Creating complex applications using embedded workflows, legacy codes Comfort features Separated views for application developers and end-users Community components from workflow repository

10 WS-PGRADE in a nutshell General purpose, workflow-oriented portal. Supports the development and execution of workflow-based applications Based on Liferay Services supported by the portal: New functionalities Web services DB connectors Embedded workflows Job level PS Conditional jobs Multi-generator Multi-collector CROSS product PS DOT product PS Simultaneous use of various clusters, service and desktop Grids at workflow level Basic ServicesEGEE grids (LCG2,GLite) Globus grids (GT2,GT4) Desktop grids clusters Job execution File storage Certificate management Information system Brokering Job monitoring Workflow & job visualization

11 How to build a science gateway? There are two basic options: 1.Build from scratch Long time to produce a robust gateway Requires substantial manpower and development cost 2.Adapt and customize an existing gateway technology Significantly reduces development time Produces a robust and usable service WS-PGRADE/gUSE provides the required core gateway and customization technology

12 Main objectives of this tutorial 1.To show how to use the WS-PGRADE portal to develop and run DCI applications 2.To show how to run workflow applications on various DCIs in a seamless way 3.To show how to use the WS-PGRADE/gUSE framework as a generic-purpose gateway technology 4.To show how to create an application-specific gateway based on the WS-PGRADE/gUSE framework

13 Thank you for your attention! Questions? Special thanks to Peter Kacsuk (MTA SZTAKI) for the slides