1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: 2011-10-01 Duration:

Slides:



Advertisements
Similar presentations
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
Advertisements

WS-PGRADE: Supporting parameter sweep applications in workflows Péter Kacsuk, Krisztián Karóczkai, Gábor Hermann, Gergely Sipos, and József Kovács MTA.
Extending a molecular docking tool to run simulations on clouds Damjan Temelkovski Dr. Tamas Kiss Dr. Gabor Terstyanszky University of Westminster.
EXTENDING SCIENTIFIC WORKFLOW SYSTEMS TO SUPPORT MAPREDUCE BASED APPLICATIONS IN THE CLOUD Shashank Gugnani Tamas Kiss.
1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS
Developing an Application-Specific Portal with P-GRADE Portal 2.9 Author: Ákos Balaskó, Date :
Workflows Information Flows Prof. Silvia Olabarriaga Dr. Gabriele Pierantoni.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Workflow-Oriented Science Gateway for Astrophysical Visualization Eva.
Connecting Workflow-Oriented Science Gateways to Multi-Cloud Systems Zoltán Farkas, Péter Kacsuk, Ákos Hajnal MTA SZTAKI.
Using the WS-PGRADE Portal in the ProSim Project Protein Molecule Simulation on the Grid Tamas Kiss, Gabor Testyanszky, Noam.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Build and Test Portal SCI-BUS - agINFRA OSD Eva Takacs 4D Soft Kft. Budapest,
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Sharing, integrating and executing different workflows in heterogeneous multi-cloud systems Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
07/06/11 New Features of WS-PGRADE (and gUSE) 2010 Q Q2 Miklós Kozlovszky MTA SZTAKI LPDS.
G. Terstyanszky, T. Kukla, T. Kiss, S. Winter, J.: Centre for Parallel Computing School of Electronics and Computer Science, University of.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Creating the Autodock gateway from WS-PGRADE/gUSE and making it cloud-enabled.
From P-GRADE to SCI-BUS Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy.
Protein Molecule Simulation on the Grid G-USE in ProSim Project Tamas Kiss Joint EGGE and EDGeS Summer School.
1 IDGF International Desktop Grid Federation How can you benefit from joining IDGF? Hannover, Peter Kacsuk, MTA SZTAKI, EDGI.
Parameter Sweep Workflows for Modelling Carbohydrate Recognition ProSim Project Tamas Kiss, Gabor Terstyanszky, Noam Weingarten.
Sharing Workflows through Coarse-Grained Workflow Interoperability : Sharing Workflows through Coarse-Grained Workflow Interoperability G. Terstyanszky,
Introduction to SHIWA Technology Peter Kacsuk MTA SZTAKI and Univ.of Westminster
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported.
STAR net, Resources and VOs C. Vuerli, A. Costa, U. Becciani, P. Massimino, G. Castelli.
Introduction to WS-PGRADE and gUSE Tutorial Akos Balasko 04/17/
WS-PGRADE portal and its usage in the CancerGrid project M. Kozlovszky, P. Kacsuk Computer and Automation Research Institute of the Hungarian Academy of.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
AgINFRA science gateway for workflows and integrated services 07/02/2012 Robert Lovas MTA SZTAKI.
How to Read gUSE Documents Orange Docs Series for General Pruposes RELEASE ISSUE POLICY LICENSE HOW TO READ GUSE DOCUMENTS GUSE IN A NUTSHELL by Tibor.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
1 IDGF International Desktop Grid Federation How can you benefit from joining IDGF? Lyon, Peter Kacsuk, MTA SZTAKI, EDGI is.
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
Scientific Gateway for Academic Grid Malaysia Group Name: ZenFone Munirah binti Kassim Ana Farhanah binti Omar Siti Syahirah binti.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
A Catch-All Science Gateway Portal for Malaysia Research Communities The International Workshop on Science Gateways 2013, 3-5 June 2013 Elizabeth Pek Iee.
11 Introduction to EDGI Peter Kacsuk, MTA SZTAKI Start date: Duration: 27 months EDGI.
Building an European Research Community through Interoperable Workflows and Data ER-flow project Gabor Terstyanszky, University of Westminster, UK EGI.
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
1 WS-PGRADE/gUSE generic DCI gateway framework for EGI user communities Zoltan Farkas and Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
Introduction to the program of the summer school Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
OpenNebula: Experience at SZTAKI Peter Kacsuk, Sandor Acs, Mark Gergely, Jozsef Kovacs MTA SZTAKI EGI CF Helsinki.
WS-PGRADE/gUSE in use Advance use of WS- PGRADE/gUSE gateway framework Zoltán Farkas and Peter Kacsuk MTA SZTAKI LPDS.
Introduction to SHIWA project EGI User Forum, Vilnius Peter Kacsuk MTA SZTAKI
Cloud-enabled, scalable Data Avenue service to process very large, heterogeneus data Péter Kacsuk, Ákos Hajnal MTA SZTAKI Francesco Tusa, Junaid Arshad.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
Usage of WS-PGRADE and gUSE in European and national projects Peter Kacsuk 03/27/
1 Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF-SP International Desktop Grid Federation - Support Project SZTAKI.
New developments of gUSE & WS-PGRADE to support e-science gateways Peter Kacsuk and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI SCI-BUS and the CloudBroker Platform: Extending Science Gateways to Clouds.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
Converting P-GRADE Grid Portal into E-Science Gateways A. Balasko, M. Kozlovszky, K. Varga, A. Schnautigel, K. Karóckai, I. Márton, T. Strodl, P. Kacsuk.
Convert generic gUSE Portal into a science gateway Akos Balasko.
Convert generic gUSE Portal into a science gateway Akos Balasko.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk MTA SZTAKI Start date:
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Quality assurance in SCI-BUS project by applying agile testing practices.
A. Costa, P. Massimino, C. Vuerli, U. Becciani INAF CTA Gateway Prototype Based on gUSE/WS-PGRADE and Single-Sign-On (SSO)
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
1 SCI-BUS gateway technology for a large variety of user communities Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities.
Peter Kacsuk, Zoltan Farkas MTA SZTAKI
WS-PGRADE for Molecular Sciences and XSEDE
Peter Kacsuk MTA SZTAKI
University of Westminster Centre for Parallel Computing
Presentation transcript:

1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI

2 How to build a science gateway? 1.Build from scratch –If the gateway is not extremely simple, it requires long time to develop a robust gateway –Requires substantial manpower and development cost –It is very specialized and as users start to use it and come up with new requirements it is difficult to extend in a scalable way –Isolated development without belonging to an open source community => sustainability is difficult

3 How to build a science gateway? 2. Adapt and customize an existing gateway technology –Significantly reduces development time (e.g. Yuri Gordienko’s talk) –Requires limited manpower and development cost –Produces a robust and usable service –The open source community is driving force for further development and extensions SCI-BUS provides the required core gateway and customization technology

Who are the members of an e-science community regarding Option 2? End-users (e-scientists) ( ) Execute the published WF applications with custom input parameters by creating application instances using the published WF applications as templates WF (Application) Developers ( ) Develop WF applications Publish the completed WF applications for end-users SHIWA project SG Instance Developers (50-100) Develop application domain specific SG instance SCI-BUS project Science Gateway (SG) Framework Developers (5-10) Develop generic SG framework SCI-BUS project

Flexible usage scenarios/business models by WS-PGRADE/gUSE Workflow developer view and support (full gateway framework view) End-user view and support (limited portlets) Customized user interface to support the creation of domain specific gateways (ASM API) Provide workflow execution service on top of many different DCIs (Remote API) 5

Typical usage scenarios of WS- PGRADE/gUSE 6 ASM API WS-PGRADE UI Customized UI Other, existing UI Workflow execution service from existing portal (e.g. VisIVO mobile)

Gateway types based on WS-PGRADE/gUSE For developing workflow (WF) applications for a large set of various DCIs Developed WF Internal gUSE Repository End User mode WS- PGRADE/gUSE gateway generated by configuration Customized gUSE gateway with portlets developed by ASM API Generic WS-PGRADE/gUSE gateway Existing Community Gateway WF execution gUSE gateway Remote API

8 The use case: Molecular docking simulations Random blind docking: Uses AutoDock 4 1 receptor and 1 ligand file (pdb or pdbqt) Virtual screening: Uses AutoDock Vina 1 receptor file a library of ligands AutoDock: –a suite of automated docking tools –designed to predict how small molecules, such as substrates or drug candidates, bind to a receptor of known 3D structure –open source software, around 30,000 users worldwide –two distinct AutoDock versions: –Autodock 4: slower, more complex, more precise (?) –AutoDock Vina: newer, faster, less proven results

Autodock gateway operated by SZTAKI

Autodock and rendering gateway operated by Univ. of Westminster

Scenario 1: Generic gUSE framework as gateway For developing workflow (WF) applications for a large set of various DCIs Place developed WF for own usage Internal gUSE Repository Generic WS-PGRADE/gUSE gateway Examples: SZTAKI Public portal Greek NGI portal Turkish NGI portal

Scenario 1: Generic gUSE framework as gateway What is required from the user (WF developer)? Design and configure WF Execute and monitor WF Export WF to repo What needs to be done by the gateway/application provider (system administrator)? Deploy gateway out of box

Scenario 1/b: Generic gUSE framework with end-user support For developing workflow (WF) applications for a large set of various DCIs WF developer: Places developed WF for end-users’ usage Internal gUSE Repository Generic WS-PGRADE/gUSE gateway

For developing workflow (WF) applications for a large set of various DCIs End user: Takes developed WF for own usage Internal gUSE Repository Generic WS-PGRADE/gUSE gateway Scenario 1/b: Generic gUSE framework with end-user support

What is required from the end-user? Import workflow from repository Customise, execute and monitor workflow Scenario 1/b: Generic gUSE framework with end-user support What needs to be done by the gateway/application provider (system administrator + workflow developer)? Deploy gateway out of box Develop and configure workflows Export workflows to repository

Scenario 2: End-user view based gateway For developing workflow (WF) applications for a large set of various DCIs WF developer: Places developed WF as template for end-users’ usage Internal gUSE Repository End User mode WS- PGRADE/gUSE gateway generated by configuration Generic WS-PGRADE/gUSE gateway End user: Take developed WF template and parameterize it for own run

Scenario 2: End-user view based gateway What is required from the end-user? Import workflow from repository Customise, execute and monitor application using simple web forms What needs to be done by the gateway/application provider (system administrator + workflow developer)? Deploy gateway out of box Develop and configure workflows Create templates and applications Export application to repository

Scenario 3: Completely customised gateway For developing workflow (WF) applications for a large set of various DCIs Developed WF Internal gUSE Repository Customized gUSE gateway with portlets developed by ASM API Generic WS-PGRADE/gUSE gateway Examples: Swiss Proteomics Portal MosGrid Portal VisIVO gateway, etc.

Scenario 3: Completely customised gateway What is required from the end-user? Execute and monitor application using completely customised GUI What needs to be done by the gateway/application provider (system administrator + workflow developer + SG instance developer)? Deploy gateway out of box Develop and configure workflows Export workflows to repository Develop custom GUI using the Application Specific Module (ASM) API accessing gUSE services

Swiss Proteomics Portal (ETH Zurich) 20

Scenario 4: Use own gateway with a gUSE gateway for WF developing and execution 21 For developing workflow (WF) applications for a large set of various DCIs Developed WF Internal gUSE Repository Existing Community Gateway Generic WS-PGRADE/gUSE gateway WF execution gUSE gateway Remote API Possible options: 1.These two gateways can be the same 2.The WF developer gateway could be the SZTAKI gateway, the execution gateway the community’s gateway

Scenario 4: Use own gateway with a gUSE gateway for WF developing and execution See the AEGIS CMPC Scientific Gateway poster as an example Further examples: –4D Soft portal –e-Group portal –VisIVO Mobile 22

VisIVO Mobile Architecture

Scenario 4: Using DCI Bridge as independent service 24 ASM API Own existing UI

Conclusions There is a rich set of options on how to use WS-pGRADE/gUSE technology Think over how you would like to support your community and choose the most suitable option 25