Peter Kacsuk, Zoltan Farkas MTA SZTAKI

Slides:



Advertisements
Similar presentations
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
Advertisements

SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI Science Gateways for improving the uptake of Grid and Cloud Computing.
EDGI is supported by the FP7 Capacities Programme under contract nr RI End-User view of the AutoDock Portal Zoltán Farkas, MTA SZTAKI
WS-PGRADE: Supporting parameter sweep applications in workflows Péter Kacsuk, Krisztián Karóczkai, Gábor Hermann, Gergely Sipos, and József Kovács MTA.
Extending a molecular docking tool to run simulations on clouds Damjan Temelkovski Dr. Tamas Kiss Dr. Gabor Terstyanszky University of Westminster.
EXTENDING SCIENTIFIC WORKFLOW SYSTEMS TO SUPPORT MAPREDUCE BASED APPLICATIONS IN THE CLOUD Shashank Gugnani Tamas Kiss.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Connecting Workflow-Oriented Science Gateways to Multi-Cloud Systems Zoltán Farkas, Péter Kacsuk, Ákos Hajnal MTA SZTAKI.
Using the WS-PGRADE Portal in the ProSim Project Protein Molecule Simulation on the Grid Tamas Kiss, Gabor Testyanszky, Noam.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Build and Test Portal SCI-BUS - agINFRA OSD Eva Takacs 4D Soft Kft. Budapest,
1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: Duration:
07/06/11 New Features of WS-PGRADE (and gUSE) 2010 Q Q2 Miklós Kozlovszky MTA SZTAKI LPDS.
G. Terstyanszky, T. Kukla, T. Kiss, S. Winter, J.: Centre for Parallel Computing School of Electronics and Computer Science, University of.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Creating the Autodock gateway from WS-PGRADE/gUSE and making it cloud-enabled.
From P-GRADE to SCI-BUS Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy.
Protein Molecule Simulation on the Grid G-USE in ProSim Project Tamas Kiss Joint EGGE and EDGeS Summer School.
1 IDGF International Desktop Grid Federation How can you benefit from joining IDGF? Hannover, Peter Kacsuk, MTA SZTAKI, EDGI.
Parameter Sweep Workflows for Modelling Carbohydrate Recognition ProSim Project Tamas Kiss, Gabor Terstyanszky, Noam Weingarten.
Sharing Workflows through Coarse-Grained Workflow Interoperability : Sharing Workflows through Coarse-Grained Workflow Interoperability G. Terstyanszky,
Introduction to SHIWA Technology Peter Kacsuk MTA SZTAKI and Univ.of Westminster
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported.
Introduction to WS-PGRADE and gUSE Tutorial Akos Balasko 04/17/
WS-PGRADE portal and its usage in the CancerGrid project M. Kozlovszky, P. Kacsuk Computer and Automation Research Institute of the Hungarian Academy of.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support in EGEE Gergely Sipos MTA SZTAKI EGEE’08.
1 IDGF International Desktop Grid Federation How can you benefit from joining IDGF? Lyon, Peter Kacsuk, MTA SZTAKI, EDGI is.
A scalable and flexible platform to run various types of resource intensive applications on clouds ISWG June 2015 Budapest, Hungary Tamas Kiss,
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
Scientific Gateway for Academic Grid Malaysia Group Name: ZenFone Munirah binti Kassim Ana Farhanah binti Omar Siti Syahirah binti.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
11 Introduction to EDGI Peter Kacsuk, MTA SZTAKI Start date: Duration: 27 months EDGI.
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
1 WS-PGRADE/gUSE generic DCI gateway framework for EGI user communities Zoltan Farkas and Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
Introduction to the program of the summer school Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
WS-PGRADE/gUSE in use Advance use of WS- PGRADE/gUSE gateway framework Zoltán Farkas and Peter Kacsuk MTA SZTAKI LPDS.
Supporting Big Data Processing via Science Gateways EGI CF 2015, November, Bari, Italy Dr Tamas Kiss, CloudSME Project Director University of Westminster,
Usage of WS-PGRADE and gUSE in European and national projects Peter Kacsuk 03/27/
1 Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF-SP International Desktop Grid Federation - Support Project SZTAKI.
New developments of gUSE & WS-PGRADE to support e-science gateways Peter Kacsuk and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI SCI-BUS and the CloudBroker Platform: Extending Science Gateways to Clouds.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
Convert generic gUSE Portal into a science gateway Akos Balasko.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk MTA SZTAKI Start date:
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Quality assurance in SCI-BUS project by applying agile testing practices.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Improving the Swiss Grid Proteomics Portal Peter Kunszt, Lorenz Blum,
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
Building an European Research Community through Interoperable Workflow and Data Gabor Terstyanszky University of Westminster.
1 SCI-BUS gateway technology for a large variety of user communities Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities.
SHIWA SIMULATION PLATFORM = SSP Gabor Terstyanszky, University of Westminster e-Science Workflows Workshop Budapest 09 nd February 2012 SHIWA is supported.
Progress Apama Fundamentals
Flowbster: Dynamic creation of data pipelines in clouds
Data Bridge Solving diverse data access in scientific applications
WS-PGRADE for Molecular Sciences and XSEDE
Peter Kacsuk MTA SZTAKI
P-GRADE and GEMLCA.
Grid Portal Services IeSE (the Integrated e-Science Environment)
Recap: introduction to e-science
Lightweight introduction
Lightweight introduction
a Collaborative Environment for the Astrophysics Community
University of Westminster Centre for Parallel Computing
Introduction to the SHIWA Simulation Platform EGI User Forum,
Workflow level parametric study support by the P-GRADE portal
Contract Management Software 100% Cloud-Based ContraxAware provides you with a deep set of easy to use contract management features.
Presentation transcript:

Peter Kacsuk, Zoltan Farkas MTA SZTAKI Developing Customised Science Gateways at Various Levels of Granularity Tamas Kiss, Attila Sasvari, Peter Borsody, Gabor Terstyanszly University of Westminster Peter Kacsuk, Zoltan Farkas MTA SZTAKI International Workshop on Science Gateways 4th June 2013 Zurich, Switzerland SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481

How to build a science gateway? Option 1: Build from scratch Unless the gateway is extremely simple, it requires long time, substantial manpower and development cost to develop a robust gateway It is probably highly specialized and it may be difficult to extend in a scalable way It typically represents an isolated development without belonging to a larger (open source) community

How to build a science gateway? Option 2: Adapt and customize an existing gateway framework Significantly reduces development time Requires limited manpower and development cost Produces a robust and usable service The open source community is driving force for further development and extensions

Who are the members of an e-science community regarding Option 2? Science Gateway (SG) Framework Developers (5-10) Develop generic SG framework SCI-BUS project SG Instance Developers (50-100) Develop application domain specific SG instance SCI-BUS project WF (Application) Developers (500-1.000) Develop WF applications Publish the completed WF applications for end-users SHIWA project End-users (e-scientists) (50.000-1.000.000) Execute the published WF applications with custom input parameters by creating application instances using the published WF applications as templates 4

WS-PGRADE/gUSE Generic-purpose gateway framework Based on Liferay General purpose Workflow-oriented portal framework Supports the development and execution of workflow-based applications Enables the multi-cloud and multi-DCI execution of any WF Supports the fast development of SG instances by a customization technology Provides access to application/workflow repositories internal repository external SHIWA Repository

gUSE – grid User Support Environment Scalable architecture based on collaborating services

Molecular docking simulations The user scenario Molecular docking simulations AutoDock: a suite of automated docking tools designed to predict how small molecules, such as substrates or drug candidates, bind to a receptor of known 3D structure open source software, around 30,000 users worldwide two distinct AutoDock versions: Autodock 4: slower, more complex, more precise (?) AutoDock Vina: newer, faster, less proven results Random blind docking: Uses AutoDock 4 1 receptor and 1 ligand file (pdb or pdbqt) grid and docking parameter files number of iterations number of lowest energy results Virtual screening: Uses AutoDock Vina 1 receptor file a library of ligands grid and docking parameter files number of work units (granularity) number of lowest energy results

Granularity 1: Deploy the generic gUse framework for end-users What is required from the end-user? Design and configure workflow Execute and monitor workflow What needs to be done by the gateway/application provider (system administrator)? Deploy gateway out of box

Granularity 2: Pre-create workflows for end-users What is required from the end-user? Import workflow from repository Customise, execute and monitor workflow What needs to be done by the gateway/application provider (system administrator + workflow developer)? Deploy gateway out of box Develop and configure workflows Export workflows to repository

Granularity 3: The end user view What is required from the end-user? Import workflow from repository Customise, execute and monitor application using simple web forms What needs to be done by the gateway/application provider (system administrator + workflow developer)? Deploy gateway out of box Develop and configure workflows Create templates and applications Export application to repository

Granularity 4: Completely customised gateway What is required from the end-user? Customise, execute and monitor application using completely customised GUI What needs to be done by the gateway/application provider (system administrator + workflow developer + SG instance developer)? Deploy gateway out of box Develop and configure workflows Export workflows to repository Develop custom GUI using the Application Specific Module (ASM) API accessing gUSE services

Any questions? Conclusions? Sorry, but time is far too short for that (but happy to discuss after the presentation). Any questions?