1 P-GRADE Portal tutorial at EGEE’09 Introduction to hands-on Gergely Sipos MTA SZTAKI EGEE.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Introduction to EGEE hands-on Gergely Sipos.
Advertisements

1 P-GRADE Portal and GEMLCA Legacy Code Architecture Peter Kacsuk MTA SZTAKI
12th EELA Tutorial, Lima, FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America.
LPDS MTA SZTAKI Equation Solver A Grid solution Important hint: A follow up example demonstrating the Parameter Study solution for the mass calculations.
P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann MTA SZTAKI.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
1 MTA SZTAKI Application development on EGEE with P-GRADE Portal Gergely Sipos
EGEE-II INFSO-RI Enabling Grids for E-sciencE Grid application development with gLite and P-GRADE Portal Miklos Kozlovszky MTA SZTAKI.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI
Grid Execution Management for Legacy Code Applications Exposing Application as Grid Services Porto, Portugal, 23 January 2007.
1 MTA SZTAKI Hungarian Academy of Sciences Grid application support by the P-GRADE Portal Peter Kacsuk.
1 P-GRADE Portal and GEMLCA: A workflow-oriented portal and application hosting environment Miklos Kozlovszky.
1 portal.p-grade.hu További lehetőségek a P-GRADE Portállal Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
1 P-GRADE Portal: Towards a User-friendly Grid Environment Tamas Kiss Centre for Parallel Computing.
1 portal.p-grade.hu Further information on P-GRADE Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
Enabling Grids for E-sciencE EGEE-II INFSO-RI BG induction to GRID Computing and EGEE project – Sofia, 2006 Practical: Porting applications.
Example Gridification via command-line Application Developer Training Day IV. Miklos Kozlovszky Ankara, 25. October, 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Grid application development with gLite and P-GRADE Portal Miklos Kozlovszky MTA SZTAKI.
1 Next steps with EGEE and P-GRADE Portal Gergely Sipos MTA SZTAKI EGEE Training and Induction.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
Parameter Study (PS) Principles & Practices Note This document uses as starting example the non PS case discussed in document EquationSolver.ppt If you.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives Plovdiv, 2006.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Introduction to GILDA and gaining access.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE Gergely Sipos
1 P-GRADE Portal tutorial MTA SZTAKI Gergely Sipos
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support in EGEE Gergely Sipos MTA SZTAKI EGEE’08.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
1 P-GRADE Portal: a workflow-oriented generic application development portal Peter Kacsuk MTA SZTAKI, Hungary Univ. of Westminster, UK.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
1 P-GRADE Portal: An easy to use graphical interface for Globus and EGEE Grids.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
1 Practical information for the GEMLCA / P-GRADE hands-on Gergely Sipos On behalf of: MTA.
1 P-GRADE Portal tutorial at EGEE'09 Gergely Sipos MTA SZTAKI EGEE Training and Induction.
1 Practical information for the GEMLCA / P-GRADE hands-on Tamas Kiss University of Westminster.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to P-GRADE Portal hands-on Miklos Kozlovszky MTA SZTAKI
1 portal.p-grade.hu Workflow and parameter study management by P-GRADE Portal Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
EGEE-II INFSO-RI Enabling Grids for E-sciencE P-GRADE overview and introduction: workflows & parameter sweeps (Advanced features)
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
1 Other features and next steps Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
1 Support for Parameter Study applications in the P-GRADE Portal Cevat Şener Dept. Of Computer Engineering, METU.
1 Egrid portal Stefano Cozzini and Angelo Leto. 2 Egrid portal Based on P-GRADE Portal 2.3 –LCG-2 middleware support: broker, CEs, SEs, BDII –MyProxy.
1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
07/02/2012 WS-PGRADE/gUSE in use Lightweight introduction Zoltán Farkas MTA SZTAKI LPDS.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
1 P-GRADE Portal and Developer Alliance Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences portal.p-grade.hu.
1 Support for parameter study applications in the P-GRADE Portal Gergely Sipos MTA SZTAKI (Hungarian Academy of Sciences)
EGEE-III INFSO-RI Enabling Grids for E-sciencE Latest results of the Grid Application Support Centre at MTA SZTAKI Gergely Sipos.
Centre for Parallel Computing Tamas Kiss Centre for Parallel Computing A Distributed Rendering Service Tamas Kiss Centre for Parallel Computing Research.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Application specific portlet other portal features and next steps Miklos Kozlovszky.
FESR Trinacria Grid Virtual Laboratory Practical using WMProxy advanced job submission Emidio Giorgio INFN Catania.
Tamas Kiss University Of Westminster
Security and getting access to the training infrastructure
P-GRADE Portal tutorial
Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, Created by Akos Balasko
Grid2Win: Porting of gLite middleware to Windows XP platform
Introduction to P-GRADE Portal hands-on
Lightweight introduction
Lightweight introduction
Application development on EGEE with P-GRADE Portal
The GENIUS portal and the GILDA t-Infrastructure
GENIUS Grid portal Hands on
Introduction to the SHIWA Simulation Platform EGI User Forum,
Workflow level parametric study support by the P-GRADE portal
Presentation transcript:

1 P-GRADE Portal tutorial at EGEE’09 Introduction to hands-on Gergely Sipos MTA SZTAKI EGEE Training and Induction EGEE Application Porting Support

2 P-GRADE Portal (SZTAKI, Budapest) based on v2. 8 Infrastructure Client machines Proxy download GILDA Grid services GILDA MyProxy server gLite Proxy MyProxy name: **************** MyProxy password: **************** portal.p-grade.hu/multi-grid

3 Exercise 1 Import and execute a pre-defined application Traffic simulation Generates the road network map of Manchester Put traffic lights and cars on the map. Simulate road traffic. Compares and visualizes the density of cars

4 Exercise 1 Import and execute a pre-defined application Traffic simulation Generates the road network map of Manchester Put traffic lights and cars on the map. Simulate road traffic. Compares and visualizes the density of cars x.jpg

5 Exercise 2 Create a matrix multiplication workflow (one job workflow) Job executable: C code, compiled on GILDA UI Command line parameters: M V C code knows nothing about the grid Job input/output files: Program reads matrixes from two files called INPUT1 and INPUT2 Program writes result matrix into file called OUTPUT Local execution on a PC:./multiply M V Exercise: Execute the program on GILDA, transfer input and output files in Sandboxes binary INPUT INPUT OUTPUT

6 gLite Storage Element Exercise 3 Save the multiplication OUTPUT on a Storage Element and register in the File Catalog Modify output file type from “Local” to “Remote” Specify a logical file name as target location: lfn:/grid/gilda/tutorials/barcelonaXX Binary executable INPUT INPUT OUTPUT Storage Element is selected automatically by gLite middleware lfn:/grid/gilda/tutorials/barcelonaXX/… Logical file name is defined by you gLite File Catalog Browse result file using the File Manager Portlet

7 Exercise 4 Combine jobs to build a MatrixOperations workflow AB[*, 0] T * AB[*, 1] Matrix AMatrix B A * B A * B [ *, 0 ]A * B [ *, 1 ] ( A * B [ *, 0 ] T ) * ( A * B [ *, 1 ] ) A * B [ *, 0 ] T

8 Exercise 5 Matrix multiplication PS parameter study workflow with 5 parameters Multiplication job Matrix

9 Portal accounts: ***************** Portal passwords: ***************** Proxy upload & download information: Hostname: myproxy.ct.infn.it Port: 7512 Account: ****************** Password: ****************** Login: No need to wait for jobs to finish – proceed to next exercise

10 Parameter study talk

11 Multiplication job Auto generator Input files stored on SEs and registered in LFC catalog Y 9 <= Y <=36, step Matrix2 Output files stored on SEs and registered in LFC catalog... Exercise 5 Matrix multiplication PS parameter study workflow with 5 parameters

12 Job level fault tolerance Tips Exclude erroneous sites from the brokering process: 1.Open the JDL editor of the job 2.Write other.GlueCEInfoHostname != “hostname” into the “Ranks & requirements” window Automatic job resubmission: 1.Add ShallowRetryCount = 3 into JDL

13 User authentication MyProxy server P-GRADE Portal server GILDA services Proxy VOMS server Proxy VOMS ext. Proxy VOMS ext. issgc58 GridISS58 userXX Proxy based authentication Login & psw based authentication Tutor already generated and uploaded a proxy