EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks S. Natarajan (CSU) C. Martín (UCM) J.L. Vázquez-Poletti (UCM) A. Lorca (UCM) EGEE'09 Conference (Barcelona) September 2009 Google Summer of Code Projects may help you with Fusion Physics Applications on Grid

Enabling Grids for E-sciencE EGEE-III INFSO-RI Why Fusion on Grid? Fusion –Clean –Alternative method for large scale energy production –No CO 2 – No Global Warming –No long lived radioactive waste –Fuels required are found in abundance –No chain reactions – No “metdown” - Inherently safe Grid Computing (EGEE) –Access to a great amount of computing resources –More simulations in less time  Increase effectiveness of real experiments  But… How to port/use an application efficiently?

Enabling Grids for E-sciencE EGEE-III INFSO-RI What all of this is about? Our Experience –Grid Metascheduler  GridWay: –Fusion applications Our “2 cents” today –Google Summer of Code Projects

Enabling Grids for E-sciencE EGEE-III INFSO-RI Execution Manager Transfer Manager Information Manager Dispatch Manager Request Manager Scheduler Job PoolHost Pool DRMAA libraryCLI GridWay Core Grid File Transfer Services Grid Execution Services GridFTPRFT pre-WS GRAM WS GRAM Grid Information Services MDS2 GLUE MDS4 Resource Discovery Resource Monitoring Resource Discovery Resource Monitoring Job Preparation Job Termination Job Migration Job Preparation Job Termination Job Migration Job Submission Job Monitoring Job Control Job Migration Job Submission Job Monitoring Job Control Job Migration GridWay in a Glance GridWay Internals

Enabling Grids for E-sciencE EGEE-III INFSO-RI SGE Cluster Users PBS Cluster gLite GridWay gLite Services: BDII, GRAM, GridFTP EGEE Resource Broker GridWay Users Fusion EGEE RB Massive Ray Tracing GridWay in a Glance GridWay is being used on EGEE for… CD-HIT workflow Biomed Pheno Users GridWay AITALC code Bhabha

Enabling Grids for E-sciencE EGEE-III INFSO-RI Application: MaRaTra Massive Ray Tracing in Fusion Plasmas Executable: Truba (traces 1 ray of the microwave bunch)‏ –1.8 MB – 9' (Pentium Ghz)‏ Input files =~ 70 KB Output files =~ 549 KB

Enabling Grids for E-sciencE EGEE-III INFSO-RI Application: VASHRA-T gLite GT4 gLite Local Machine –SGI ALTIX 3700 – CPUs 64 bits –LSF Local Communications –scp and ssh –User ssh keys exported Grid machine –Globus Toolkit 4 –Globus GridWay –Access to 30 sites

Enabling Grids for E-sciencE EGEE-III INFSO-RI Google Summer of Code Project #1 GridWay Graphical User Interface

Enabling Grids for E-sciencE EGEE-III INFSO-RI About Google Summer of Code 4th Edition – Three-month projects to develop and learn free open source code 1,000 Students around the world – 150 mentoring organizations 2 accepted projects within the Globus Alliance

Enabling Grids for E-sciencE EGEE-III INFSO-RI About the Developer Srinivasan Natarajan Graduate Student, Computer Science California State University Sacramento (USA)

Enabling Grids for E-sciencE EGEE-III INFSO-RI The Idea behind the GridWay GUI  To help users  compose, manage and control their jobs  not using command line interface.  Enables  host and user monitoring  filtering account statistics and execution history information  Supports DAGMAN workflow  compose the DAG file  visualize dependencies between the jobs  pass the DAG file to GridWay

Enabling Grids for E-sciencE EGEE-III INFSO-RI JT Generator

Enabling Grids for E-sciencE EGEE-III INFSO-RI JT Generator

Enabling Grids for E-sciencE EGEE-III INFSO-RI Job Submission

Enabling Grids for E-sciencE EGEE-III INFSO-RI Job State Information

Enabling Grids for E-sciencE EGEE-III INFSO-RI Job State Information

Enabling Grids for E-sciencE EGEE-III INFSO-RI Job Signalling

Enabling Grids for E-sciencE EGEE-III INFSO-RI User Information

Enabling Grids for E-sciencE EGEE-III INFSO-RI Account Details based on Date Filter

Enabling Grids for E-sciencE EGEE-III INFSO-RI Account Details based on Username

Enabling Grids for E-sciencE EGEE-III INFSO-RI Host matching Job Requirements

Enabling Grids for E-sciencE EGEE-III INFSO-RI Host and Queue Information

Enabling Grids for E-sciencE EGEE-III INFSO-RI History Information

Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow Composition

Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow Composition

Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow Composition

Enabling Grids for E-sciencE EGEE-III INFSO-RI Google Summer of Code Project #2 Google Maps + GridWay

Enabling Grids for E-sciencE EGEE-III INFSO-RI About the Developer Carlos Martín Sánchez Graduate Student, Computer Science Universidad Complutense de Madrid (UCM), Spain

Enabling Grids for E-sciencE EGEE-III INFSO-RI Idea behind the GridWay GMaps  To help users, administrators, project leaders  Control of hosts, jobs and users from a given instance  Not using command line interface  Fast check of experiment status  Enables Geolocalization  Host, job and user monitoring  Filtering account statistics and execution history information  Real time (update minutely)  Provides a snapshot of the grid-health  Different icons depending on % of free slots  Understand geopolitical issues, limitations  Identify problematic resources

Enabling Grids for E-sciencE EGEE-III INFSO-RI Hosts Tab

Enabling Grids for E-sciencE EGEE-III INFSO-RI Jobs Tab

Enabling Grids for E-sciencE EGEE-III INFSO-RI VO-filtering and queue check

Enabling Grids for E-sciencE EGEE-III INFSO-RI Conclusions Fusion Physics is attracting much interest from Grid Application Porting Community Initial Grid solutions become mature and general Next generations –Become attracted by Fusion Physics –Improve existing solutions Fusion Physics Community benefits from new solutions

Enabling Grids for E-sciencE EGEE-III INFSO-RI ¡Muchísimas Gracias! Questions?