The EDGeS project receives Community research funding 1 The EDGeS project: Enabling Desktop Grids for e-Science P. Kacsuk MTA SZTAKI

2 The problem we address We have service grids (SG):We have service grids (SG): –Guaranteed service based on clusters but –Relatively small number of processors (1K -50K) –Many users but misuse the resources Most of the applications are parameter sweep applications that better fit to desktop grids Take away the cluster resources from MPI type applications We have desktop (volunteer) grids (DG):We have desktop (volunteer) grids (DG): –No guaranteed service but –Large number of processors (100K – 1M) –Few users: 1-3 projects per desktop grid

3 EDGeS: A 2-year long FP7 project started on the 1st January 2008 Main goals of the project: To integrate Service Grids (EGEE) and Desktop Grids (BOINC and XtremWeb) to attract new scientific communities that needs very large number of computing resources (100K-1M processors) To enable the seamless usage of the integrated SG-DG infrastructure, i.e. the user does not need to be aware if the application is executed in SG or DG To provide a Grid application development environment What is EDGeS? Enabling Desktop Grids for e-Science

4 Project partners Partic. No.Participant nameParticipant short name Country 1Computer and Automation Research Institute of the Hungarian Academy of Sciences MTA SZTAKIHungary 2Centro de Investigaciones Energéticas Medio Ambientales y Tecnológicas CIEMATSpain 3Foundation for the Development of Science and Technology in Extremadura FundecytSpain 4The French National Institute for Research in Computer Science and Control INRIAFrance 5University of WestminsterUoWUK 6Cardiff UniversityCUUK 7Faculty of Sciences and Technology of the University of Coimbra FCTUCPortugal 8Stichting AlmereGridAlmereGridThe Netherlands 9Centre National de la Recherche Scientifique - Institut National de Physique Nucleaire et de Physique des Hautes Energies IN2P3France

5 Sevice Grid (EGEE) Public DG SZDG PCs Local DG UoW Grid PCs Public DG IN2P3 Grid 300 PCs Public DG Planned PCs Public DG Extremadura Grid PCs Public DG EGEE-> XtremWeb PCs Public DG AlemereGrid PCs BOINC based DGs Local DG IN2P3 Grid 200 PCs XtremWeb based DGs The EDGeS production infrastructure

6 GlobalDEG LocalDEG University local DG Volunteer public DG Service Grid EGEE Typical scenario for EGEE users EDGeS Appl. Repository

7 Typical scenario for EGEE users Bag of tasks type of EGEE applications are selected and ported to BOINC and XtremWeb DGsBag of tasks type of EGEE applications are selected and ported to BOINC and XtremWeb DGs Porting is a joint work of EDGeS and the application developerPorting is a joint work of EDGeS and the application developer Since there is no certificate in DGs, all the applications are validated by the EDGeS teamSince there is no certificate in DGs, all the applications are validated by the EDGeS team Validated applications are placed in the EDGeS Appl. Repository (AR)Validated applications are placed in the EDGeS Appl. Repository (AR) DGs connected by EDGeS can register appls from the EDGeS ARDGs connected by EDGeS can register appls from the EDGeS AR EGEE users can take appls from the EDGeS AR and can submit to the connected DGs via the EGEE->DG bridges developed and operated by EDGeSEGEE users can take appls from the EDGeS AR and can submit to the connected DGs via the EGEE->DG bridges developed and operated by EDGeS

8 Use scenario 2: DG->EGEE EDGeS creates a new VO in EGEE called as EDGeS VOEDGeS creates a new VO in EGEE called as EDGeS VO Sites in the EDGeS VO support the applications of the EDGeS connected DGsSites in the EDGeS VO support the applications of the EDGeS connected DGs WUs of the connected DGs can be seamlessly executed in the EDGeS VOWUs of the connected DGs can be seamlessly executed in the EDGeS VO Example: WUs are executed by VOCE for experimental purposesExample: WUs are executed by VOCE for experimental purposes

9 MoU between EGEE and EDGeS On the second day of this conference EGEE-III signed its first MoU with EDGeS showing that the importance of EDGeS is well understood by the leadership of EGEEOn the second day of this conference EGEE-III signed its first MoU with EDGeS showing that the importance of EDGeS is well understood by the leadership of EGEE Goals of the MoU:Goals of the MoU: –Jointly select EGEE applications that should be migrated to EDGeS –Collaboration in porting these appls to EDGeS –EGEE support for the establishment and operation of the EDGeS VO –Organizing joint events (summer school, user forum)

10 User communities Another important goal of EDGeSAnother important goal of EDGeS –To identify user communities that need such large computational infrastructure –To support these communities in porting their application to EDGeS 14 identified communities:14 identified communities: –BioInfoGrid, e-Health, Fusion, computational chemists, etc. Establishing EDGeS User ForumEstablishing EDGeS User Forum 5 identified companies5 identified companies Establishing EDGeS Industry ForumEstablishing EDGeS Industry Forum

11 Applications already ported to EDGeS Video Stream Analysis in a Grid Environment (VISAGE) Correlation Systems Limited - Israel (shown at the EDGeS demo booth) Originally runs on the local DG of the company It is connected to the EDGeS VO and WUs are executed in the EDGeS VO Digital Alias-free Signal Processing University of Westminster (shown at the EDGeS demo booth) Originally runs on the local DG of the university It is connected to the EDGeS VO and WUs are executed in the EDGeS VO Protein Molecule Simulation using Autodock – University of Westminster Patient Readmission Application – University of Westminster 3D video rendering – University of Westminster

12 Applications currently being ported to EDGeS Ultrasound computer tomography - Forschungszentrum Karlsruhe Integrator of Stochastic Differential Equations in Plasmas - BIFI Distributed Audio Retrieval – Cardiff University Cellular Automata based Laser Dynamics – University of Sevilla Radio Network Design – University of Extramadura An X-ray diffraction spectrum analysis - University of Extramadura DNA Sequence Comparison and Pattern Discovery – Erasmus Medical Center -PLINK - Analysis of genotype/phenotype data - Atos Origin

13 Summary If you have any application that requires much more resources than you have currently in EGEE, please, contact usIf you have any application that requires much more resources than you have currently in EGEE, please, contact us EDGeS will help any EGEE user community in porting their applications into EDGeSEDGeS will help any EGEE user community in porting their applications into EDGeS EDGeS demonstrates how to attract new resource providers into the Grid and provides know-how to do it:EDGeS demonstrates how to attract new resource providers into the Grid and provides know-how to do it: –Home PCs (volunteer DGs) –University PCs (local university DGs) –Public school PCs –PCs of city grids