The EDGeS project receives Community research funding 1 EDGeS Bridge technology to interconnect EGEE and BOINC grids Peter Kacsuk MTA SZTAKI

2 The problem we address Desktop grids (DGs) (volunteer DGs – home computers, organizational DGs – institutional desktops) Inexpensive, very large number of CPUs (~100K – 1M) Bag of task appls Cluster based service grids (SGs) (EGEE, OSG, etc.) Moderately expensive, moderate number of sites and CPUs any appls Supercomputer based SGs (DEISA, TeraGrid) Very expensive, small number of sites and large number of CPUs MPI appls OGF GIN EDGeS

3 What is EDGeS? EDGeS: Enabling Desktop Grids for e-Science 1.EDGeS is a 2-year FP7 project started on the 1 st of January 2008 Research on integrating (bridging) SGs and DGs Creates infrastructure Provides services 2.EDGeS is an infrastructure EDGeS VO interconnected with various DGs Application repository 3.EDGeS is a service for Application porting and validation

4 Project partners Partic. No.Participant nameParticipant short name Country 1Computer and Automation Research Institute of the Hungarian Academy of Sciences MTA SZTAKIHungary 2Centro de Investigaciones Energéticas Medio Ambientales y Tecnológicas CIEMATSpain 3Foundation for the Development of Science and Technology in Extremadura FundecytSpain 4The French National Institute for Research in Computer Science and Control INRIAFrance 5University of WestminsterUoWUK 6Cardiff UniversityCUUK 7Faculty of Sciences and Technology of the University of Coimbra FCTUCPortugal 8Stichting AlmereGridAlmereGridThe Netherlands 9Centre National de la Recherche Scientifique - Institut National de Physique Nucleaire et de Physique des Hautes Energies IN2P3France

5 v2.0 SG interoperation/interoperability: Task of OGF GIN EDGeS gLite (EGEE) ARC (NorduGrid) Boinc (Berkeley) XtremWeb (INRIA/IN2P3) Xgrid (Apple) Unicore (DEISA) VDT (OSG) Current Future Integration of SG and DG systems Solving the DG-SG interoperation (EDGeS) interoperation (EDGeS) interoperability (EDGeS and PGI) interoperability (EDGeS and PGI)

Generic Grid-Grid (3G) Bridge to integrate SGs and DGs Job Handler Interface Job source BOINC client Job source EGEE GRAM Job source gUSE submitter Job source PGI client Job Database Queue Manager GridHandler Interface DC-API Plugin XtremWe b Plugin EGEE Plugin BOINC EGEE Xtrem Web BOINC EGEE gUSE/ WS- PGRADE portal 3G Bridge

7 Production DG - EGEE Infrastructure voms lbwmsbdii gLite based service grid VO XtremWeb-EGEE bridge XtremWeb- based DGs IN2P3 local DG (200) IN2P3 public DG (300) AR UI/bridge Core service Resource SZTAKI 16 cpus CIEMAT 20 cpus ce CNRS 1554 cpus ce BOINC-EGEE bridge BOINC-based DGs UoW (1.700), Corr. System s (10) local DGs SZDG (72.000) Almere (1.000) IberCivis (14.000) public DGs

8 Oct.Nov.Dec.Jan.Feb. EDGeS VO activity according to EGEE Accounting Portal CPU > 1 Day/Week CPU > 1 Month/Week CPU > 1 Year/Week

9 GlobalDEGLocalDEG University DG Volunteer DG Service Grid EGEE EGEE User access to various grids EDGeS Appl. Repository

10 GlobalDEGLocalDEG University DG Volunteer DG Service Grid EGEE User access to various grids WS- PGRADE EDGeS Appl. Repository gUSE

Accessing EDGeS by WS-PGRADE portal EDGeS VO UI machine WMS Machine Other EGEE services EDGeS CE1 machine LCG-CE WNWN WNWN WNWN WNWN WNWN WNWN BOINC server DB QM DC-API plugin QM WS client QM EGEE pluginJW Client UI machine WS Interf ace WS- PGRADE gUSE DG submi tter

12 Applications ported by EDGeS ApplicationOrganisation Runs on Desktop Grid Runs on EGEE (EDGes VO) Video Stream Analysis in a Grid Environment (VISAGE) Correlation Systems Ltd - Israel√√ Digital Alias-free Signal Processing University of Westminster√√ Protein Molecule Simulation using Autodock University of Westminster√√ E-Marketplace Model Integrated with Logistics (EMMIL) SZTAKI√√

13 Applications ported by EDGeS ApplicationOrganisation Runs on Desktop Grid Runs on EGEE (EDGes VO) Anti-cancer Drug Design (CancerGrid) SZTAKI√√ Cellular Automata based Laser Dynamics (CALD) University of Seville and University of Westminster√√ Signal and Image Processing using GT4 Tray Forschungszentrum Karlsruhe√ Analysis of Genotype Data (Plink) Atos Origin√

14 Applications ported by EDGeS ApplicationOrganisation Runs on Desktop Grid Runs on EGEE (EDGes VO) Distributed Audio Retrieval using TRIANA (DART) Cardiff University√√ Fusion Plasma Application (ISDEP) BIFI√ 3-D Video Rendering using Blender University of Westminster√ Profiling Hospitals in the UK based on Patient Readmission Statistics University of Westminster√

15 RI NA3 version: 1.0 Introduction Author: Ad Emmen NA1: MoUs with other projects Signed MoU with EGEE III Jointly select EGEE applications that should be migrated to EDGeS Collaboration in porting these appls to EDGeS EGEE support for the establishment and operation of the EDGeS VO Organizing joint events (summer school, user forum meetings) Signed MoU with EELA-2 Prepared MoUs with IberCivis DG SEE-GRID-SCI Univ. of Houston (Virtual Prairie DG) 15

16 Summary EDGeS connectsEDGeS connects –BOINC or XtremWeb DGs –and gLite based SGs EDGeS is an open infrastructure:EDGeS is an open infrastructure: –Any BOINC or XtremWeb DG can join –Any gLite based SG can join Any EGEE user can access EDGeSAny EGEE user can access EDGeS Any EGEE VO can be extended with DGs based on EDGeS bridge technologyAny EGEE VO can be extended with DGs based on EDGeS bridge technology EDGeS helps any EGEE user community in porting their applications into EDGeSEDGeS helps any EGEE user community in porting their applications into EDGeS

17 For more information please visit the EDGeS Website: Join the EDGeS User & Industry Forum here! Please contact us if you need support in porting your application to EDGeS! Thank you for your attention … Any questions?