11 Introduction to EDGI Peter Kacsuk, MTA SZTAKI Start date: Duration: 27 months EDGI is supported by the FP7 Capacities Programme under contract nr RI

2 EU FP7 projects on desktop grids EDGeS –> EDGI and DEGISCO EDGI ARC, Unicore, CloudsARC, Unicore, Clouds QoS with CloudsQoS with Clouds Data intensive appsData intensive apps SG->DG direction supportSG->DG direction support EDGeS DG SG integration:DG SG integration: gLite → BOINC, XtremWebgLite → BOINC, XtremWeb BOINC, XtremWeb → gLiteBOINC, XtremWeb → gLite Compute intensive applicationsCompute intensive applications further d eveloped by supported by DEGISCO Disseminate EDGeS results world-wideDisseminate EDGeS results world-wide Green IT aspectsGreen IT aspects

33 EDGeS and EDGI EDGI scope for both compute and data intensive applications for EMI/EGI (gLite, ARC, Unicore) Extend Desktop Grids with Clouds for QoS EDGeS scope only for compute intensive applications for gLite

4 Basic EDGI architecture ARC grid ARC MCE atticmonitorAR 3GBridge monitor AR User IF Bridge IF Monitor UI DG Pro- ject submit inspect down- load submit Volunteer/ Institutional Resources DG client Unicore grid CREAM MCE atticmonitorAR submit Unicore MCE gLite grid CREAM MCE atticmonitorAR

5 Advanced EDGI architecture ARC gridEucalyptus/ Amazon ARC MCE atticmonitorAR 3GBridge attic monitor AR User IF Bridge IF Attic FS DG client attic Monitor UI DG Pro- ject submit inspect upload down- load submit cloud Volunteer/ Institutional Resources DG client attic Unicore grid CREAM MCE atticmonitorAR submit Unicore MCE gLite grid CREAM MCE atticmonitorAR

6 MetaJob concept to increase performance 6 ARC grid gLite grid Eucalyptus/ Amazon ARC MCE atticmonitorAR CREAM MCE atticmonitorAR 3GBridge attic monitor AR User IF Bridge IF Attic FS DG client attic Monitor UI DG Pro- ject submit inspect upload down- load submit cloud Volunteer/ Institutional Resources DG client attic MetaJob as a single job Unfol ding Huge number of jobs Single job

7

8

Institutional DGs: University of Westminster Local DG 1.New Cavendish Street576 nodes 2.Marylebone Campus559 nodes 3.Regent Street395 nodes 4.Wells Street31 nodes 5.Little Tichfield Street66 nodes 6.Harrow Campus254 nodes Total:1881 nodes Lifecycle of a node: 1.PCs basically used by students/staff 2.If unused, switch to Desktop Grid mode 3.No more work from DG server -> shutdown (green solution)

10 gLite UI 3G Bridge BOINC Server BOINC Client Typical EDGI infrastructure configuration WMSMCE EDGI AR CC BOINC Client EDGI portal CE Public or Local DG

11 gLite UI 3G Bridge BOINC Server BOINC Client Typical EDGI infrastructure configuration WMSMCE EDGI AR CC BOINC Client EDGI portal CE Public or Local DG

12 3G Bridge BOINC Server BOINC Client Typical EDGI infrastructure configuration CC BOINC Client EDGI portal Public or Local DG

13 Usage scenarios of EDGI technology for EGI/NGI VOs Extending VOs by using the EDGI services SG VOs can be extended by existing EDGI DG resources SG VOs can be extended by new institutional DGs First create institutional DG system (e.g. Univ. of Westminster local DG) SG VOs can be extended by new volunteer DGs SG VOs can be extended by all of the above Building infrastructure by installing the EDGI services: extending the VO with: A modified CE (Application Repository if virtualization is not used) Using the infrastructure SG users can submit applications by their CLI SG users can submit applications via the EDGI portal

14 Parameter study application execution in desktop grids GEN SEQ COLL SEQ Generates input parameter space Evaluates the results of the simulation Parameter sweep jobs: To be executed in DGs Two options: 1.registered/ ported appl 2.Any appl

15 The typical option in the past for BOINC Port the application to BOINC Port the application to BOINC Create master code (BOINC API, DC-API) Create master code (BOINC API, DC-API) Create client code (BOINC API, DC-API, BOINC Wrapper, GenWrapper) Create client code (BOINC API, DC-API, BOINC Wrapper, GenWrapper) Register the application on the BOINC server Register the application on the BOINC server Run the application Run the application

16 The new option for BOINC Register the GBAC (Generic BOINC Application Client) application on the BOINC server Register the GBAC (Generic BOINC Application Client) application on the BOINC server Run any application as input parameter of the GBAC application Run any application as input parameter of the GBAC application Generate as many GBAC workunits for BOINC as many parametric jobs are in your application. Generate as many GBAC workunits for BOINC as many parametric jobs are in your application.

WS- PGRADE 3G Bridge (GBAC) BOINC Server (GBAC) BOINC Client (VirtualBox) BOINC Client (VirtualBox) Demo configuration SZTAKI Cloud

18 IDGF (International Desktop Grid Federation)

19 IDGF (International Desktop Grid Federation)

20 IDGF (International Desktop Grid Federation) New project: IDGF-SP Starting in September 2012

21 ConclusionsConclusions Without any effort your VO can be connected to the EDGI infrastructure and the users of your VO can get access to machines for BoT/PS applications Without any effort your VO can be connected to the EDGI infrastructure and the users of your VO can get access to machines for BoT/PS applications Please, try the EDGI infrastructure and contact us: Please, try the EDGI infrastructure and contact us: Peter Kacsuk (coordinator of EDGI, EDGeS) Peter Kacsuk (coordinator of EDGI, Jozsef Kovacs (technical coordinator) Jozsef Kovacs (technical Websites: