Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner - An opportunity for VRCs Bernard Marechal (Project Coordinator) 5 th Iberian Grid Infrastructure Conference, 8 th -10 th June 2011 Santander (Spain)

IBERGRID /10 June - Santander (Spain) 22 Outline GISELA as Resource Infrastructure Provider: –General  is much experienced in Grid computing  has a powerful Infrastructure  complies with EGI policies & recommendations –Specificities  Both Service (gLite) and Opportunistic Computing (OurGrid) supported GISELA: an option for VRCs –Platform for all kinds of Applications –Offers a series of new, well-supported Services (e.g. DIRAC) –VRC Training & Support –Collaborates with EGI and Regional Initiatives GISELA interests in the IBERGRID context –Welcomes international VRCs –Creates emulation process in LA –Interest in Iberian VRCs collaborating with Latin America

6 Iberian Institutions in EELA –Portugal:  Laboratório de Instrumentação e Física Experimental de Partículas (LIP) –Spain:  CIEMAT  Consejo Superior de Investigaciones Científicas (CSIC)  Universidad Politecnica de Valencia (UPV)  Universidad de Cantabria (UC)  Red Académica y de Investigación Española (REDIRIS) IBERGRID /10 June - Santander (Spain) Remembering the past 3 10 Iberian Institutions in EELA-2 –Portugal:  Universidade do Porto (UPORTO)  Universidade de Aveiro (UAV)  Universidade do Minho (UMINHO) –Spain:  CETA-CIEMAT  Centro de Supercomputación de Galicia (CESGA)  MAAT GKnowledge (MAAT)  Universidad de Cantabria (UC)  Universidad Complutense de Madrid (UCM)  Universidad de Extremadura (UEX)  Grupo de Reds y Computación de Altas Prestaciones (GRyCAP - UPV)

4 GISELA Countries & Partners 15 Countries (11 in Latin America) 19 Partners (14 in Latin America) 12 Third Parties (11 in Latin America) IBERGRID /10 June - Santander (Spain) 4 UNAM Third Parties CICESE ITV ITESM IPN-CIC UAEM UNISON The GISELA spirit is not anymore to consider Institutions, but rather representatives of JRU / NGI, with the advantage to “accept” de facto all JRU / NGI members. UPORTO Third Party Uminho REUNA Third Parties UFRO UTFSM UNIANDES Third Parties UIS PUJ UFRJ Third Party CEFET-RJ

IBERGRID /10 June - Santander (Spain) 55 GISELA as Resource Infrastructure Provider

6 Long record in e-Science support IBERGRID /10 June - Santander (Spain) 6 Fruit of 5-6 year experience of successful e-Science EU-LA Collaboration, through EU funded projects (EELA, EELA-2, GISELA) Has long outstanding collaboration with Spain (CIEMAT- Coordinating Institution) and Portugal Present in almost all LA countries Most encompassing e-Infrastructure for scientific collaborations between Latin America and Europe Sound long-term sustainability approach rooted on CLARA, NRENs, LA NGIs

IBERGRID /10 June - Santander (Spain) GISELA e-Infrastructure (1) 7 Committed CPU & Storage resources (from the GISELA DoW) CountryCPUsTBsRCsCountryCPUsTBsRCs Argentina13005Mexico19828 Brazil Peru11087 Colombia20026Panama10012 Cuba5001Portugal10003 Ecuador10015Spain France4001Uruguay Italy100301Venezuela12063 CPUsTBsRCs Total

GISELA gLite sites integrated in the infrastructure –CEFET-RJ, CIEMAT-TIC, EELA-UNLP, ICN-UNAM, INFN-CATANIA, UFRJ-IF, ULA-MERIDA, UMinho-CP, Uniandes and UPorto – About 1000 cores (VO “prod.vo.eu-eela.eu”) Non-GISELA sites contributing to the VO “prod.vo.eu-eela.eu” –CERN-PROD, csTCDie, EELA-UTFSM, IEETA and UNICAN OurGrid sites - about 400 cores (all in Brazil): –LCC2, GMF,DCA, AESA, LCC1, LSD IBERGRID /10 June - Santander (Spain) GISELA e-Infrastructure (2) 8

IBERGRID /10 June - Santander (Spain) GISELA e-Infrastructure (3) 9 UFRJ is the most active site (gLite only) – specInt2000

IBERGRID /10 June - Santander (Spain) GISELA e-Infrastructure (4) 10 Accumulated load per VO (gLite only)

IBERGRID /10 June - Santander (Spain) 11 EGI compliant Infrastructure EGI - GISELA Resource Infrastructure Provider MoU signed EGI compliance is based on the adoption of common services and practices –The Operational Level Agreement (OLA) ( –Monitoring System (Nagios) –Ticket System (GGUS) –Accounting System (APEL) –Middleware (gLite) –Resource database (GOCDB) –Operations Dashboard

IBERGRID /10 June - Santander (Spain) 12 Platform for any Application / VRC VRC initial situation: –EELA-2 ended up supporting 70 Applications from 78 Institutions Emerging VRCs –Legacy: EELA-2 User Communities, typically 1-2 Institution group(s), largely located in Latin America, alone or collaborating with a few Institutions. –A few large VRCs from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments at CERN) –More than 200 scientific contacts in LA, e.g. CLARA surveyed communities

IBERGRID /10 June - Santander (Spain) 13 Comprehensive framework for VRC support

IBERGRID /10 June - Santander (Spain) 14 Rich portfolio of new, well supported Services Broad range of services, covering both Application and Infrastructure support Examples of services for which support is available: –Application-related Services  Job, Catalogue, File and Data Management Digital archives, Secure storage, WatchDog, lcg-rec toolkit –Infrastructure-related Services  Support for opportunistic resources (OurGrid middleware)  Support for infrastructure bridging (OurGrid and gLite)  Support for Storage Accounting (SAGE) –Data processing and distributed user analysis services  DIRAC: workload and data management system (cf DIRAC meeting in Barcelona)

IBERGRID /10 June - Santander (Spain) 15 Comprehensive VRC Training & Support (1) Tailorable to VRCs needs

IBERGRID /10 June - Santander (Spain) 16 Adaptable to VRCs Comprehensive VRC Training & Support (2)

IBERGRID /10 June - Santander (Spain) 17 Collaboration with EGI & Regional projects EGEE, EGI –EGEE: Long, outstanding interaction (MoU) in collaboration with other related projects (EUMedGrid, EU-IndiaGrid, EUAsiaGrid, SEE-Grid-2, BalticGrid, BELIEF,..) –EGI: Natural follow up of the EGEE cooperation  Infrastructure Providers MoU, signed with EGI.eu  Project MoU (Dissemination, Training, Support tools & Services), signed with EGI-InSPIRE EGI-related projects / Regional Initiatives –DEGISCO: Volunteer computing support (gLite OurGrid bridge)  EU: UNIZAR-IBERCIVIS, ATOS ORIGIN, CNRS,…  LA: UFCG-Brazil –CHAIN: Focus on VRC support (MoU under preparation)  EU: INFN, CIEMAT  LA: CLARA –EPIKH Joint sponsoring /organisation of Tutorials & Workshops (MoU signed)  EU: INFN, CIEMAT, CNRS,..  LA: Brazil: CEFET/RJ, UFRJ, Chile: UTFSM, Mexico: UNAM)

IBERGRID /10 June - Santander (Spain) 18 GISELA specific interests in the IBERGRID context

IBERGRID /10 June - Santander (Spain) 19 GISELA interests Welcome international VRCs –A few large VRCs already on board such as from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments) Create emulation process in Latin America –Not enough intensive productions from LA VRCs –Wish to stimulate LA Institutions to move on from small tests to evaluate the Grid technology to mass production as exemplified by the large VRCs. –Hope to stimulate new collaborations Interest in “Iberian” VRCs collaborating with Latin America –GISELA is (was) naturally looking for existing or foreseen collaborations between SPAIN & Portugal and Latin America

IBERGRID /10 June - Santander (Spain) 20 CAM (Community Atmospheric Model) Domain: Earth Sciences / Climate forecast Collaboration: UNICAN (Spain), UCH+CMM (Chile), SENAHMI (Peru) From EELA: “…Therefore, there is a real need for a seamless global+regional climate application in grid environment allowing users to access and submit runs or experiments using a friendly tool (e.g. a portal).” Current status, perspectives?

IBERGRID /10 June - Santander (Spain) 21 WRF4G (Weather Research and Forecasting for Grid) Domain: Earth Sciences / Climate simulation Collaboration: UNICAN (Spain) From EELA-2: “One of the advantages of having ported the WRF to the Grid is the large community of end users around this model world wide. Especially the Latin America has a well established community around the WRF model. If we combine this community with the benefits of the Grid, the WRF4G will allow to create a new virtual community around this application supported by the Grid technology provided by the EELA-2 project.” Current status, perspectives?

IBERGRID /10 June - Santander (Spain) 22 BLAST (Basic Local Alignment Search Tool) Domain: Life Science / Bio-informatics Collaboration: UPV (Spain) From EELA-2: “…processing these databases with BLAST demands computational resources that exceed the capabilities of most research groups. Nevertheless, these massive experiments can be performed by means of e Science infrastructures (such as EGEE, EELA and some NGIs) following ‘High-Throughput’ approaches” Current status, perspectives?

IBERGRID /10 June - Santander (Spain) 23 GAMOS (Geant-based Architecture for Medicine-Oriented Simulations) GAMOS: Framework for the simulation of medical applications, in (PET/SPECT) and radiotherapy Domain: Life Sciences / Medical Physics Collaboration: CIEMAT (Spain), UTFSM (Chile), UNIANDES (Colombia) From EELA-2: “the gridified version GAMOS has been successfully deployed and tested on a first group of selected EELA-2 resources. The suitability of this application for Grid environments has been demonstrated performing a real simulation based in calibrating a commercial accelerator, which is in use in multiple hospitals for radiotherapy.” Current status, perspectives?

IBERGRID /10 June - Santander (Spain) 24 CROSS FIRE Domain: Civil Protection Collaboration: UMINHO (Portugal) From EGRIS1: “ Collaborative Resources Online to Support Simulations on Forest Fires: a Grid Platform to Integrate Geo-referenced Web Services for Real-Time Management” Current status, perspectives? CROSS FIRE: An integrated system aimed at the simulation of fire growth over complex topology

GISELA still young (9 months old) but … Some concerns (from a managerial point of view): –Slow implementation of the CLARA business plan for long-term sustainability –Handover to CLARA and NRENS of the GISELA activities –(Not enough) use of the GISELA e-Infrastructure –Third parties not yet fully on board –Slow and painful NGIs implementation in LA:  Different levels of development in LA countries' grid infrastructures/services  Local political issues  Non-uniform enthusiasm (but appreciable efforts in Colombia and Mexico) IBERGRID /10 June - Santander (Spain) 25 Conclusions (1)

However… –6 important MoUs already signed and 2 in progress (WP1) –Excellent dissemination and Outreach activities (WP2) –VRCs supported and training available (WP3) –Infrastructure operating satisfactorily (WP4) –Late, but currently satisfactory, ramping up of the Network Resource Provision (WP5) –Infrastructure and Applications-oriented Services for User Communities (WP6) rather productive (DIRAC) Finally … How could we strengthen the Portugal / Spain – LA collaborations? IBERGRID /10 June - Santander (Spain) 26 Conclusions (2)