1. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America WP3: Identification and support of Grid enhanced applications Rafael Mayo – CIEMAT Vicente Hernández – UPV Lukas Nellen – UNAM Inês Dutra – COPPE/UFRJ José Manuel Gutiérrez – UC First EELA Annual Review Madrid, 27.02.2007

2. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 2 THE OVERVIEW (Work Package Manager) Mandate Management Actions THE APPLICATIONS (Task Leaders) 3.1 Biomed 3.2 HEP 3.3 E-Learning & Climate CONCLUSIONS OUTLINE

3. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 3 WP3: Identification and support of Grid enhanced applications –Coordinated by CIEMAT –Identifies, selects and customizes relevant applications and tools suitable for the Grid dissemination process in:  T3.1 Biomedicine (CUBAENERGIA, ULA, UPV)  T3.2 High Energy Physics (CERN, CIEMAT, UFRJ, UNAM, UNLP, UTFSM)  T3.3 Additional Applications e-Education (CECIERJ/CEDERJ, CIEMAT, CUBAENERGIA, UFRJ, UNAM) Climate (UC, UDEC, SENAMHI) –Aims at being the place of information exchange between already gridified applications and future ones.. WORK PACKAGE 3

4. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 4 MANAGEMENT

5. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 5 –Meetings, reports, info exchange… Joint work! –4/4 Deliverables submitted –11 monthly reports MANAGEMENT

6. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Task 3.1 Biomedical Applications Rafael Mayo – CIEMAT Vicente Hernández – UPV Lukas Nellen – UNAM Inês Dutra – COPPE/UFRJ José Manuel Gutiérrez – UC First EELA Annual Review Madrid, 27.02.2007

7. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 7 Contents Task T3.1, Objectives and Plan. Status of the Applications –GATE. –Malaria Docking: WISDOM. –Blast in Grids: BiG. –Phylogeny. Summary of Achievements Future Plans

8. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 8 Task T3.1 - Objectives and Plan Participants: UPV (Coordinator), CUBAENERGIA, ULA. Work in the Task –A3.1 - Identification and selection of applications and tools [COMPLETED] –A3.2 - Customization of grid applications and tools [ON ADVANCED STAGE] –A3.3 - Evaluation of the impact on dissemination of the selected applications and tools [IN PROGRESS] Deliverables and Milestones (Biomed) –D3.1.1 - Selection report, M2 [DONE] –D3.2.1 - Application and tools customized, M6 [DONE] –D3.3.1 - Impact on dissemination report, M9 [DONE] –M3.1 - Successful use of the selected applications and tools, M9 [ACHIEVED] Next Deliverables and Milestones (Biomed) –D3.2.3 - Application and tools customized, M18 –D3.3.3 - Impact on dissemination report, M23

9. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 9 GATE Problem Addressed –The computation of the doses in radiotherapy treatments is performed through analytical simplified models –Environment for the Monte-Carlo simulation of particle physics emission in the medical field that is more accurate specially when dealing with heterogeneous tissues –Very time-consuming User Community –The interest of the LA community is led by CUBAENERGÍA –It is focused towards two main oncological problems:  Thyroid cancer.  Treatment of metastasis with P 32. –9 centers in Cuba are interested (5 hospitals and 4 oncological centers and institutions)

10. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 10 Mature Applications: GATE Outcome –>60 Computing resources have GATE Available –Gate is Installed on  tochtli.nucleares.unam.mx  ramses.dsic.upv.es  grid012.ct.infn.it  ce-eela.ic.uff.br  ce01.eela.if.ufrj.br  ce-eela.ciemat.es –A demonstration was performed in the frame of the EU-LAC Summit, Lisbon 28-29 April 2006 –Due to the lack of network connectivity from/to Cuba a local configuration has been set-up using the EELA stand-alone grid distribution

11. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 11 Mature Applications: WISDOM Problem Addressed –WISDOM (Wide In-Silico Docking Of Malaria) is a deployment of a high-throughput virtual screening platform in the perspective of in-silico drug discovery for neglected diseases –The in-silico docking is faster and much cheaper than the experimental docking, which is restricted to the most successful ligands obtained after the simulation process LA Interest –ULA is leading the interest in the LA –Collaboration is started in the analysis of new targets for malaria. ULA has selected new targets of Plasmodium Vivax which have been included in large-scale docking experiments

12. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 12 First EELA WISDOM Data Challenge Outcome: –2 Targets proposed by ULA –DC operated and coordinated by UPV –Starting date: October the 23 rd, 2006 –Ending date: January the 1 st, 2007 –Number of original jobs of the first target: 2422. First data challenge experiment on completing all jobs –Average computing time per job: 34,4 hours –Total effective running time: 228 CPU.days –Results obtained: 53 GBytes

13. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 13 First EELA WISDOM Data Challenge Sites used: –CIEMAT, Since beginning –GRYCAP-UPV, Since beginning –INFN, Since beginning –UNAM, Since beginning –UFRJ, Since beginning –UNICAN, LIP and CERN during the DC execution More than 40% of the jobs were effectively executed in LA sites 42% 58% Europe LA 17% 1% 5% 37% 8% 4% 25% 3% UFRJ LIP CERN CIEMAT UNICAN INFN UNAM GRyCAP-UPV

14. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 14 New Applications: Blast in Grids Problem addressed –BiG: BLAST in Grids is a grid-enabled BLAST interface –BLAST (Basic Local Alignment Search Tool) is a computationally intensive bioinformatics procedure applied to identify compatible protein and nucleotids sequences in protein and DNA databases –Applications in drug development, phylogeny, etc. User community –The Bioinformatics Ibero-American Network and Portal (http://portal-bio.ula.ve) –This portal also provides several on-line applications for registered users –It currently has almost 600 registered users from 70 countries (although 90% come from 10 countries)

15. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 15 Blast in Grids: Approach Use of MPI-Blast kernel Enhanced security through a MyProxy server Fault tolerant on the client and server side Embeddable on a stand-alone application or web portal Splitting of input sequences and reference databases into multiple jobs. Deals with multiple databases simultaneously FASTA File (Input Sequence) AGTACGTAGTAGCTGC TGCTACGTGGCTAGCT AGTACGTCAGACGTA GATGCTAGCTGACTC GA FASTA File (Input Sequence) AGTACGTAGTAGCTGC TGCTACGTGGCTAGCT AGTACGTCAGACGTA GATGCTAGCTGACTC GA Execution Parameters Execution Parameters Output Matches Xxxxx x x x x x xxx xx xxx x Output Matches Xxxxx x x x x x xxx xx xxx x Protein Database (Non Redunda nt e.g.)

16. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 16 Blast in Grids: Usage Report Period: Jul’06-Dec’06. Usage statistics: –Number of jobs: 284 –CPU consumed: 173 CPU.days –Resources used: ramses.dsic.upv.es 20-CPU queue –BiG is being used at the University of Los Andes to work on the complete genome of the Plasmodium Falciparum for the identification of DHFR antigenic proteins 0 20 40 60 80 100 120 140 dic-06nov-06oct-06sep-06ago-06jul-06 CPU.hours Time#Jobs

17. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 17 Problem addressed –A phylogeny is a reconstruction of the evolutionary history of a group of organisms. Very important for the analysis of the resistance to treatments –Phylogeny tools consumes much memory and computing time User community –The Bioinformatics Ibero-American Network and Portal (http://portal-bio.ula.ve)http://portal-bio.ula.ve Solution proposed –Use an mpi-enabled version of a widely used Bayesian inference application for phylogeny (MrBayes) Achievements –A grid-service to run parallel MrBayes executions is currently available at UPV New Applications: Phylogenyfalciparum reichenowl gallinaceum mexicanum malariae lophurae vivax cynomolgi berghei fragile knowlesi >

18. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 18 Review of Actions with Respect to the Technical Annex Expected results (at the end of the project) –The running of at least 2 EGEE biomed applications in the EELA pilot testbed [ACHIEVED] –The processes of identification of at least two new biomed applications that could provide solutions to problems, which are more relevant to local LA partners and use them on dissemination activities [ACHIEVED] –To achieve at least 3000 executions [ACHIEVED] of the biomed applications from at least 50 users.  WISDOM: More than 100.000 executions  BiG: 300 executions  18 different users, although results are available to a wider community –To transfer at least 1 of the new EELA biomed applications to EGEE infrastructure [ACHIEVED] –To reach at least impact on 4 different countries (European + Latin American). [ACHIEVED]

19. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 19 Planning for the Next Period BLAST in Grids (http://www.cecalc.ula.ve/blast/)http://www.cecalc.ula.ve/blast/ –Operate the system and support users –Extend to other communities WISDOM (http://wisdom.eu-egee.fr/)http://wisdom.eu-egee.fr/ –Analyse the results of the 1st target –Propose changes for the WISDOM code –Submit the second target GATE (http://opengatecollaboration.healthgrid.org/)http://opengatecollaboration.healthgrid.org/ –Support the operations of the Cuban installation –Increase the user community in LA Phylogeny (http://mrbayes.csit.fsu.edu/)http://mrbayes.csit.fsu.edu/ –Complete migration and deployment of the interface –Operate the application

20. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Task 3.2 HEP Applications Rafael Mayo – CIEMAT Vicente Hernández – UPV Lukas Nellen – UNAM Inês Dutra – COPPE/UFRJ José Manuel Gutiérrez – UC First EELA Annual Review Madrid, 27.02.2007

21. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 21 Overview HEP and GRID computing First HEP applications –ALICE experiment –LHCb experiment Status of installations Future applications Summary

22. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 22 EELA - HEP synergy Mature applications  guaranteed applications Well supported –Developed by LHC collaborations –Support available to collaboration members HEP Experiments need GRID computing –All experiments use grid based computing models –HEP communities in Latin America require GRID –HEP communities in LA are interested in collaboration with EELA Several EELA partners have HEP groups

23. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 23 HEP applications in EELA Applications of interest to EELA partners and other communities in Latin America –Initial applications  ALICE experiment: Heavy ion physics at LHC INFN-Catania, CIEMAT, and UNAM  LHCb experiment: B physics at LHC UFRJ –Other LHC applications  ATLAS experiment (General purpose) UFRJ, UNLP and UTFSM  CMS experiment (General purpose) CIEMAT; CMS has participants in EELA Brazil and Mexico, but no EELA partner from LA –New projects  Pierre Auger Observatory INFN-Catania, LIP, UFRJ, UNAM, and UNLP, others in EGEE

24. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 24 ALICE experiment: GRID setup Job 1.1lfn1 Job 1.2lfn2 Job 1.3lfn3, lfn4 Job 2.1lfn1, lfn3 Job 2.1lfn2, lfn4 Job 3.1lfn1, lfn3 Job 3.2lfn2 Site ALICE central services Optimizer Computing Agent RBCEWN Execs agent Submits job User ALICE Job Catalogue VO-Box LCG/gLite User Job ALICE catalogues Registers output lfnguid{se’s} lfnguid{se’s} lfnguid{se’s} lfnguid{se’s} lfnguid{se’s} ALICE File Catalogue packmanSA xrootd GUID LFC SRM MSS File access Workload request SURL VO box complicates installation: Few ALICE EELA sites

25. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 25 Three groups –INFN-Catania –CIEMAT –UNAM Four resource centres set up for ALICE jobs –INFN-Catania –CIEMAT Madrid –CIEMAT Trujillo –UNAM Participating in data challenges Working on jobs of direct interest to EELA partners ALICE experiment in EELA A total of  59000 jobs done on EELA sites Submission of ALICE Grid jobs from Latin America

26. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 26 LHCb computing model Centralistic model: No local participation Only 4 grid user accounts

27. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 27 LHCb experiment in EELA One group –UFRJ Three resource centers support LHCb –INFN-Catania –CIEMAT –UFRJ In Data Challenge: Package of 500 events every 20h, 0.5Gb in size, negligible impact on network.

28. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 28 ATLAS experiment in EELA UNLP has recently joined the ATLAS collaboration UTFSM has started to collaborate with ATLAS UFRJ ATLAS group expressed interest in using the EELA infrastructure CIEMAT already resource centre UNLP and UTFSM are setting up resource –Support ATLAS –To be shared with EELA http://atlas.web.cern.ch/Atlas/index.html

29. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 29 CMS experiment in EELA CMS is the only LHC experiment without participation from a Latin American EELA partner CMS groups in EELA member countries –Brazil –Mexico –Spain (CIEMAT) First contacts established –Presentation at the 1st EELA conference –Brazilian and Mexican CMS groups participated in the network survey http://cms.cern.ch/

30. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 30 Pierre Auger Observatory Four EELA partners (more collaborators in EGEE) –INFN-Catania –LIP –UFRJ –UNAM –UNLP Start GRID use in 2007 http://www.auger.org/

31. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 31 Conclusions Two applications selected and running –ALICE experiment –LHCb experiment Infrastructure set up to support them –Many thanks to WP2 –We have to review network requirements for LHC data taking  Information so far relates to data challenges –Move to production quality service We have more candidate applications in EELA –ATLAS experiment –Pierre Auger Observatory CMS experiment is the only LHC experiment without an EELA partner from Latin America –Contacts established Acknowledgement: Thanks to the experts from ALICE and LHCb for providing the technical information

32. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 32 References ALICE experiment http://aliceinfo.cern.ch/ LHCb experiment http://lhcb.web.cern.ch/lhcb/ ATLAS experiment http://atlas.web.cern.ch/Atlas/ CMS experiment http://cms.cern.ch/ Pierre Auger Observatory http://www.auger.org/

33. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Task 3.3 e-Learning Applications Rafael Mayo – CIEMAT Vicente Hernández – UPV Lukas Nellen – UNAM Inês Dutra – COPPE/UFRJ José Manuel Gutiérrez – UC First EELA Annual Review Madrid, 27.02.2007

34. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 34 Task responsible for new applications (dynamic!) Recap e-Learning Status Report Conclusions Future Work Plan Task 3.3: Additional Applications

35. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 35 Recap: –8 Partners/ 6 Countries (1 EU and 5 LA):  CEDERJ (Brazil)  active  CIEMAT (Spain)  active  CUBAENERGIA (Cuba)  active  SENAMHI (Peru)  active  UniCan (Spain)  active  UDEC (Chile)  active  UFRJ (Brazil)  active  UNAM (Mexico)  active Task 3.3: Recap

36. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 36 Task 3.3: Milestone –M3.2: successful use of the selected applications: M15. –We are very close to our goal, with successfully gridified applications  6 EELA applications: 2 e-Learning (in process of deployment) 2 Climate (already deployed) 2 others (already deployed)  3 non-EELA applications (in process of deployment)

37. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 37  What is it? Use of multimedia technology to develop and improve new learning strategies  Characteristics Data stored under the control of a Learning Management System (LMS) Contents can be updated and exchanged with other systems e-Learning

38. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 38 e-Learning Why e-learning on a grid? –Limitations of current systems  Scalability  Storage capacity  Availability  Computing power  Lack of some kinds of interactive capabilities –Good side-effects:  Automatic data location (video, text, equipments, etc.)  Confidentiality  Extraction of relevant information, not only location  Data standardization

39. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 39 e-Learning Applications  CEDERJ, UFRJ, CIEMAT  VoD  CUBAENERGIA  CuGfL  UNAM  LEMDist

40. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 40 Application Status Report: VoD 16 Regional sites 3 Regional satellite sites 5 call centers at UERJ, UFRJ, UNIRIO, UFF and UENF Sites of the CS course 3 places dedicated to Science New sites (Feb 2006) Map of Rio de Janeiro state

41. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 41 Application Status Report: VoD Multimedia Server Computer Lab

42. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 42 Application Status Report: VoD

43. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 43 Application Status Report: VoD First prototype version to the EELA infrastructure during the 1 st EELA Grid School (EGRIS-1) Client requests come from User Interfaces (UIs) Videos and data are stored on Storage Elements RIO server installed on entry points of the EELA infra- structure

44. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 44 VoD Architecture on EELA

45. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 45 Applications Status Report: CuGfl Cuban Grid for Learning (CuGfL) (CUBAENERGIA) CuGfL portal Portal/website Repositories (contents, digital assets, metadata Ministries Universities Libraries Gov. Agencies e-Learning initiatives

46. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 46 Application Status Report: CuGfl CuGfl (Cuba, CITMATEL) - Based on Moodle - Course management system to produce web- based courses that support a social constructionist framework of education - Implemented: - Job Management Module - Authentication Module

47. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 47 Application Status Report: CuGfl LMS MOODLE - Architecture overview I Workload Management System components LMS–MOODLE server New activity / services Interface with the Grid environment - Authentication - Job Management Workload Management System components LMS–MOODLE server Workload Management System components LMS–MOODLE server

48. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 48 Application Status Report: LEMDist LFC File Catalogue Metadata Catalogue Storage Elements AMGA UI Instrument Element (IE) Job submission Browsing Information system File Copy RB Information Storage 1 2 Laboratorio Experimental Multidisciplinario a Distancia

49. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 49 Application Status Report: LEMDist How is it being ported to EELA –4 activities:  NMR image analysis  Capillarity electrophoresis: LABView for remote interface  Computational modelling: CNSsolve  Food engineering Current Status –Remote control of food engineering equipment using gLite

50. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 50 Conclusions According to the project goals: –To provide access to remote lab work  VoD and LEMDist –To use grid technology in the teaching process  VoD and CuGfL –To teach grid technology to students in mainstream courses  VoD –To supply suitable applications to disseminate grid technology in LA after their porting on the grid  VoD, LEMDist and CuGfL

51. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 51 Thanks!!!...to all groups that have been contributing to task 3.3, working hard to make EELA a success! …to WP2 people! …to WP4 people! More details on the apps presented here can be found in the deliverable D3.2.2 at www.eu-eela.org Let’s welcome the Climate application!

52. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Task 3.3 Climate Applications Rafael Mayo – CIEMAT Vicente Hernández – UPV Lukas Nellen – UNAM Inês Dutra – COPPE/UFRJ José Manuel Gutiérrez – UC First EELA Annual Review Madrid, 27.02.2007

53. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Climate group UC-Spain UDEC-Chile SENAMHI-Perú

54. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 54  Goal: Predict Local Impacts of “El Niño” in Latin America A challenging problem for the climate community, with huge socio-economical impact in Latin America.  GRID helps to share computing resources, heterogeneous data, as well as know-how in a user-friendly form.  A new integrated climate application developed in EELA from the scratch, with no similar counterpart in any other Earth Science/Climate EU Project. WP 3.3. Climate Challenge Anomalous heatingAnomalous cooling

55. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 55 Three applications have been identified (climate sequence):  Global atmospheric circulation model (CAM) ……..  Regional weather model (WRF) …………………….  Datamining clustering tools (SOM) ………………… This sequence poses several computational challenges Nontrivial dependent relationships among the applications. This sequence of jobs demands middleware solutions for:  Preparing and submitting dependent jobs / data sharing (workflow).  Restarting interrupted experiments.  Manage metadata (for datasets and application status). WP 3.3. Applications Sea Surface Temperature CAM 1 year = 2 CPU days 1-10 GB WRF (job 1) WRF (job 2) WRF (job n) … SE SOM Deployed ! Work in progress Input

56. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 56 Application Workflow UI supersubmiter.sh Generate CAM.jdl Submit CAM.jdl Insert entry in CAM collection AMGA Resource Broker WN change_status_CAM.sh Update status Insert runon CAM collection AMGA CAM upload_info_CAM.sh Insert entry in WRF collection AMGA 1 2 3 checkpoint_CAM.sh Insert entry in CHECKPOINT collection AMGA update_history_CAM.sh Insert entry in HISTORYCAM collection AMGA

57. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 57  Using GENIUS to interact with the applications (CAM+WRF)  In the future a climate specific portal will be developed (JSR168) to run and track scientific experiments. WP 3.3. Current Status

58. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 58 The second year will focus on a scientific challenge: High resolution regional simulations for El Niño and La Niña 1982-1983 and 1997-98 strong events. Comparison with historical local data, including sensitivity studies of SST. WP 3.3. Scientific Challenge CAM WRF (job 1) WRF (job 2) WRF (job n) … SE SOM SST …

59. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 59  A sequence of climate simulations has been integrated in a common Grid, granting access to processed data suitable for the dissemination activities: CAM and WRF provide simulation forecasts from input meteorological conditions (working within the testbed storage elements).  Predictions for different local variables in the area of El Niño phenomenon, both CAM (global) and WRF (regional), are being run in the area of El Niño (an simulation experiment for two strong El Niño events has been designed for the 2nd year of the project).  This tasks has achieved in month 12 the goals planned for month 15, and a new scientific goal is planned.  The scientific challenge has been extended to include sensitivity studies of Sea Surface Temperature (SST) local impact. WP 3.3. Climate achievements

60. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 60 CAM Application. Global simulations WP 3.3. Climate Demo… WRF Application. Regional simulations

61. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 61 CAM Application: http://www.ccsm.ucar.edu/models/atm-cam/http://www.ccsm.ucar.edu/models/atm-cam/ User’s Guide to the NCAR Community Atmosphere Model (CAM 3.0): J. R. McCaa, M. Rothstein, B. E. Eaton, J. M. Rosinski, E. Kluzek, M. Vertenstein: Climate And Global Dynamics Division, NCAR, Boulder, Colorado, 2004, 88 pp. W. D. Collins, C. M. Bitz, et al. (2006) “The Community Climate System Model: CCSM3”, Journal of Climate, Special Issue on CCSM, 19(11). WRF Application: http://www.wrf-model.org/http://www.wrf-model.org/ Skamarock, W. C., J. B. Klemp, J. Dudhia, D. O. Gill, D. M. Barker, W. Wang and J. G. Powers, 2005: A Description of the Advanced Research WRF Version 2. NCAR Technical note, 2005, 88 pp. Michalakes, J., J. Dudhia, D. Gill, T. Henderson, J. Klemp, W. Skamarock, and W. Wang, 2004: "The Weather Reseach and Forecast Model: Software Architecture and Performance,"Proceedings of the 11th ECMWF Workshop on the Use of High Performance Computing In Meteorology, 25-29 October 2004, Reading U.K. Ed. George Mozdzynski. WP 3.3. References SOM Application (grid version): http://www.meteo.unican.eshttp://www.meteo.unican.es F. Luengo, A.S. Cofiño, and J.M. Gutiérrez (2004) “GRID Oriented Implementation of Self-Organizing Maps for Data Mining in Meteorology”, Lecture Notes in Computer Science, 2970, 163 – 171.

62. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America WP3: Final conclusions Rafael Mayo – CIEMAT Vicente Hernández – UPV Lukas Nellen – UNAM Inês Dutra – COPPE/UFRJ José Manuel Gutiérrez – UC First EELA Annual Review Madrid, 27.02.2007

63. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 63 Milestone for WP3 –Successful use of the selected Biomedical and HEP applications and tools in M09. Official objectives

64. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 64 For achieving WP3 objectives, some criteria were defined: –At least 4 applications in year 1.  3 Biomedical, 2 HEP, 3 e-Learning, 2 Climate and 3 additional applications  13 applications –At least 1 new application considered  From the 13 applications, 9 are new –At least 50 researchers that have tested an enhanced application  61 EELA VO members (not counting Tutorials!) –At least 10 Participations in relevant fora of EELA members  23 WP3 contributions in non-EELA events Criteria

65. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 65 –51 presentations in conferences  49 Oral contributions –5 Information Sheets –4 papers published  Studies In Health Technology and Informatics 120, 397-400 (2006)  Proceedings of the NETTAB conferences 6, 8-13 (2006)  Proceedings of the CONAMA conferences 8, 160-168 (2006)  IEEE TNB (to be published) Dissemination

66. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 66 For the near future, but established through 2006 –Increase and support the user communities –Survey of new communities  MoU with more Projects –12 New applications interested in joining EELA Near future

67. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 67 EELA has setup a procedure to accept new associated partners and their applications http://www.eu-eela.org/eela_mou.php New communities

68. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 68 EGRIS-1 EMBOSS (UNAM  MoU) SegHidro (UFCG  MoU) Distributed Simulation of Multiple Failure Events on Optical Networks (UNESP, UNICAMP, USP) VOLCANO SONIFICATIONS (EGEE-INFN) SATyrus (UFRJ) PILP (UFRJ) New communities

69. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 69 Milestone for WP3 -Successful use of the selected E-Learning and Climate Applications in M15 -and the “new ones” during 2007 Others -4 Deliverables -New dissemination activities -Inf. Sheets -Conferences, Workshops, Schools… Next period

70. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 70 Conclusions Difficult WP given that some people involved did not have a clue about grid technology or they have to work from scratch They were trained through tutorials for users and administrators to gain background on grid issues Most important, they were taught how to gridify an application Despite of this lack of background, they have been achieving great progress since the beginning of the project, accomplishing all goals

71. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 71 Great achievements after the 1 st EELA Grid School in Itacuruçá with EELA and non-EELA applications successfully ported to gLite More synergy and interaction among all partners People are very much involved in making the EELA infrastructure a success All of these apps will have a tremendous impact on LA Conclusions

72. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 72 WP3 web page: http://www.eu-eela.org/eela_wp3.php WP3 documents: http://documents.eu-eela.org Useful information

73. FP6-2004-Infrastructures-6-SSA-026409 E-infrastructure shared between Europe and Latin America Madrid, First EELA Annual Review, 27.02.2007 73 Any questions?