1. INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org Introduction to EGEE and the training infrastructure Dr. Rüdiger Berlich, Forschungszentrum Karlsruhe / Germany Dr. Mike Mineter National e-Science Centre, Edinburgh / UK Brisbane, 02.02.06 Slides contributed by EGEE Team

2. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 2 Presentation overview General description of the EGEE project and relations to HEP CERN LCG project EGEE operates a production infrastructure: –Operations –Middleware – Applications Establishment of new user communities Promoting and enabling international collaboration

3. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 3 The largest Grid Infrastructure: EGEE Objectives –consistent, robust and secure service grid infrastructure –improving and maintaining the middleware –attracting new resources and users from industry as well as science Structure –71 leading institutions in 27 countries, federated in regional Grids –leveraging national and regional grid activities worldwide –funded by the EU with ~32 M Euros for first 2 years starting 1st April 2004 –Second project phase starts April 2006 EGEE == Enabling Grids for E-SciencE

4. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 4 EGEE Activities 48 % service activities (Grid Operations, Support and Management, Network Resource Provision) 24 % middleware re-engineering (Quality Assurance, Security, Network Services Development) 28 % networking (Management, Dissemination and Outreach, User Training and Education, Application Identification and Support, Policy and International Cooperation) Emphasis in EGEE is on operating a production grid and supporting the end-users

5. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 5 6000 physicists worldwide want to access LHC data

6. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 6 EGEE pilot applications High-Energy Physics (HEP) –Provides computing infrastructure (LCG) –Challenging:  thousands of processors world-wide  generating petabytes of data  ‘chaotic’ use of grid with individual user analysis (thousands of users interactively operating within experiment VOs) Biomedical Applications –Similar computing and data storage requirements –Major additional challenge: security & privacy Chemistry, Earth Observation, Astronomy, Geophysics,...

7. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 7 Grid middleware The Grid relies on advanced software, called middleware, which interfaces between resources and the applications The GRID middleware: –Finds convenient places for the application to be run –Optimises use of resources –Organises efficient access to data –Deals with authentication to the different sites that are used –Runs the job & monitors progress –Recovers from problems –Transfers the result back to the scientist

8. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 8 EGEE Middleware gLite First release of gLite end of March 2005 –Release 1.1 in May 05 –Release 1.2 in July 05 –Release 1.5 in January 06 –see www.gLite.orgwww.gLite.org Interoperability & Co-existence with deployed infrastructure Robust: Performance & Fault Tolerance Service oriented approach Open source license Webservice focus Likely successor to LCG-2 / Merge

9. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 9 User information, training & support Over 2000 people trained Induction, application developer, advanced courses, retreats,... Material archive online > 200 presentations Press work Grid summer schools Public and technical websites constantly evolving to expand information available and keep it up to date 4 conferences organized ~ 300 @ Cork ~ 400 @ Den Haag ~ 450 @ Athens ~ 450 @ Pisa (10/05)

10. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 Operation Management Centre –located at CERN, coordinates operations and management –coordinates with other grid projects Core Infrastructure Centres –behave as single organisations –operate core services (VO specific and general Grid services) –develop new management tools –provide support to the Regional Operations Centres EGEE operations: OMC and CIC

11. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 EGEE operations: ROC Regional Operations Centre responsibilities and roles: –Testing (certification) of new middleware on a variety of platforms before deployment –Deployment of middleware releases + coordination + distribution inside the region –integration of ‘Local’ VO –Development of procedures and capabilities to operate the resources –First-line user support (GGUS) –Bring new resources into the infrastructure and support their operation –Coordination of integration of national grid infrastructures Provide resources for pre-production service –Germany/Switzerland: Distributed ROC

12. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 12 Collaborations EGEE closely collaborates with other projects, e.g. Flooding Crisis (CrossGrid) demonstrated at 3 rd EGEE conference in Athens –Simulation of flooding scenarios –Display in Virtual Reality –Optimize data transport  won prize for “best demo” Collaboration with Slowak Academy of Sciences

13. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 13 Ongoing collaborations –with non-EU partners: US, Israel, Russia, Korea, Taiwan…  MoU with the Chonnam–Kangnung–Sejong–Collaboration project (CKSC)  Strong relationship KISTI (Korea Institute of Science and Technology Information), developing into partnership for EGEE II –with other European projects, in particular:  GÉANT  DEISA  SEE-GRID –with non-European projects:  OSG: OpenScienceGrid (USA)  NAREGI (Japan)  International Grid Trust Federation EU-GridPMA joining with Asia-Pacific and American counterparts EGEE as incubator –18 recently submitted EU proposals supported –More proposals in next calls and national funding programmes EGEE as partner

14. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 14 From Phase I to II From 1st EGEE EU Review in February 2005: –“The reviewers found the overall performance of the project very good.” –“… remarkable achievement to set up this consortium, to realize appropriate structures to provide the necessary leadership, and to cope with changing requirements.” EGEE I –Large scale deployment of EGEE infrastructure to deliver production level Grid services with selected number of applications EGEE II –approved ! –Natural continuation of the project’s first phase –Emphasis on providing an infrastructure for e-Science  increased support for applications  increased multidisciplinary Grid infrastructure  more involvement from Industry –Extending the Grid infrastructure world-wide  increased international collaboration (Asia-Pacific is already a partner!)

15. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 15 t-infrastructure The training infrastructure and the Gilda testbed

16. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 16 The GILDA project (https://gilda.ct.infn.it)

17. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 17 The GILDA Test-bed (https://gilda.ct.infn.it/testbed.html) 15 sites in 3 continents !

18. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 18 The GILDA Services (https://gilda.ct.infn.it/testbed.html) Ready for gLite !

19. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 19 The GILDA Certification Authority (https://gilda.ct.infn.it/CA)

20. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 20 The GILDA Virtual Organization

21. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 21 The GILDA User Interface Plug&Play combined (https://gilda.ct.infn.it/UIPnPcomb/)

22. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 22 The GILDA Live User Interface (https://gilda.ct.infn.it/live-cd/)

23. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 23 The GILDA Video Tutorials (https://gilda.ct.infn.it/video.html)

24. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 24 Other components Local clusters for specialised training purposes –did LCG-2 and gLite installation courses using virtualised „Grid in a box“ –16 dual-CPU nodes, 1GB, 700 Mhz each CPU –up to 5 virtual images on each node –Xen –complete Grid created from virtualised components Laptops as training environment –provide pre-installed laptops to each student Knoppix – P&P Linux environment

25. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 25 Some Successes See press release: „EGEE battles malaria with Grid wisdom“ (over 46 million docked ligands) See press release: „EGEE makes rapid earth quake analysis possible“ (analysis of large indonesian earth quake 28.03.05 within 30 hours, showed that it was not an aftershock of the tsunami)

26. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 26 Conclusions Grids are a powerful new tool for science – as well as other fields Grid computing has been chosen by CERN and HEP as the most cost effective computing model Several other applications are already benefiting from Grid technologies (biomedical is a good example) Investments in grid projects are growing world-wide Europe is strong in the development of Grids also thanks to the success of EGEE and related projects Collaboration across national and international programmes is very important: –Grids are above all about collaboration at a large scale –Science is international and therefore requires an international computing infrastructure Large and versatile Grid training environment

27. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 27 Contacts EGEE Website http://www.eu-egee.org How to join http://public.eu-egee.org/join/ EGEE Project Office project-eu-egee-po@cern.ch Gilda UI PnP https://gilda.ct.infn.it/UIPnPcomb/ Gilda Live UI https://gilda.ct.infn.it/live-cd/

28. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Tutorial, Brisbane, 2.02.06 28 Thanks for the opportunity to present EGEE to all of you and for your kind attention!