1. 1 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department LHC Computing and Grids Frédéric Hemmer Deputy IT Department Head January 23, 2007 For Professor Donald Bowen Dean of the College of Science United Arab Emirates University

2. 2 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department The accelerator generates 40 million particle collisions (events) every second at the centre of each of the four experiments’ detectors The LHC Accelerator

3. 3 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department LHC DATA This is reduced by online computers that filter out a few hundred “good” events per sec. Which are recorded on disk and magnetic tape at 100-1,000 MegaBytes/sec ~15 PetaBytes per year for all four experiments

4. 4 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department The LHC Data Challenge The accelerator will be completed in 2007 and run for 10-15 years Experiments will produce about 15 Million Gigabytes of data each year (about 20 million CDs!) LHC data analysis requires a computing power equivalent to ~100,000 of today's fastest PC processors Requires many cooperating computer centres, as CERN can only provide ~20% of the capacity

5. 5 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Solution: the Grid Use the Grid to unite computing resources of particle physics institutes around the world The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations The Grid is an infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe

6. 6 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department LCG Service Hierarchy Tier-0 – the accelerator centre Data acquisition & initial processing Long-term data curation  Data Distribution to Tier-1 centres Canada – Triumf (Vancouver) France – IN2P3 (Lyon) Germany –Karlsruhe Italy – CNAF (Bologna) Netherlands – NIKHEF/SARA (Amsterdam) Nordic countries – distributed Tier-1 Spain – PIC (Barcelona) Taiwan – Academia SInica (Taipei) UK – CLRC (Oxford) US – FermiLab (Illinois) – Brookhaven (NY) Tier-1 – “online” to the data acquisition process  high availability Managed Mass Storage –  grid-enabled data service  All re-processing passes Data-heavy analysis National, regional support Tier-2 – ~100 centres in ~40 countries Simulation End-user analysis – batch and interactive  Services, including Data Archive and Delivery, from Tier-1s

7. 7 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department CPU DiskTape Distribution of Computing Services

8. 8 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department LHC Computing Grid Project - a Collaboration The physicists and computing specialists from the LHC experiments The national and regional projects in Europe and the US that have been developing Grid middleware The regional and national computing centres that provide resources for LHC The research networks Researchers Computer Scientists & Software Engineers Service Providers Building and operating the LHC Grid – a global collaboration between

9. 9 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department The Grid used by CERN and its partners The EGEE and OSG projects are the basis of the Worldwide LHC Computing Grid Project

10. 10 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department

11. 11 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department The new European Network Backbone LCG working group with Tier-1s and national/ regional research network organisations New GÉANT 2 – research network backbone  Strong correlation with major European LHC centres Swiss PoP at CERN

12. 12 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department LCG has been the driving force for the European multi- science Grid EGEE (Enabling Grids for E-sciencE) EGEE is now a global effort, and the largest Grid infrastructure worldwide Co-funded by the European Commission (~130 M€ over 4 years) EGEE already used for >20 applications, including… Impact of the LHC Computing Grid in Europe Medical Imaging Education, Training Bio-informatics

13. 13 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department The EGEE Project Infrastructure operation Currently includes >200 sites across 40 countries Continuous monitoring of grid services & automated site configuration/management http://gridportal.hep.ph.ic.ac.uk/rtm/launch_frame.html Middleware Production quality middleware distributed under business friendly open source licence User Support - Managed process from first contact through to production usage Training Documentation Expertise in grid-enabling applications Online helpdesk Networking events (User Forum, Conferences etc.) Interoperability Expanding interoperability with related infrastructures

14. 14 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Status ~17.5 million jobs run (6450 cpu-years) in 2006; Workloads of the “other VOs” start to be significant – approaching 8- 10K jobs per day; and 1000 cpu-months/month one year ago this was the overall scale of work for all VOs ~17.5 million jobs run (6450 cpu-years) in 2006; Workloads of the “other VOs” start to be significant – approaching 8- 10K jobs per day; and 1000 cpu-months/month one year ago this was the overall scale of work for all VOs

15. 15 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department EGEE Resources Region #countries #sites#cpu #cpu DoW disk (TB) CERN0178001800 1000* UK/I223730920102410 Italy127333622801350 France11037151252 1300* De/CH21332371852 280* Northern Europe61626551860200 SW Europe2131125898 200* SE Europe8261286118933 Central Europe7211759116390 Russia11551544552 Asia-Pacific8191239751120 North America282973-300 Totals4019236949202657335 PPS14242517-- * Estimates taken from reporting as IS publishes total MSS space

16. 16 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Use of the EGEE Infrastructure >20k jobs running simultaneously

17. 17 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Use for massive data transfer Large LHC experiments now transferring ~ 1PB/month each

18. 18 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Site availability – SAM

19. 19 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department EGEE: > 180 sites, 40 countries > 24,000 processors, ~ 5 PB storage EGEE Grid Sites : Q1 2006 sites CPU EGEE: Steady growth over the lifetime of the project

20. 20 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Applications on EGEE More than 20 applications from 7 domains Astrophysics MAGIC, Planck Computational Chemistry Earth Sciences Earth Observation, Solid Earth Physics, Hydrology, Climate Financial Simulation E-GRID Fusion Geophysics EGEODE High Energy Physics 4 LHC experiments (ALICE, ATLAS, CMS, LHCb) BaBar, CDF, DØ, ZEUS Life Sciences Bioinformatics (Drug Discovery, GPS@, Xmipp_MLrefine, etc.) Medical imaging (GATE, CDSS, gPTM3D, SiMRI 3D, etc.) Multimedia Material Sciences …

21. 21 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Example: EGEE Attacks Avian Flu EGEE used to analyse 300,000 possible potential drug compounds against bird flu virus, H5N1. 2000 computers at 60 computer centres in Europe, Russia, Taiwan, Israel ran during four weeks in April - the equivalent of 100 years on a single computer. Potential drug compounds now being identified and ranked Neuraminidase, one of the two major surface proteins of influenza viruses, facilitating the release of virions from infected cells. Image Courtesy Ying-Ta Wu, AcademiaSinica.

22. 22 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Example: Geocluster industrial application The first industrial application successfully running on EGEE Developed by the Compagnie Générale de Géophysique (CGG) in France, doing geophysical simulations for oil, gas, mining and environmental industries. EGEE technology helps CGG to federate its computing resources around the globe.

23. 23 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department EU projects related to EGEE

24. 24 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department Evolution EGEE EGEE-II EDG EGEE-III European e-Infrastructure Coordination Testbeds Utility Service Routine Usage

25. 25 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department CERN openlab Concept Partner/contributor sponsors latest hardware, software and brainware (young researchers) CERN provides experts, test and validation in Grid environment Partners: 500’000 €/ year, 3 years Contributors: 150’000 €, 1 year Current Activities Platform competence centre Grid interoperability centre Security activities Joint events F-Secure contributes in the fields of malware protection, anti-spyware, intrusion detection and intrusion prevention with a particular focus on client security and mail server security. Stonesoft also contributes in the fields intrusion detection and intrusion prevention with a particular focus on combining events form network and client level security systems. The Helsinki Institute of Physics (HIP) was instrumental in the setting-up of the collaboration

26. 26 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department