1. Jürgen Knobloch/CERN Slide 1 A Global Computer – the Grid Is Reality by Jürgen Knobloch October 31, 2007

2. Jürgen Knobloch/CERN Slide 2 LHC gets ready …

3. … what about Computing? The Challenge Starting to grasp the scope Going for the Grid Are we there? What other use is the Grid? Where do we go from here? Jürgen Knobloch/CERN Slide 3

4. Jürgen Knobloch/CERN Slide 4 The LHC Computing Challenge Signal/Noise 10 -9 Data volume –High rate * large number of channels * 4 experiments  15 PetaBytes of new data each year Compute power –Event complexity * Nb. events * thousands users  100 k of (today's) fastest CPUs Worldwide analysis & funding –Computing funding locally in major regions & countries –Efficient analysis everywhere  GRID technology

5. Jürgen Knobloch/CERN Slide 5 Timeline LHC Computing 199419951996199719981999200020012002200320042005200620072008 LHC approved ATLAS & CMS approved ALICE approved LHCb approved “Hoffmann” Review 7x10 7 MIPS 1,900 TB disk ATLAS (or CMS) requirements for first year at design luminosity ATLAS&CMS CTP 10 7 MIPS 100 TB disk LHC start Computing TDRs 55x10 7 MIPS 70,000 TB disk (140 MSi2K)

6. CSC 2007 LCG Evolution of CPU Capacity at CERN SC (0.6GeV) PS (28GeV) ISR (300GeV) SPS (400GeV) ppbar (540GeV) LEP (100GeV) LEP II (200GeV) LHC (14 TeV) Costs (2007 Swiss Francs) Includes infrastructure costs (comp.centre, power, cooling,..) and physics tapes Slide from Les Robertson

7. Requirements Match Jürgen Knobloch/CERN Slide 7 Tape & disk requirements: >10 times CERN possibility

8. Options as seen in 1996 Jürgen Knobloch/CERN Slide 8

9. Jürgen Knobloch/CERN Slide 9 Timeline Grids Data Challenges First physics Cosmics GRID 3 EGEE 1 LCG 1 Service Challenges EU DataGrid GriPhyN, iVDGL, PPDG EGEE 2 OSG LCG 2 EGEE 3 199419951996199719981999200020012002200320042005200620072008 WLCG

10. Jürgen Knobloch/CERN Slide 10 WLCG Collaboration The Collaboration –4 LHC experiments –~250 computing centres –12 large centres (Tier-0, Tier-1) –38 federations of smaller “Tier-2” centres –Growing to ~40 countries –Grids: EGEE, OSG, Nordugrid Technical Design Reports –WLCG, 4 Experiments: June 2005 Memorandum of Understanding –Agreed in October 2005 Resources –5-year forward look

11. Jürgen Knobloch/CERN Slide 11 CPU & Disk Requirements 2006 CPUDisk CERN: ~ 10%

12. Events at LHC Jürgen Knobloch/CERN Slide 12

13. Trigger and Data Acquisition Jürgen Knobloch/CERN Slide 13

14. Tier-0 Recording Jürgen Knobloch/CERN Slide 14

15. Tier-0 -1 -2 Jürgen Knobloch/CERN Slide 15

16. Jürgen Knobloch/CERN Slide 16 Centers around the world form a Supercomputer The EGEE and OSG projects are the basis of the Worldwide LHC Computing Grid Project WLCG Inter-operation between Grids is working!

17. Jürgen Knobloch/CERN Slide 17 Middleware Security –Virtual Organization Management (VOMS) –MyProxy Data management –File catalogue (LFC) –File transfer service (FTS) –Storage Element (SE) –Storage Resource Management (SRM) Job management –Work Load Management System(WMS) –Logging and Bookeeping (LB) –Computing Element (CE) –Worker Nodes (WN) Information System –Monitoring: BDII (Berkeley Database Information Index), RGMA (Relational Grid Monitoring Architecture)  aggregate service information from multiple Grid sites, now moved to SAM (Site Availability Monitoring) –Monitoring & visualization (Griview, Dashboard, Gridmap etc.)

18. Moore Delivered for CPU & Disk Jürgen Knobloch/CERN Slide 18 Slides from 1996 Expectations fulfilled!

19. Network was a Concern … Jürgen Knobloch/CERN Slide 19 We are now here

20. Jürgen Knobloch/CERN Slide 20 LHCOPN Architecture

21. Jürgen Knobloch/CERN Slide 21 Networking

22. Data Transfer out of Tier-0 Jürgen Knobloch/CERN Slide 22

23. Jürgen Knobloch/CERN Slide 23 Site reliability

24. Site Reliability Tier-2 Sites 83 Tier-2 sites being monitored Targets – CERN + Tier-1s Before July July 07Dec 07 Avg.last 3 months Each site88%91%93%89% 8 best sites 88%93%95%93%

25. Jürgen Knobloch/CERN Slide 25 ARDA Dashboard

26. Gridmap Jürgen Knobloch/CERN Slide 26

27. Increasing workloads 27 EGEE'07; 2nd October 2007 32% non-LHC

28. Many Grid Applications At present there are about 20 applications from more than 10 domains on the EGEE Grid infrastructure –Astronomy & Astrophysics - MAGIC, PlanckPlanck –Computational Chemistry –Earth Sciences - Earth Observation, Solid Earth Physics, Hydrology, Climate –Fusion –High Energy Physics - 4 LHC experiments (ALICE, ATLAS, CMS, LHCb) BaBar, CDF, DØ, ZEUSATLAS –Life Sciences - Bioinformatics (Drug Discovery, GPS@, Xmipp_MLrefine, etc.) –Condensed Matter Physics –Computational Fluid Dynamics –Computer Science/Tools –Civil Protection –Finance (through the Industry Task Force) Jürgen Knobloch/CERN Slide 28

29. Grid Applications Jürgen Knobloch/CERN Slide 29 Medical Metadata Seismology Chemistry Astronomy Fusion Particle Physics

30. Available Infrastructure EGEE: ~250 sites, >45000 CPU OSG: ~ 15 sites for LHC, > 10000 CPU ¼ of the resources are contributed by groups external to the project ~>25 k simultaneous jobs 30 EGEE'07; 2nd October 2007

31. Ramp-up Needed for Startup Jul Sep Apr -07 -07 -08 3.7 X Sep Jul Apr -06 -07 -08 Sep Jul Apr -06 -07 -08 3 X 2.9 X Sep Jul Apr -06 -07 -08 Sep Jul Apr -06 -07 -08 2.3 X 3.7 X target usage usage pledge installed

32. Jürgen Knobloch/CERN Slide 32 3D - Distributed Deployment of Databases for LCG ORACLE Streaming with Downstream Capture (ATLAS, LHCb) SQUID/FRONTIER Web caching (CMS)

33. The Next Step Jürgen Knobloch/CERN Slide 33

34. EGI – European Grid Initiative Jürgen Knobloch/CERN Slide 34 www.eu-egi.org EGI Design Study proposal to the European Commission (started Sept 07) Supported by 37 National Grid Initiatives (NGIs) 2 year project to prepare the setup and operation of a new organizational model for a sustainable pan-European grid infrastructure after the end of EGEE-3

35. Jürgen Knobloch/CERN Slide 35 Tier-1 Centers: TRIUMF (Canada); GridKA(Germany); IN2P3 (France); CNAF (Italy); SARA/NIKHEF (NL); Nordic Data Grid Facility (NDGF); ASCC (Taipei); RAL (UK); BNL (US); FNAL (US); PIC (Spain) The Grid is now in operation, working on: reliability, scaling up, sustainability