1. David Britton, 28/7/03 Imperial, College GridPP1 Overview David Britton, 28/7/2003 Imperial College

2. David Britton, 28/7/03 Imperial, College Project Overview

3. David Britton, 28/7/03 Imperial, College Institutes GridPP GridPP in Context Core e-Science Programme GridPP CERN LCG Tier-1/A Middleware Experiments Tier-2 Grid Support Centre EGEE Not to scale! Apps Dev Apps Int

4. David Britton, 28/7/03 Imperial, College The Project Map

5. David Britton, 28/7/03 Imperial, College LHC Computing Grid (LCG) Help create LCG project Components shared by LHC experiments; e.g. POOL Prototyping the CERN Tier0/1 center. (Scalability issue) Requirements; Monitoring; recommendations. Deploying and operating the LHC Computing Grid 6.2* 39.2 25.0 15.3 5.3 TOTAL 91.1 GridPP 24.0 * LCG management FTE in 2002

6. David Britton, 28/7/03 Imperial, College LHC Computing Grid LCG-1 Release Ref.milestone descriptiontarget date M1.1First Global Service (LCG-1) - Initial Availability This comprises the construction and commissioning of the first LHC Computing service suitable for physics usage. The service must offer reliably 24x7 availability to all four LHC experiments and include some ten Regional Centers from Europe, North America and Asia. The milestone includes delivery of the associated Technical Design, containing description of the architecture and functionality and quantified technical specifications of performance (capacity, throughput, reliability, availability). It must also include middleware specifications, agreed as a common toolkit by Europe and US. The service must prove functional, providing a batch service for event production and analysis of the simulated data set. For the milestone to be met, operation must be sustained reliably during a 7 day period; stress tests and user productions will be executed, with a failure rate below 1%. July 2003

7. David Britton, 28/7/03 Imperial, College Certification and distribution process established Middleware package – components from – –European DataGrid (EDG) –US (Globus, Condor, PPDG, GriPhyN) the Virtual Data Toolkit Agreement reached on principles for registration and security RAL to provide the initial grid operations centre FZK to operate the call centre Initial service being deployed now to 10 centres US, Europe, Asia Expand to other centres as soon as the service is stable LCG Academia Sinica Taipei, BNL, CERN, CNAF, FNAL, FZK, IN2P3 Lyon, Moscow State Univ., RAL, Univ. Tokyo LHC Computing Grid Service

8. David Britton, 28/7/03 Imperial, College Resources committed for 1Q04 LCG Service - Target for 2004 Establish the LHC Grid as a service for data challenges, and computing model evaluation the basic infrastructure for distribution, coordination, operation building collaboration between the people who manage and operate the Regional Centres integrating the majority of the resources in Regional Centres needed for the LHC data challenges of 2004 reliability – this is the priority – and essential for …. providing measurable value for experiments production teams and attracting end-users to the grid CPU (kSI2K) Disk TB Support FTE Tape TB CERN70016010.01000 Czech Repub 6052.55 France4208110.2540 Germany207409.062 Holland12434.012 Italy5076016.0100 Japan220455.0100 Poland8695.028 Russia1203010.040 Taiwan220304.0120 Spain150304.0100 Sweden179402.040 Switzerland2652.040 UK165622617.3295 USA80117615.51741 Total56001169120.04223 LCG

9. David Britton, 28/7/03 Imperial, College European DataGrid (EDG) EDG 2.0EDG 2.1

10. David Britton, 28/7/03 Imperial, College European DataGrid UK Roles Quality Assurance Representative0.5 Deputy Leader, (Iteam)2.0 Group Leader, Deputy Leader, Iteam, ATF, QA3.0 + 3.0EU 2.0 Group Leader, Deputy Leader, Iteam, ATF, QA3.0 + 1.0EU CA Group Manager3.0 Deputy Leader, Security Group Leader, ATF3.7* * Includes Security Group Leader4.0 FTE

11. David Britton, 28/7/03 Imperial, College European DataGrid – WP1 WP1 Workload Management Deploy and support Resource Brokers at IC

12. David Britton, 28/7/03 Imperial, College European DataGrid – WP1 WP1 Workload Management Logging & Bookkeeping Server Saving of job checkpoint state state.saveState() Job Job checkpoint states saved in the LB server Retrieval of job checkpoint u Also used (even in rel. 1) as repository of job status info u Already proved to be robust and reliable u The load can be distributed between multiple LB servers, to address scalability problems Job Checkpointing in EDG2.0

13. David Britton, 28/7/03 Imperial, College European DataGrid – WP2 WP2 Data Management Storage Element Replica Manager Replica Location Service Replica Optimization Service Replica Metadata Catalog SE Monitor Network Monitor Information Service Resource Broker User Interface or Worker Node Storage Element Virtual Organization Membership Service UK Contributions RM in EDG2.0

14. David Britton, 28/7/03 Imperial, College European DataGrid – WP3 WP3 Information and Monitoring Services UK Product RGMA in EDG2.0 R-GMA Consumers LDAP InfoProvider GIN LDAP Server LDAP InfoProvider Stream Producer GIN Consumer (CE) Consumer (SE) Consumer (SiteInfo) RDBMS Latest Producer GOUT ConsumerA PI Archiver (LatestProducer) Stream Producer R-GMA GLUE Schema Push mode Updates every 30s >70 sites (simul.)

15. David Britton, 28/7/03 Imperial, College European DataGrid – WP4 WP4 Fabric Management UK Product LCFG configuration software from Univ. Edinburgh was used from Month 12 onwards of the EDG project. Newer version, LCFGng, in EDG-2.0 and in LCG-1

16. David Britton, 28/7/03 Imperial, College European DataGrid – WP5 WP5 Mass Storage Management SE in EDG2.0 Client App API SE HTTP library SSL socket library AXIS SE core SE Java Client Tomcat u The design of the SE follows a layered model with a central core handling all paths between client and MSS. Core is flexible and extensible making it easy to support new protocols, features and MSS Client App Java Client API C Client RMANMAN Apache Web Service UK Product

17. David Britton, 28/7/03 Imperial, College European DataGrid – WP6 WP6 Testbed EDG Application testbed: More than 40 sites More than 1000 CPUs 5 Terabyte of storage Testbed successfully demonstrated during 2 nd EU review in Feb 2003 Large UK participation

18. David Britton, 28/7/03 Imperial, College European DataGrid – WP7 WP7 Network Services

19. David Britton, 28/7/03 Imperial, College Applications

20. David Britton, 28/7/03 Imperial, College Applications: GANGA Underlying GRID services (GLOBUS toolkit) GRID middleware (EDG, PPDG,…) Application specific layer (Athena/Gaudi, …) GUI interface OS and Network services Multilayered Grid architecture GANGA A common interface to the Grid for Atlas and LHCb Server Bookkeeping DB Production DB EDG UI PYTHON SW BUS XML RPC server XML RPC module GANGA Module OS Module Athena\ GAUDI GaudiPython PythonROOT PYTHON SW BUS GUI Job Configuration DB Remote user (client) Local Job DB LAN/WAN GRID LRMS

21. David Britton, 28/7/03 Imperial, College Applications: CHEP03 Papers ATCom GANGA DIRAC Grid Tests Three papers Six papers Total of 14 Application papers (plus 7 middleware papers).

22. David Britton, 28/7/03 Imperial, College Applications: CMS GUIDO portal demonstrated at All-Hands 2002. New, generic version to be unveiled this year. Adding RGMA to BOSS

23. David Britton, 28/7/03 Imperial, College Applications: CDF/D0

24. David Britton, 28/7/03 Imperial, College Applications: CDF/D0 D0 plan to reprocess 22 TB of DST using SAMGRID between Sep 1 st and Nov 25th

25. David Britton, 28/7/03 Imperial, College Tier-1/A

26. David Britton, 28/7/03 Imperial, College Tier-2

27. David Britton, 28/7/03 Imperial, College

28. David Britton, 28/7/03 Imperial, College Testbed

29. David Britton, 28/7/03 Imperial, College All testbed sites can be said to be truly on a Grid by virtue of their registration in a comprehensive resource information publication scheme, their accessibility via a set of globally enabled resource brokers, and the use of one of the first scalable mechanisms to support distributed virtual communities (VOMS). There are few such Grids in operation in the World today.

30. David Britton, 28/7/03 Imperial, College Data Challenges

31. David Britton, 28/7/03 Imperial, College LHCb Data Challenge: 1/3 of events produced in the UK

32. David Britton, 28/7/03 Imperial, College ATLAS DC1 Phase 2 UK largest producer

33. David Britton, 28/7/03 Imperial, College Total number of MC events produced/processed in millions for Q1 and Q2 in 2002 CMS Data Challenge

34. David Britton, 28/7/03 Imperial, College Interoperability and Dissemination

35. David Britton, 28/7/03 Imperial, College

36. David Britton, 28/7/03 Imperial, College Resources

37. David Britton, 28/7/03 Imperial, College Summary Status: At the midpoint of GridPP1, 95 out of 182 tasks (52%) have been successfully completed. The LCG-1 release is imminent; a landmark moment. Achievements: A major factor in establishing the LCG project Leadership roles within 5 of the 8 (applicable) EDG workpackages. Significant middleware development. Deployed the UKs largest testbed (16 sites and >100 servers). Integration with EU-wide programme and linked to Worldwide efforts. Active Tier-1/A production centre, meeting demands. Tier-2 resources identified and a structure being developed. Established productive links with the experiment applications. Responded to the LHC Computing Challenge: Defined and initiated a programme that will be the basis for LHC computing.