1. Tony Doyle a.doyle@physics.gla.ac.uk “Executive Summary”, GridPP CB Meeting, IoP, 29 October 2002

2. Tony Doyle - University of Glasgow Excutive Summary Introduction Project Management Resources CERN DataGrid Applications Tier-1/A Tier-2 Dissemination Future Funding the Grid is starting to work Major: via Project Map now under control Small modifications Manpower OK. Hardware Making impact Engaged (posts filled + value added) Tier-A production mode Latent resources UK flagship project Preliminary planning

3. Tony Doyle - University of Glasgow Update (to 10/10/02) DataGrid Q7 Update ATLAS taskforce –v. useful, ongoing, other experiments Releases –Avoid “Big Bang” approach –Separate “Prod” & “Dev” 2 nd EU Review –1 month earlier Active in FP6 planning Domestic –Q7 delivered~150% contract –No major issues Applications Q7 Update Review of Project Map Milestones (DB, PC, NB – 9/10/02) –No major issues –Feedback to experiments initiated GridPP-LCG-DataGrid applications overlap e.g. persistency framework e.g. future milestones (via change notice)

4. Tony Doyle - University of Glasgow GridPP Overview EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA LCFG MDS deployment GridSite SlashGrid Spitfire… Applications (start-up phase) BaBar CDF/D0 (SAM) ATLAS/LHCb CMS (ALICE) UKQCD £17m 3-year project funded by PPARC through the e-Science Programme CERN - LCG (start-up phase) funding for staff and hardware... CERN DataGrid Tier - 1/A Applications Operations http://www.gridpp.ac.uk

5. Tony Doyle - University of Glasgow £17m++ 3-Year Project Five components –Tier-1/A = Hardware + CLRC ITD Staff –DataGrid = 15 DataGrid Posts + CLRC PPD Staff –Applications = 13 Experiments Posts (to interface middleware) –Operations = Travel (~100 people)+ Management +  Early Investment –CERN = 25 LCG posts + Tier-0 +  LTA

6. Tony Doyle - University of Glasgow Financial Profile

7. Tony Doyle - University of Glasgow Financial Breakdown

8. Tony Doyle - University of Glasgow Financial Profile TOTALFY2001FY2002FY2003FY2004 CERN £5,666,600£21,625£1,813,784£1,923,647£1,907,544 DataGrid £3,786,302£591,177£1,209,807£1,278,227£707,092 Tier-1/A £3,651,371£888,000£1,117,987£1,391,399£253,986 Applications £2,066,018£62,817£659,911£749,032£594,257 Operations £1,829,647£473,060£519,346£539,566£297,675 OC2 TOTAL £16,999,938£2,036,679£5,320,835£5,881,871£3,760,553 Estimated Breakdown by Financial Year Project Summary TOTALFY2001FY2002FY2003FY2004 CERN £5,666,600£0£1,239,021£2,282,111£2,145,468 DataGrid £3,786,302£591,177£1,209,807£1,278,227£707,092 Tier-1/A £3,674,009£888,000£742,987£1,766,399£276,624 Applications £2,077,645£91,846£661,304£738,557£585,938 Operations £1,794,159£443,060£507,695£523,688£319,716 OC3 TOTAL £16,998,715£2,014,083£4,360,813£6,588,981£4,034,838 Estimated Breakdown by Financial Year Project Summary Re-profile of CERN contribution and Tier-1/A increase in FY2002

9. Tony Doyle - University of Glasgow Financial Breakdown Reduced Spend in FY2002 (Increase in FY2003-04)

10. Tony Doyle - University of Glasgow Project Management - 7 Elements

11. Tony Doyle - University of Glasgow Summary (by Project Map areas) Grid success is fundamental for PP 1.CERN = LCG, Grid as a Service. 2.DataGrid = Middleware built upon Globus and Condor-G. Testbed 1 deployed. 3.Applications – complex, need to interface to middleware.  LHC Analyses – ongoing feedback/development.  Other Analyses have immediate requirements. Integrated using Globus, Condor, EDG/SAM tools 4.Infrastructure = Tiered computing to the physicist desktop:  Scale in UK? 1 PByte and 2,000 distributed CPUs  GridPP in Sept 2004 5.Integration = ongoing with UK e-science… 6.Dissemination Co-operation required with other disciplines/industry 7.Finances – under control, but need to start looking to Year 4.. Year 1 was a good starting point. First Grid jobs have been submitted.. Looking forward to Year 2. Web services ahead.. but Experiments will define whether this experiment is successful (or not)

12. Tony Doyle - University of Glasgow LCG Creation

13. Tony Doyle - University of Glasgow LCG Level 1 Milestones 2002200520042003 Q1 Q2 Q3 Q4 Hybrid Event Store available for general users Distributed production using grid services First Global Grid Service (LCG-1) available Distributed end-user interactive analysis Full Persistency Framework LCG-1 reliability and performance targets “50% prototype” (LCG-3) available LHC Global Grid TDR applications grid

14. Tony Doyle - University of Glasgow Robust? Development Infrastructure CVS Repository –management of DataGrid source code –all code available (some mirrored) Bugzilla Package Repository –public access to packaged DataGrid code Development of Management Tools –statistics concerning DataGrid code –auto-building of DataGrid RPMs –publishing of generated API documentation –latest build = Release 1.2 (August 2002) 140506 Lines of Code 10 Languages (Release 1.0)

15. Tony Doyle - University of Glasgow ComponentETTUTITNINFFMBSD Resource Broker vvvl Job Desc. Lang. vvvl Info. Index vvvl User Interface vvvl Log. & Book. Svc. vvvl Job Sub. Svc. vvvl Broker Info. API vvl SpitFire vvl GDMP l Rep. Cat. API vvl Globus Rep. Cat. vvl ETTExtensively Tested in Testbed UTUnit Testing ITIntegrated Testing NINot Installed NFFSome Non-Functioning Features MBSome Minor Bugs SDSuccessfully Deployed ComponentETTUTITNINFFMBSD Schema vvvl FTree vvl R-GMA vvl Archiver Module vvl GRM/PROVE vvl LCFG vvvl CCM vl Image Install. vl PBS Info. Prov. vvvl LSF Info. Prov. vvl ComponentETTUTITNINFFMBSDSD SE Info. Prov. Vvl File Elem. Script l Info. Prov. Config. Vvl RFIO Vvl MSS Staging l Mkgridmap & daemon vl CRL update & daemon vl Security RPMs vl EDG Globus Config. vvl ComponentETTUTITNINFFMBSD PingER vvl UDPMon vvl IPerf vvl Globus2 Toolkit vvl Robust? Software Evaluation

16. Tony Doyle - University of Glasgow Robust? Middleware Testbed(s) Validation/ Maintenance =>Testbed(s) EU-wide development

17. Tony Doyle - University of Glasgow Robust? Code Development Issues Reverse Engineering (C++ code analysis and restructuring; coding standards) => abstraction of existing code to UML architecture diagrams Language choice (currently 10 used in DataGrid) –Java = C++ - - “features” (global variables, pointer manipulation, goto statements, etc.). –Constraints (performance, libraries, legacy code) Testing (automation, object oriented testing) Industrial strength? OGSA-compliant? O(20 year) Future proof?? ETTExtensively Tested in Testbed UTUnit Testing ITIntegrated Testing NINot Installed NFFSome Non-Functioning Features MBSome Minor Bugs SDSuccessfully Deployed

18. Tony Doyle - University of Glasgow Dissemination (to other e-scientists) e-Science ‘All Hands’ Meeting held at Sheffield, 2-4 September 2002 –~ 300 people in total –~ 19 GridPP People attended –~ 13 GridPP ‘Abstracts’ accepted (total ~100) –~ 10 GridPP Posters displayed – 4 GridPP Invited talks – 3 GridPP Demonstrations GridPP Web Page Requests

19. Tony Doyle - University of Glasgow GridPP Posters ATLASSAM OptorSimGridPPTier-1/AScotGrid BaBarLHCbCMS Storage 10 Posters for NeSC Opening and e-Science All Hands Meeting

20. Tony Doyle - University of Glasgow t0t0 t1t1 Web Pages using Certificates and GridSite

21. Tony Doyle - University of Glasgow TestBed Status 28 Oct 2002 15:22

22. Tony Doyle - University of Glasgow Tier-1/A: Year of Growth GridPP Certificates BaBar Use

23. Tony Doyle - University of Glasgow Tier-1/A development In the next six months the main targets will be: Integration within the Grid (or Grids). Improving monitoring and error-handling. Developing support structure including longer hours of cover. Optimising the service for LHC Data Challenges. Completing next year’s hardware procurement. Migration to UK e-Science CA (start October 30 th ) Beyond this, we recognise support of the Tier-1/A centre as our highest priority for future funding

24. Tony Doyle - University of Glasgow Tier-1 and -2 Centre Resources Estimated resources at end of 2003 (from Institute returns) Number of CPUs Amount of Disk (TB) Amount of Tape (TB) London1252 76 8 Northern201511333 Southern 392 2920 ScotGrid 154 35 0 Number of CPUs Amount of Disk (TB) BaBar110829%7630% CDF45312%3915% D03208% 83% ATLAS94725%7228% CMS3048% 94% LHCb54314%4016% Tier-1 Tier-1: 600 CPUs + 150 TB Tier-2:  (4000 CPUs + 200 TB)

25. Tony Doyle - University of Glasgow Tier-2 Support We have: Testbed rollout plan (GridPP-TB-02-UKRollout) Testbed Support Mailing List and weekly phone conference Experienced System Managers creating a Grid and responding to a rapid Grid deployment cycle A (Rolling Grant) environment where System Managers are not the highest priority We require: Four additional System Manager posts in third year (within current resources) Higher priority for deployment and support of Tier-2 centres (with future resources) Fabric Management Tools (GridPP and others) leading to reduction in System Manager workload

26. Tony Doyle - University of Glasgow GridPP – Achievements and Issues 1st Year Achievements Complete Project Map –Applications: Middleware: Hardware Fully integrated with EU DataGrid, LCG and SAM Projects Rapid middleware deployment /testing Integrated US-EU applications development e.g. BaBar+EDG Roll-out document for all sites in the UK (Core Sites, Friendly Testers, User Only). Testbed up and running at 16 sites in the UK Tier-1 Deployment 250 GridPP Certificates issued (personal + server) First significant use of Grid by an external user (LISA simulations) in May 2002 Web page development (GridSite) Issues for Year 2 Status: 28 Oct 2002 15:22 GMT – monitor and improve testbed deployment efficiency short (10 min) and long-term (monthly)… Importance of EU-wide development of middleware and integration with US-led approach Integrated Testbed for use/testing by all applications Common “integration” layer between middleware and application software Integrated US-EU applications development Tier-1 Grid Production Mode Tier-2 Definitions and Deployment Integrated Tier-1 + Tier-2 Testbed Transfer to UK e-Science CA Integration with other UK projects e.g. AstroGrid, MyGrid… Publication of YOUR work

27. Tony Doyle - University of Glasgow GridPP User Interface Pulling it all together… GridPP Web Links 2003?: Demonstration elements: Gridsite, GUIDO, R-GMA,… Short and Long-Term Monitoring, Local and WAN Monitoring.

28. Tony Doyle - University of Glasgow SWOT Analysis Strengths –Excellent people, sense of community, well resourced, well respected, integrated into EU development, significant role in US development, good website Weaknesses –Slow to get going, have not convinced the UK PP community yet, limited industry involvement Opportunities –Further funding, potential for wide impact (talks, demos etc), sharing of resources by all experiments Threats –EDG software delays, UK PP community no longer support us

29. Tony Doyle - University of Glasgow Reporting to Oversight (and Steering) Committee Exceeding 1 st year targets Delivering.. and seen to be delivering via the Project Map 1 st year Grid and PP success

30. Tony Doyle - University of Glasgow UK Grid Future Priorities Continue supporting Tier-1/A staff Continue ramp up of Tier-1/A hardware –UK leading role in computing infrastructure for LHC Support for Tier-2 staff –Complementary to University funding Continued support for Applications development –Beyond middleware data-handling interfaces? –As part of rolling grant programme? Continued support for Middleware development –including Framework VI EGEE project [DataGrid’] Ramp up of Tier-2 hardware –available via University SRIF/JREI/future funding? Continued support of CERN staff Continued ramp up of CERN hardware ALL of these are required to address the LHC Computing Challenge