1. Slide 1 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Steve Lloyd Queen Mary, University of London Grid Brokering Meeting December 2006

2. Slide 2 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 19 UK Universities, CERN and CCLRC (RAL & Daresbury) Funded by PPARC: GridPP1 2001-2004 From Web to Grid GridPP2 2004-2007 From Prototype to Production GridPP3 2007-2011 (proposed) From Production to Exploitation Who are GridPP? Developed a working, highly functional Grid

3. Slide 3 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 Why? - The CERN Large Hadron Collider - LHC 4 Large Experiments The worlds most powerful particle accelerator – Starting 2007/8 ~100,000,000 electronic channels 800,000,000 proton-proton interactions per second 0.0002 Higgs per second 10 PBytes of data a year (10 Million GBytes = 14 Million CDs)

4. Slide 4 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 International Context LHC Computing Grid (LCG) Grid Deployment Project for the Large Hadron Collider (LHC) EU Enabling Grids for E-SciencE (EGEE) 2004-2008 Grid Deployment Project for all disciplines GridPP LCG EGEE GridPP is part of EGEE and LCG (currently the largest Grid in the world) UK National Grid Service UKs core production computational and data Grid Open Science Grid (USA) Science applications from HEP to biochemistry Nordugrid (Scandinavia) Grid Research and Development collaboration UK part of LCG PP part of EGEE

5. Slide 5 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 What is (gLite) Middleware? MIDDLEWARE CPU Disks, CPU etc PROGRAMS OPERATING SYSTEM Word/Excel Email/Web Your Program Games CPU Cluster User Interface Machine CPU Cluster CPU Cluster Resource Broker Information Service Single PC Grid Disk Server Your Program Middleware is the Operating System of a distributed computing system Replica Catalogue Bookkeeping Service

6. Slide 6 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Middleware Development Workload Management Storage Interfaces Network Monitoring SecurityInformation Services Grid Data Management

7. Slide 7 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 The EGEE Grid Status Worldwide 207 Sites 48 Countries 32,823 CPUs 13.1 PB Disk 6,946 Years of CPU time UK 21 Sites 6306 CPUs 131 TB Disk 1,996 Years of CPU time

8. Slide 8 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 UK Tier-1 and Tier-2 Sites Mostly funded by HEFCE Tier-1 CPU (KSI2K)Disk (TB) Brunel1161.4 Imperial3688.4 QMUL120918.0 RHUL1638.8 UCL1211.1 Lancaster48472.0 Liverpool5922.8 Manchester1152145.0 Sheffield1832.0 Durham994.0 Edinburgh1160.0 Glasgow471.6 Birmingham2239.3 Bristol123.8 Cambridge404.4 Oxford15027.0 RAL PPD3206.4 London197737.7 NorthGrid2411221.8 ScotGrid15765.6 SouthGrid74550.9 Total Tier-25290376.0 Tier-11034180.0 Normally most recent gLite versions. Still running the LCG RB and CE (not gLite). SEs being upgraded to SRM 2.2.

9. Slide 9 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 What you need to use the Grid 1. Get a digital certificate (UK Certificate Authority) 2. Join a Virtual Organisation (VO) 3. Get access to a local User Interface Machine (UI) and copy your files and certificate there Authentication – who you are Authorisation – what you are allowed to do 4. Write some Job Description Language (JDL) and scripts to wrap your programs ############# HelloWorld.jdl ################# Executable = "/bin/echo"; Arguments = "Hello welcome to the Grid "; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; #########################################

10. Slide 10 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 How it works Job Description UI Machine Resource Broker Input Sandbox Script you want to run Other files (Job Options, Source...) Storage Element Compute Element Storage Element Grid Proxy Certificate Output Sandbox Output files (Plots, Logs...) Input Data Output Data Job Output Sandbox

11. Slide 11 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 What is it good for? Problems that are highly parallelizable Problem Grid Solution Input data is independent e.g. Images: A=2 B=3 A=3 B=3 A=2 B=4 Simulation using different parameters: Not so good for closely coupled problems These pieces may be independent These pieces will have to interact

12. Slide 12 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Outreach Current GridPP Outreach Team: 0.5 FTE Dissemination Officer 1.0 FTE Events Officer Proposed GridPP Outreach Team (GridPP3): 1.0 FTE Dissemination Officer 0.5 FTE Industrial Liaison Officer 0.5 FTE (User) Documentation GridPP Website Events and Demonstrations Press Releases and News Items Dissemination Awards (e.g. Schools) Posters, Brochures, Papers Expand Industrial Liaison Technology Transfer Steering Group Improved User Documentation Training e.g. Use of Portal

13. Slide 13 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP and Industry Use of our Grid Access to the Certificate Authority Security tools GridSite Secure Web Toolkit R-GMA Information System APEL Accounting tools Help getting PPARC funding What We Have to Offer: Current Involvement: GridPP has a collaboration with IBM through ScotGrid and R-GMA. Specific sites also have close relationships with various industrial suppliers. One PPARC MiniPPIPS with a startup company.

14. Slide 14 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 Cost Recovery Survey GridPP attitudes to allowing commercial access to resources BirminghamKeen to share if not too time consuming Cambridge Concerned about organisational issues but happy for limited access GlasgowWill allow access for limited time OxfordConcerned about organisational issues Queen Mary Prefer to offer full technical and research support rather than dumb access Royal HollowayConcerned about diversion of effort Generally positive as long as not too time consuming and (University) bureaucracy can be overcome

15. Slide 15 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 Further Information … http://www.gridpp.ac.uk RSS News feed