Presentation is loading. Please wait.

Presentation is loading. Please wait.

David Britton, 2/9/03 Imperial, College GridPP Project Overview David Britton, Imperial College.

Similar presentations


Presentation on theme: "David Britton, 2/9/03 Imperial, College GridPP Project Overview David Britton, Imperial College."— Presentation transcript:

1 David Britton, 2/9/03 Imperial, College GridPP Project Overview David Britton, Imperial College

2 David Britton, 2/9/03 Imperial, College 9 orders of magnitude The HIGGS All interactions The Challenge of the LHC

3 David Britton, 2/9/03 Imperial, College Tier2 Centre ~1 TIPS Online System Offline Farm ~20 TIPS CERN Computer Centre >20 TIPS RAL Regional Centre US Regional Centre French Regional Centre Italian Regional Centre Institute Institute ~0.25TIPS Workstations ~100 MBytes/sec Mbits/sec One bunch crossing per 25 ns 100 triggers per second Each event is ~1 MByte Physicists work on analysis channels Each institute has ~10 physicists working on one or more channels Data for these channels should be cached by the institute server Physics data cache ~PBytes/sec ~ Gbits/sec or Air Freight Tier2 Centre ~1 TIPS ~Gbits/sec Tier 0 Tier 1 Tier 3 Tier 4 ScotGRID++ ~1 TIPS Tier 2 Tier Structure

4 David Britton, 2/9/03 Imperial, CollegeRAW Recorded by DAQ Triggered events Detector digitisation ~2 MB/event ESD Pseudo-physical information: Clusters, track candidates (electrons, muons), etc. Reconstructedinformation ~100 kB/event AOD Physical information: Transverse momentum, Association of particles, jets, (best) id of particles, Physical info for relevant objects Selectedinformation ~10 kB/event TAG Analysisinformation ~1 kB/event Relevant information for fast event selection Data Hierarchy

5 David Britton, 2/9/03 Imperial, College GridPP Project Overview

6 David Britton, 2/9/03 Imperial, College The Project Map

7 David Britton, 2/9/03 Imperial, College LHC Computing Grid (LCG) Help create LCG project Components shared by LHC experiments; e.g. POOL Prototyping the CERN Tier0/1 center. (Scalability issue) Requirements; Monitoring; recommendations. Deploying and operating the LHC Computing Grid 6.2* TOTAL 91.1 GridPP 24.0 * LCG management FTE in 2002

8 David Britton, 2/9/03 Imperial, College LHC Computing Grid LCG-1 Release

9 David Britton, 2/9/03 Imperial, College Certification and distribution process established Middleware package – components from – –European DataGrid (EDG) –US (Globus, Condor, PPDG, GriPhyN) the Virtual Data Toolkit Agreement reached on principles for registration and security RAL to provide the initial grid operations centre FZK to operate the call centre Initial service being deployed now to 10 centres US, Europe, Asia Expand to other centres as soon as the service is stable LCG Academia Sinica Taipei, BNL, CERN, CNAF, FNAL, FZK, IN2P3 Lyon, Moscow State Univ., RAL, Univ. Tokyo LCG Status

10 David Britton, 2/9/03 Imperial, College European DataGrid (EDG) EDG 2.0EDG 2.1

11 David Britton, 2/9/03 Imperial, College European DataGrid UK Roles Quality Assurance Representative0.5 Deputy Leader, (Iteam)2.0 Group Leader, Deputy Leader, Iteam, ATF, QA EU 2.0 Group Leader, Deputy Leader, Iteam, ATF, QA EU CA Group Manager3.0 Deputy Leader, Security Group Leader, ATF3.7* * Includes Security Group Leader4.0 FTE

12 David Britton, 2/9/03 Imperial, College European DataGrid – WP1 WP1 Workload Management Logging & Bookkeeping Server Saving of job checkpoint state state.saveState() Job Job checkpoint states saved in the LB server Retrieval of job checkpoint u Also used (even in rel. 1) as repository of job status info u Already proved to be robust and reliable u The load can be distributed between multiple LB servers, to address scalability problems Job Checkpointing in EDG2.0

13 David Britton, 2/9/03 Imperial, College European DataGrid – WP2 WP2 Data Management Storage Element Replica Manager Replica Location Service Replica Optimization Service Replica Metadata Catalog SE Monitor Network Monitor Information Service Resource Broker User Interface or Worker Node Storage Element Virtual Organization Membership Service UK Contributions RM in EDG2.0 See OptorSim Demo at PPARC Stand

14 David Britton, 2/9/03 Imperial, College European DataGrid – WP3 WP3 Information and Monitoring Services UK Product RGMA in EDG2.0 R-GMA Consumers LDAP InfoProvider GIN LDAP Server LDAP InfoProvider Stream Producer GIN Consumer (CE) Consumer (SE) Consumer (SiteInfo) RDBMS Latest Producer GOUT ConsumerA PI Archiver (LatestProducer) Stream Producer R-GMA GLUE Schema Push mode Updates every 30s >70 sites (simul.) RGMA talk Thursday 10.15am

15 David Britton, 2/9/03 Imperial, College European DataGrid – WP4 WP4 Fabric Management UK Product LCFG configuration software from Univ. Edinburgh was used from Month 12 onwards of the EDG project. Newer version, LCFGng, in EDG-2.0 and in LCG-1

16 David Britton, 2/9/03 Imperial, College European DataGrid – WP5 WP5 Mass Storage Management SE in EDG2.0 Client App API SE HTTP library SSL socket library AXIS SE core SE Java Client Tomcat u The design of the SE follows a layered model with a central core handling all paths between client and MSS. Core is flexible and extensible making it easy to support new protocols, features and MSS Client App Java Client API C Client RMANMAN Apache Web Service UK Product

17 David Britton, 2/9/03 Imperial, College European DataGrid – WP6 WP6 Testbed EDG Application testbed: More than 40 sites More than 1000 CPUs 5 Terabyte of storage Testbed successfully demonstrated during 2 nd EU review in Feb 2003 Large UK participation

18 David Britton, 2/9/03 Imperial, College European DataGrid – WP7 WP7 Network Services (Wed 12:10: High speed data transfers)

19 David Britton, 2/9/03 Imperial, College Applications

20 David Britton, 2/9/03 Imperial, College Applications: GANGA Underlying GRID services (GLOBUS toolkit) GRID middleware (EDG, PPDG,…) Application specific layer (Athena/Gaudi, …) GUI interface OS and Network services Multilayered Grid architecture GANGA A common interface to the Grid for Atlas and LHCb Server Bookkeeping DB Production DB EDG UI PYTHON SW BUS XML RPC server XML RPC module GANGA Module OS Module Athena\ GAUDI GaudiPython PythonROOT PYTHON SW BUS GUI Job Configuration DB Remote user (client) Local Job DB LAN/WAN GRID LRMS

21 David Britton, 2/9/03 Imperial, College Applications: GUIDO See GUIDO demo at the PPARC booth

22 David Britton, 2/9/03 Imperial, College Applications: CMS Adding RGMA to BOSS

23 David Britton, 2/9/03 Imperial, College Applications: CDF/D0

24 David Britton, 2/9/03 Imperial, College Applications: CDF/D0 D0 plan to reprocess 22 TB of DST using SAMGrid starting mid September See SAMGrid Demo at PPARC Stand

25 David Britton, 2/9/03 Imperial, College Tier-1/A

26 David Britton, 2/9/03 Imperial, College Tier-2

27 David Britton, 2/9/03 Imperial, College

28 David Britton, 2/9/03 Imperial, College Testbed

29 David Britton, 2/9/03 Imperial, College All testbed sites can be said to be truly on a Grid by virtue of their registration in a comprehensive resource information publication scheme, their accessibility via a set of globally enabled resource brokers, and the use of one of the first scalable mechanisms to support distributed virtual communities (VOMS). There are few such Grids in operation in the World today.

30 David Britton, 2/9/03 Imperial, College Data Challenges

31 David Britton, 2/9/03 Imperial, College ATLAS DC1 Phase 2 UK largest producer

32 David Britton, 2/9/03 Imperial, College Interoperability,Dissemination, Resources

33 David Britton, 2/9/03 Imperial, College GridPP2 proposal: The Future From Testbed to Production

34 David Britton, 2/9/03 Imperial, College Summary Status: At the midpoint of GridPP1, 95 out of 182 tasks (52%) have been successfully completed. The LCG-1 release is imminent; a landmark moment. Achievements: A major factor in establishing the LCG project Leadership roles within 5 of the 8 (applicable) EDG workpackages. Significant middleware development. Deployed the UKs largest testbed (16 sites and >100 servers). Integration with EU-wide programme and linked to Worldwide efforts. Active Tier-1/A production centre, meeting demands. Tier-2 resources identified and a structure being developed. Established productive links with the experiment applications. Developed a proposal for a follow-on project, GridPP2. Responded to the LHC Computing Challenge: Defined and initiated a programme that will be the basis for LHC computing.


Download ppt "David Britton, 2/9/03 Imperial, College GridPP Project Overview David Britton, Imperial College."

Similar presentations


Ads by Google