GridPP3 project status Sarah Pearce 14 April 2010 GridPP24 RHUL.

Slides:



Advertisements
Similar presentations
London Tier2 Status O.van der Aa. Slide 2 LT 2 21/03/2007 London Tier2 Status Current Resource Status 7 GOC Sites using sge, pbs, pbspro –UCL: Central,
Advertisements

S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Oversight Committee Meeting.
Deployment metrics and planning (aka Potentially the most boring talk this week) GridPP16 Jeremy Coles 27 th June 2006.
GridPP4 – Revised Plan Implementing the PPAN recommendations.
Project Status David Britton,15/Dec/ Outline Programmatic Review Outcome CCRC08 LHC Schedule Changes Service Resilience CASTOR Current Status Project.
RAL Tier1: 2001 to 2011 James Thorne GridPP th August 2007.
Partner Logo Tier1/A and Tier2 in GridPP2 John Gordon GridPP6 31 January 2003.
S.L.LloydGridPP Collaboration Meeting IC Sept 2002Slide 1 Introduction Welcome to the 5 th GridPP Collaboration Meeting Steve Lloyd, Chair of GridPP.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Oversight Committee Meeting.
GridPP From Prototype to Production David Britton 21/Sep/06 1.Context – Introduction to GridPP 2.Performance of the GridPP/EGEE/wLCG Grid 3.Some Successes.
Nick Brook University of Bristol The LHC Experiments & Lattice EB News Brief overview of the expts  ATLAS  CMS  LHCb  Lattice.
S.L.LloydGridPP CB 29 Oct 2002Slide 1 Agenda 1.Introduction – Steve Lloyd 2.Minutes of Previous Meeting (23 Oct 2001) 3.Matters Arising 4.Project Leader's.
Southgrid Status Pete Gronbech: 27th June 2006 GridPP 16 QMUL.
12. March 2003Bernd Panzer-Steindel, CERN/IT1 LCG Fabric status
Chapter 5 IT Processes Presented by Dr. Mohamed Sammouda.
Managing the Information Technology Resource Jerry N. Luftman
London Tier 2 Status Report GridPP 13, Durham, 4 th July 2005 Owen Maroney, David Colling.
UKI-SouthGrid Overview Face-2-Face Meeting Pete Gronbech SouthGrid Technical Coordinator Oxford June 2013.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Vendor Day 30 th April.
London Tier 2 Status Report GridPP 12, Brunel, 1 st February 2005 Owen Maroney.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
D. Britton Collaboration Board Meeting David Britton 16/Jul/07.
Quarterly report SouthernTier-2 Quarter P.D. Gronbech.
D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.
GridPP Status Report David Britton, 15/Sep/09. 2 Introduction Since the last Oversight: The UK has continued to be a major contributor to wLCG A focus.
SouthGrid Status Pete Gronbech: 2 nd April 2009 GridPP22 UCL.
GridPP23 – Final Steps to Data David Britton, 8/Sep/09.
12th November 2003LHCb Software Week1 UK Computing Glenn Patrick Rutherford Appleton Laboratory.
Quarterly report ScotGrid Quarter Fraser Speirs.
1 st EGEE Conference – April UK and Ireland Partner Dave Kant Deputy ROC Manager.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
Organisation Management and Policy Group (MPG): Responsible for setting and policy decisions and resolving any issues concerning fractional usage, acceptable.
Notur: - Grant f.o.m is 16.5 Mkr (was 21.7 Mkr) - No guarantees that funding will increase in Same level of operations maintained.
John Gordon STFC-RAL Tier1 Status 9 th July, 2008 Grid Deployment Board.
GridPP3 Project Management GridPP20 Sarah Pearce 11 March 2008.
Project Management Sarah Pearce 3 September GridPP21.
Tony Doyle - University of Glasgow 1 July 2005Oversight Committee GridPP: Executive Summary Tony Doyle.
Tony Doyle - University of Glasgow 6 September 2005Collaboration Meeting GridPP Overview (emphasis on beyond GridPP) Tony Doyle.
WLCG Service Report ~~~ WLCG Management Board, 1 st September
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Jeremy Coles UK LCG Operations The Geographical Distribution of GridPP Institutes Production Manager.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
11 March 2008 GridPP20 Collaboration meeting David Britton - University of Glasgow GridPP Status GridPP20 Collaboration Meeting, Dublin David Britton,
GridPP Deployment Status GridPP14 Jeremy Coles 6 th September 2005.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
London Tier 2 Status Report GridPP 11, Liverpool, 15 September 2004 Ben Waugh on behalf of Owen Maroney.
Tony Doyle - University of Glasgow 8 July 2005Collaboration Board Meeting GridPP Report Tony Doyle.
GridPP3 project status Sarah Pearce 24 April 2010 GridPP25 Ambleside.
Your university or experiment logo here The European Landscape John Gordon GridPP24 RHUL 15 th April 2010.
UK Tier 1 Centre Glenn Patrick LHCb Software Week, 28 April 2006.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
Your university or experiment logo here User Board Glenn Patrick GridPP20, 11 March 2008.
CERN - IT Department CH-1211 Genève 23 Switzerland t IT-GD-OPS attendance to EGEE’09 IT/GD Group Meeting, 09 October 2009.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
J Jensen/J Gordon RAL Storage Storage at RAL Service Challenge Meeting 27 Jan 2005.
LCG Introduction John Gordon, STFC-RAL GDB June 11 th, 2008.
Slide § David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP delivering The UK Grid.
UK Status and Plans Catalin Condurache – STFC RAL ALICE Tier-1/Tier-2 Workshop University of Torino, February 2015.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
18/12/03PPD Christmas Lectures 2003 Grid in the Department A Guide for the Uninvolved PPD Computing Group Christmas Lecture 2003 Chris Brew.
London Tier-2 Quarter Owen Maroney
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
Ian Bird GDB Meeting CERN 9 September 2003
Bernd Panzer-Steindel CERN/IT
Collaboration Board Meeting
Select Committee on Finance (SCoF) National Treasury 10 October 2007
UK MoUs and Tier-1/A experiment shares
Presentation transcript:

GridPP3 project status Sarah Pearce 14 April 2010 GridPP24 RHUL

2 GridPP24, RHUL Since last GridPP meeting LHC has turned on –First collisions in December –“First physics” 30 March –Grid seems to working as expected for all the experiments so far Tier-1 had some ‘settling in’ problems, mostly resolved R89 officially opened 2 nd tranche of T2 hardware grants issued (?) EPSRC review EGI/ROSCOE/CUE/GridTalk proposals submitted and variously accepted or rejected GridPP4 proposal written and submitted 14/4/10

3 GridPP24, RHUL Tier-1 Acceptance problems with one tranche of disk delivery. Now resolved - drives replaced with those of a different manufacturer Three triggers for disaster management from R89: Cooling failures in August – remedial work undertaken and work to address Building Management System problems planned Water leak onto tape robot – audit of water sources carried out and rectification Impedance problems with the UPS supply – remedial work ongoing Tier-1 procurements have been carried out. Disk and CPU have been delivered and are undergoing acceptance testing R89 opened on 30 March – same day as LHC event 14/4/10

4 GridPP24, RHUL EPSRC review Report explicitly mentions: GridPP’s expertise in large-scale distributed data management and analysis. Our work with start-up companies. The substantial secondary economic benefit arising from the ability to rapidly screen drugs "in-silico”. GridPP resources were used in this way to screen potential agents in the fight against bird-flu and malaria. NGS and GridPP have been highly successful, providing many users with access to more computing power than they could otherwise easily obtain. Looking forward, we recommend that these efforts, including enhanced capacity and function of distributed storage, be sustained and expanded. 14/4/10

5 GridPP24, RHUL EGI-Inspire etc. Wide range of project bids submitted to the EC in November: –EGI-Inspire. In negotiation, will go ahead with small changes. UK involved in security, helpdesk, monitoring, regional support (and training) –GridTalk-II. In negotiation, will go ahead. QMUL and IC UK partners: GridBriefings, GridCasts, GridCafe, RTM… May change name? –ROSCOE (SSC including HEP) – not successful. –CUE (Training, outreach) – not successful 14/4/10

6 GridPP24, RHUL December performance Tier-1 Efficiency for all 4 LHC experiments over 90% Delivered a record amount of CPU to wLCG Tier-2s ScotGrid 98% availability/ 98% reliability NorthGrid 98%/98% reliability SouthGrid 97%/98% reliability LondonGrid 91%/94% reliability All above 90% threshold 14/4/10

7 GridPP24, RHUL UKI CPU contribution CPU April 2010 ? 14/4/10 Since GridPP up to GridPP23

8 GridPP24, RHUL UKI Tier-1 & Tier-2 contribution 14/4/10 Since GridPP23 GridPP22-GridPP23

9 GridPP24, RHUL CPU efficiency September 09 – April10 14/4/10

10 GridPP24, RHUL Storage From gstat (and previous talks…) September 2008March 2009September 2009 April /4/10

11 GridPP24, RHUL Since data taking started 14/4/10

12 GridPP24, RHUL Project Map GridPP3 Q /4/10

13 GridPP24, RHUL ProjectMap Q /4/10

14 GridPP24, RHUL Project map - statistics MetricsMilestones 14/4/10

15 GridPP24, RHUL Experiments - red metrics ATLAS One red metric, due to problems with T1 disk acceptance Job success rate and T1 data availability up LHCb Red metrics similar to last quarter. Low numbers of jobs account for some. RAL downtime from database issues reduced T1 LHCb SAM tests uptime T2 SAM tests low due to issues with EFDA and UCL CMS ‘Good quarter’ Other experiments Efficiency up to 82% in December, with ALICE data Fractions used by other experiments down (7.6% of T1 CPU, compared with 14% in Q3) New users: T2K, Super-B, SuperNemo 14/4/10

16 GridPP24, RHUL Grid services Operations Fraction of KSI2k used (Target 80%, achieved 61%) Job success rates – no longer use this metric, as SLL test results unreliable Security One red milestone – site security review. Questionnaires sent out in December. Mingchao will report at this meeting Security incident at Oxford: well handled 14/4/10

17 GridPP24, RHUL Tier-1 T1 operated well during data taking in Nov/Dec Work on UPS supply problems continuing. Other issues resolved (cooling, water leak) One tranche of disk capacity failed acceptance – now solved MoU commitment for tape not met, due to change in requirements because of LHC schedule Milestones General ADS Service Ends. Major users have been migrated. Considering next steps. Milestone R89 document available. A document detailing the trasition to R89 was published in March and is available on request. 14/4/10

18 GridPP24, RHUL Tier-2s % of promised disk and CPU available – green for all Tier-2s (metrics 1&2). SAM availability and reliability tests green or orange (so above 90%) for most Tier-2s (metrics 3&4). Metric 5 (SLL ATLAS test) now suspended Other red metrics: Average SLL SE test performance (metric 6) London CPU utilisation (wall clock time & CPU time, metrics 7/8) LondonGrid, SouthGrid Number of management meetings NorthGrid (metric 11) Tier-2 meeting LCG MoU service levels (metric 14) LondonGrid –UCL-central: slow to install kernel update - site taken offline 14/4/10

19 GridPP24, RHUL Management and external Project execution – red metrics Quarterly reports target not met (too much focus on GridPP4!) Rest of Map No red metrics 14/4/10

20 GridPP24, RHUL Finances - summary 14/4/10

21 GridPP24, RHUL Finances: Tier-1 hardware Tier-1 disk purchase FY09 increased in order to address potential shortfall: now allows for half a year buffer in disk £661k moved forward into FY09 from FY10, at the request of STFC Hardware requirements re-profiled, as a result of changes in LHC schedule Likely charge for networking costs pa, due to new arrangement between research councils and JISC 14/4/10

22 GridPP24, RHUL Finances: Tier-2s and staff Second tranche of Tier-2 hardware agreed 0.5FTE CMS support post at RAL delayed due to recruitment restrictions. Increased to 1FTE for FY10, to compensate for delay. Bridging funding to retain expertise of some EGEE-funded staff where posts are envisaged to continue in GridPP4. 14/4/10

23 GridPP24, RHUL In parallel 14/4/10

24 GridPP24, RHUL EGEE moves to EGI 4/2/10

25 GridPP24, RHUL And data comes… 4/2/10