GridPP3 project status Sarah Pearce 24 April 2010 GridPP25 Ambleside.

Slides:



Advertisements
Similar presentations
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
Advertisements

Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Oversight Committee Meeting.
Deployment metrics and planning (aka Potentially the most boring talk this week) GridPP16 Jeremy Coles 27 th June 2006.
GridPP4 – Revised Plan Implementing the PPAN recommendations.
Project Status David Britton,15/Dec/ Outline Programmatic Review Outcome CCRC08 LHC Schedule Changes Service Resilience CASTOR Current Status Project.
GridPP4 Project Management Pete Gronbech April 2012 GridPP28 Manchester.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Oversight Committee Meeting.
GridPP From Prototype to Production David Britton 21/Sep/06 1.Context – Introduction to GridPP 2.Performance of the GridPP/EGEE/wLCG Grid 3.Some Successes.
Nick Brook University of Bristol The LHC Experiments & Lattice EB News Brief overview of the expts  ATLAS  CMS  LHCb  Lattice.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP26 Collaboration Meeting.
S.L.LloydGridPP CB 29 Oct 2002Slide 1 Agenda 1.Introduction – Steve Lloyd 2.Minutes of Previous Meeting (23 Oct 2001) 3.Matters Arising 4.Project Leader's.
Southgrid Status Pete Gronbech: 27th June 2006 GridPP 16 QMUL.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP27 15 th Sep 2011 GridPP.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Oversight Committee 25.
London Tier 2 Status Report GridPP 13, Durham, 4 th July 2005 Owen Maroney, David Colling.
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
UKI-SouthGrid Overview Face-2-Face Meeting Pete Gronbech SouthGrid Technical Coordinator Oxford June 2013.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP Vendor Day 30 th April.
Tier-1 Overview Andrew Sansum 21 November Overview of Presentations Morning Presentations –Overview (Me) Not really overview – at request of Tony.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
Southgrid Status Report Pete Gronbech: February 2005 GridPP 12 - Brunel.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Quarterly report SouthernTier-2 Quarter P.D. Gronbech.
D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.
Southgrid Technical Meeting Pete Gronbech: 16 th March 2006 Birmingham.
GridPP Status Report David Britton, 15/Sep/09. 2 Introduction Since the last Oversight: The UK has continued to be a major contributor to wLCG A focus.
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
SouthGrid Status Pete Gronbech: 2 nd April 2009 GridPP22 UCL.
GridPP23 – Final Steps to Data David Britton, 8/Sep/09.
12th November 2003LHCb Software Week1 UK Computing Glenn Patrick Rutherford Appleton Laboratory.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP35, Liverpool 11 Sep 2015.
Oxford Update HEPix Pete Gronbech GridPP Project Manager October 2014.
1 st EGEE Conference – April UK and Ireland Partner Dave Kant Deputy ROC Manager.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
Andrew McNabNorthGrid, GridPP8, 23 Sept 2003Slide 1 NorthGrid Status Andrew McNab High Energy Physics University of Manchester.
GridPP3 project status Sarah Pearce 14 April 2010 GridPP24 RHUL.
John Gordon STFC-RAL Tier1 Status 9 th July, 2008 Grid Deployment Board.
GridPP3 Project Management GridPP20 Sarah Pearce 11 March 2008.
Project Management Sarah Pearce 3 September GridPP21.
John Gordon CCLRC e-Science Centre LCG Deployment in the UK John Gordon GridPP10.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Δ Storage Middleware GridPP10 What’s new since GridPP9? CERN, June 2004.
Jeremy Coles UK LCG Operations The Geographical Distribution of GridPP Institutes Production Manager.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Southgrid Technical Meeting Pete Gronbech: 26 th August 2005 Oxford.
11 March 2008 GridPP20 Collaboration meeting David Britton - University of Glasgow GridPP Status GridPP20 Collaboration Meeting, Dublin David Britton,
GridPP Deployment Status GridPP14 Jeremy Coles 6 th September 2005.
GridPP: Executive Summary Tony Doyle. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Outline Exec 2 Summary Grid status High level.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
GridPP Deployment Status GridPP15 Jeremy Coles 11 th January 2006.
London Tier 2 Status Report GridPP 11, Liverpool, 15 September 2004 Ben Waugh on behalf of Owen Maroney.
Tim 18/09/2015 2Tim Bell - Australian Bureau of Meteorology Visit.
BNL Tier 1 Service Planning & Monitoring Bruce G. Gibbard GDB 5-6 August 2006.
Your university or experiment logo here The European Landscape John Gordon GridPP24 RHUL 15 th April 2010.
UK Tier 1 Centre Glenn Patrick LHCb Software Week, 28 April 2006.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
Project Status Report Ian Bird Computing Resource Review Board 20 th April, 2010 CERN-RRB
Tier-1 Andrew Sansum Deployment Board 12 July 2007.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Monitoring of the LHC Computing Activities Key Results from the Services.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
Performance analysis extracts from GridPP OC metrics report For UKI operations meeting 15 th June 2005.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
J Jensen/J Gordon RAL Storage Storage at RAL Service Challenge Meeting 27 Jan 2005.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPIX, BNL 13 Oct 2015.
Dominique Boutigny December 12, 2006 CC-IN2P3 a Tier-1 for W-LCG 1 st Chinese – French Workshop on LHC Physics and associated Grid Computing IHEP - Beijing.
Using HLRmon for advanced visualization of resource usage Enrico Fattibene INFN - CNAF ISCG 2010 – Taipei March 11 th, 2010.
LCG Introduction John Gordon, STFC-RAL GDB June 11 th, 2008.
Slide § David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP delivering The UK Grid.
UK Status and Plans Catalin Condurache – STFC RAL ALICE Tier-1/Tier-2 Workshop University of Torino, February 2015.
18/12/03PPD Christmas Lectures 2003 Grid in the Department A Guide for the Uninvolved PPD Computing Group Christmas Lecture 2003 Chris Brew.
Presentation transcript:

GridPP3 project status Sarah Pearce 24 April 2010 GridPP25 Ambleside

2 GridPP24, Ambleside Skiddaw The 4 th highest mountain in England (or the 3 rd, depending) The “simplest of the mountains of this height to ascend” A well trodden tourist track The first summit of the ‘Bob Graham Round’ fell running challenge The view from the top is ‘panoramic’ 24/8/10

3 GridPP24, Ambleside Since the last meeting LHC continues to take data – see Pete’s talk EGEE finished and EGI started – see Jeremy and Andy’s discussion Tier-1 running well Tier-2s procuring more equipment from the 2 nd round of hardware grants GridPP4 proposal reviewed and accepted – see Dave’s talk 24/8/10

4 GridPP24, Ambleside Tier-1 CPU hardware delivered and commissioned in time to meet WLCG pledge One tranche of disk delivery still going through acceptance Procurements for next round of CPU and disk have started Testing for upgrade to CASTOR (from 2.1.7) Operations very stable 24/8/10

5 GridPP24, Ambleside Tier-2s RHUL cluster successfully running in new RHUL machine room UCL-Central removed from list of UK sites All grants for 2 nd tranche of hardware issued: sites procuring hardware to meet 2010 pledge. Several sites made significant upgrades, including: –Sheffield (inc. air con/ temperature monitoring equipment) –Lancaster kit for new machine room –Cambridge increased disk and CPU –IC moved site outside firewall – x2 improvement in performance Some issues with staffing (Durham, likely at Bristol) –Discussion today at PMB/ DB on how to cover sites with small amounts (or no) dedicated staff 24/8/10

6 GridPP24, Ambleside EGI, EGI-Inspire etc. EGI started operations on 1 May 2010 –Governed by EGI Council –Executive Board reports to Council – Neil Geddes elected member of the EB –Key staff now in Amsterdam (except Neasan) –First Technical Forum will Sept in Amsterdam EGI-InSPIRE also started –Grant Agreement with EC not signed yet – so no money so far e-ScienceTalk will start 1 September –funds UK staff at IC and QMUL 24/4/10

7 GridPP24, Ambleside UKI CPU contribution (LHC) CPU August 2010 – GStat2.0 24/8/10 Since April 2010 Country stats

8 GridPP24, Ambleside UKI VOs 24/8/10 Since April 2010 Previous year

9 GridPP24, Ambleside UKI Tier-1 & Tier-2 contributions 24/8/10 Since April 2010 Previous year

10 GridPP24, Ambleside Storage From GStat (and previous talks…) September 2008March 2009September 2009 April /8/10 From GStat2.0 (today)

11 GridPP24, Ambleside ProjectMap Q210 24/8/10

12 GridPP24, Ambleside Project map - statistics MetricsMilestones 24/8/10

13 GridPP24, Ambleside Experiments ATLAS T1 data acceptance from CERN, T1s and T2s up from 79% to 96% Data availability in T2 storage is green, but this hides quite significant SE issues at some sites LHCb Sharp drop in the proportion of production computing taking place in the UK, from 28% to 16% - early user jobs at CERN Issue with data transfer from the T2s to RAL (1.2.5) Ganga milestone delayed (Integrate XML job summary from Dirac into Ganga) due to setting up new DAST CMS Some data loss at T1 and T2 but not considered significant by CMS Going well – CMS recognises the UK’s contribution Other experiments MINOS, D0 and Babar mainly this quarter Red milestones for experiment satisfaction/user support questionnaire – waiting on ATLAS reply 24/8/10

14 GridPP24, Ambleside Grid services Operations Fraction job slots used (Target 80%, achieved 37%). Overall occupancy low this quarter. Security No incidents this quarter Networking No red metrics. Second (resilient) OPN link from RAL is operational Data and storage Record FTS transfer rates (2.4.4), with an average over 370 MB/s sustained over the whole quarter Still questions over published storage values 24/8/10

15 GridPP24, Ambleside Tier-1 T1 operating extremely well. Nearly all metrics for front-end systems at 100%. CASTOR SAM tests at 100% for the first time (3.4.8) Red metrics for farm occupancy (43%, against a target of 80%, ) Red milestone for 2009 disk hardware accepted. One tranche of disk capacity failed acceptance – firmware fix and running again. Red milestone on moving out of Atlas centre – revised and will be met next quarter 24/8/10

16 GridPP24, Ambleside Tier-2s % of promised CPU available – green for all Tier-2s (metric 2). % of disk red for NorthGrid, but procurements underway. Next quarter will be measured against 2010 pledge. SAM availability and reliability tests green or orange (so above 90%) for most Tier-2s (metrics 3&4). Range of issues at SouthGrid sites. Other red metrics: CPU utilisation (wall clock time & CPU time, metrics 7/8) LondonGrid, SouthGrid – but generally low Number of management meetings NorthGrid (metric 11) Staff changes at several sites (Durham, Glasgow, Manchester, QMUL) 24/8/10

17 GridPP24, Ambleside Management and external Project execution – red metrics All quarterly reports in by target time (though some earlier than others…) Red metric for no. of UB meetings Rest of Map No red metrics EGEE/EGI metrics being revised to reflect EGI start 24/8/10

18 GridPP24, Ambleside Risk register 24/8/10 3 high level risks –Recruitment and retention – more of an issue as we get closer to GridPP4 –Sudden loss of key staff – as above –Uncertain long term funding. GridPP4 approved, but government funding an issue everywhere

19 GridPP24, Ambleside Finances - summary 24/8/10

20 GridPP24, Ambleside Finances Substantial reduction in the Tier-1 FY10 hardware line –STFC requested reduced capital spend of £1.1m –New experiment resource requirements from C-RRB in April Overall (to 2015) reduction in disk and CPU but increase in custodial storage. Second tranche of Tier-2 hardware grants all issued Bridging posts for EGEE-funded staff Travel costs £173k for 09/10 – within budget Small amount of funding for R-GMA over 6 months 24/8/10

21 GridPP24, Ambleside And the view is… 24/8/10 Panoramic?