LHCbComputing Update of LHC experiments Computing & Software Models Selection of slides from last week’s GDB

Slides:



Advertisements
Similar presentations
Action Programmes KAG / HoPS / PAD Workshop 3 rd March 2014.
Advertisements

Data Management TEG Status Dirk Duellmann & Brian Bockelman WLCG GDB, 9. Nov 2011.
Ian Bird LHCC Referees’ meeting; CERN, 18 th November 2014.
Ian Bird LCG Project Leader LHCC + C-RSG review. 2 Review of WLCG  To be held Feb 16 at CERN  LHCC Reviewers:  Amber Boehnlein  Chris.
LHCbComputing LHCb Computing Tasks. December Status of Computing Personnel m Currently available people insufficient to cover all activities o Estimate.
introduction to MSc projects
Chapter 3: The Project Management Process Groups
DATA PRESERVATION IN ALICE FEDERICO CARMINATI. MOTIVATION ALICE is a 150 M CHF investment by a large scientific community The ALICE data is unique and.
Trigger and online software Simon George & Reiner Hauser T/DAQ Phase 1 IDR.
1 Towards an Upgrade TDR: LHCb Computing workshop May 2015 Introduction to Upgrade Computing Session Peter Clarke Many peoples ideas Vava, Conor,
Ian Bird WLCG Workshop Okinawa, 12 th April 2015.
Ian Bird WLCG Management Board CERN, 17 th February 2015.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
BSBIMN501A QUEENSLAND INTERNATIONAL BUSINESS ACADEMY.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
SC4 Workshop Outline (Strong overlap with POW!) 1.Get data rates at all Tier1s up to MoU Values Recent re-run shows the way! (More on next slides…) 2.Re-deploy.
Ian Bird LHCC Referee meeting 23 rd September 2014.
Grid Workload Management Massimo Sgaravatto INFN Padova.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.
ATLAS in LHCC report from ATLAS –ATLAS Distributed Computing has been working at large scale Thanks to great efforts from shifters.
©Ian Sommerville 2004 Software Engineering. Chapter 21Slide 1 Chapter 21 Software Evolution.
Ian Bird LHCC Referees Meeting; CERN, 12 th March 2013 March 6, 2013
Summary of RSG/RRB Ian Bird GDB 9 th May 2012
Ian Bird GDB; CERN, 8 th May 2013 March 6, 2013
TDAQ Upgrade Software Plans John Baines, Tomasz Bold Contents: Future Framework Exploitation of future Technologies Work for Phase-II IDR.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 21 Slide 1 Software evolution 1.
CSC480 Software Engineering Lecture 10 September 25, 2002.
LHCbComputing Manpower requirements. Disclaimer m In the absence of a manpower planning officer, all FTE figures in the following slides are approximate.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
Southend Together Secretariat 21 st February Developing Southend Together’s Sustainable Community Strategy
Ian Bird GDB CERN, 9 th September Sept 2015
Procedure to follow for proposed new Tier 1 sites Ian Bird CERN, 27 th March 2012.
Evolution of storage and data management Ian Bird GDB: 12 th May 2010.
Future computing strategy Some considerations Ian Bird WLCG Overview Board CERN, 28 th September 2012.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
The ATLAS Computing Model and USATLAS Tier-2/Tier-3 Meeting Shawn McKee University of Michigan Joint Techs, FNAL July 16 th, 2007.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Ian Bird CERN, 17 th July 2013 July 17, 2013
CLIC - CDR Status (Volume 2) Hermann Schmickler, ILCW2010.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Ian Bird, CERN WLCG LHCC Referee Meeting 1 st December 2015 LHCC; 1st Dec 2015 Ian Bird; CERN1.
LCG Issues from GDB John Gordon, STFC WLCG MB meeting September 28 th 2010.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
LHCC Referees Meeting – 28 June LCG-2 Data Management Planning Ian Bird LHCC Referees Meeting 28 th June 2004.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Evolution of WLCG infrastructure Ian Bird, CERN Overview Board CERN, 30 th September 2011 Accelerating Science and Innovation Accelerating Science and.
Ian Bird, CERN 1 st February Dec 2015
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
MASON ITSM, WHERE ARE WE NOW?. GEORGE MASON UNIVERSITY AGENDA Background – 2013/2014 Organizational Changes ITSM Tool Process Mapping Tool ITIL Framework.
Systems Analysis & Design David Walkiewicz March 31, 2012.
Marco Cattaneo, 3-June Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Outcome should be a documented strategy Not everything needs to go back to square one! – Some things work! – Some work has already been (is being) done.
Ian Bird LCG Project Leader Summary of EGI workshop.
LHC collisions rate: Hz New PHYSICS rate: Hz Event selection: 1 in 10,000,000,000,000 Signal/Noise: Raw Data volumes produced.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
Evolution of storage and data management
Ian Bird WLCG Workshop San Francisco, 8th October 2016
Computing models, facilities, distributed computing
2. ISO Certification Discussed already at 2015 PoW and several WLCG OB meetings Proposed approach: An Operational Circular that describes the organisation's.
for the Offline and Computing groups
WLCG: TDR for HL-LHC Ian Bird LHCC Referees’ meting CERN, 9th May 2017.
LHCb Software & Computing Status
LCG Operations Centres
Strategy document for LHCC – Run 4
The latest developments in preparations of the LHC community for the computing challenges of the High Luminosity LHC Dagmar Adamova (NPI AS CR Prague/Rez)
Input on Sustainability
What does DPHEP do? DPHEP has become a Collaboration with signatures from the main HEP laboratories and some funding agencies worldwide. It has established.
LHC plans for LS2 and beyond
Presentation transcript:

LHCbComputing Update of LHC experiments Computing & Software Models Selection of slides from last week’s GDB

Background Requested by the LHCC in December: need to see updated computing models before Run 2 starts A single document to: - Describe changes since the original TDRs (2005) in Assumptions, models, technology, etc. - Emphasise what is being done to adapt to new technologies, to improve efficiency, to be able to adapt to new architectures, etc. - Describe work that still needs to be done - Use common formats, tables, assumptions, etc 1 document rather than 5 March 6, 2013

Timescales Document should describe the period from LS1 – LS2 - Estimates of evolving resource needs In order to prepare for 2015, a good draft needs to be available in time for the Autumn 2013 RRB, so needs to be discussed at the LHCC in September:  Solid draft by end of summer 2013 (!) March 6, 2013

Opportunities This document gives a framework to: - Describe significant changes and improvements already made - Stress commonalities between experiments – and drive strongly in that direction Significant willingness to do this Describe the models in a common way – calling out differences - Make a statement about the needs of WLCG in the next 5 years (technical, infrastructure, resources) - Potentially review the organisational structure of the collaboration - Review the implementation: scale, quality of service of sites/Tiers; archiving vs processing vs analysis activities - Raise concerns: E.g. staffing issues; missing skills; March 6, 2013

Draft ToC Preamble/introduction Resource needs and expected evolution Technology review and outlook Challenges – the problem being addressed - Consequences for computing Experiment computing models Distributed computing Computing services Common software activities and strategies Collaboration organisation and management March 6, 2013

6 Experiment specific chapters Many topics need to be covered in this document: - Data models – types of data, event sizes, relationships, etc. The operational workflows are strongly correlated to these. - Data flows, replication and placement policies. Optimal use of resources to provide the best possible physics throughput. Role of Tiers and sites with emphasis on functionalities and services required. - Anticipated event rates and data streams in Run-2. - Non-event data handling. For example evolution of database usage and technologies, e.g. Oracle, Frontier, Hadoop, CVMFS... - Software evolution. Further software optimization in terms of processing speed, event sizes, parallelization etc..  Data preservation and several more.. An important point is to demonstrate clearly also the progress we made from the Computing TDRs until now, not just the envisaged progress towards Run2. Also, clearly identify the envisaged commonalities between experiments and potential input from the wider scientific community.

7 Status m Drafts of all chapters in preparation o Bernd Panzer, Ian Bird, John Harvey o 4 LHC experiments computing projects m Experiment specific chapters based on common template o I am drafting the LHCb chapters m First drafts to be circulated within working group by end of next week o We are late, unclear if I can circulate internally first P Time for discussion and refinement during June but basically frozen by mid-July o I would have preferred to have an LHCb editorial team, but: P We are all so busy and time is short P Requires weekly F2F interaction with other experiments