Nick Brook Current status Future Collaboration Plans Future UK plans.

Slides:



Advertisements
Similar presentations
B A B AR and the GRID Roger Barlow for Fergus Wilson GridPP 13 5 th July 2005, Durham.
Advertisements

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
31/03/00 CMS(UK)Glenn Patrick What is the CMS(UK) Data Model? Assume that CMS software is available at every UK institute connected by some infrastructure.
LHCb Computing Activities in UK Current activities UK GRID activities RICH s/w activities.
Reporting of the Experiments Follow procedures set up for technical WP of EDG Spreadsheet report man month effort Pro-forma reply sheet Pro-forma sheet.
Nick Brook University of Bristol The LHC Experiments & Lattice EB News Brief overview of the expts  ATLAS  CMS  LHCb  Lattice.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
6/4/20151 Introduction LHCb experiment. LHCb experiment. Common schema of the LHCb computing organisation. Common schema of the LHCb computing organisation.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.
Production Planning Eric van Herwijnen Thursday, 20 june 2002.
11 Dec 2000F Harris Datagrid Testbed meeting at Milan 1 LHCb ‘use-case’ - distributed MC production
Exploiting the Grid to Simulate and Design the LHCb Experiment K Harrison 1, N Brook 2, G Patrick 3, E van Herwijnen 4, on behalf of the LHCb Grid Group.
CMS Report – GridPP Collaboration Meeting VI Peter Hobson, Brunel University30/1/2003 CMS Status and Plans Progress towards GridPP milestones Workload.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
K.Harrison CERN, 21st November 2002 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Background and scope - Project organisation - Technology survey - Design -
KNMI Applications on Testbed 1 …and other activities.
3 Sept 2001F HARRIS CHEP, Beijing 1 Moving the LHCb Monte Carlo production system to the GRID D.Galli,U.Marconi,V.Vagnoni INFN Bologna N Brook Bristol.
LHCb DataModel Nick Brook Glenn Patrick University of Bristol Rutherford Lab Motivation DataModel Options Future plans.
LHCb Applications and GRID Integration Domenico Galli Catania, April 9, st INFN-GRID Workshop.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
BaBar Grid Computing Eleonora Luppi INFN and University of Ferrara - Italy.
November 7, 2001Dutch Datagrid SARA 1 DØ Monte Carlo Challenge A HEP Application.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
SLICE Simulation for LHCb and Integrated Control Environment Gennady Kuznetsov & Glenn Patrick (RAL) Cosener’s House Workshop 23 rd May 2002.
12th November 2003LHCb Software Week1 UK Computing Glenn Patrick Rutherford Appleton Laboratory.
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.
Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University.
LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
7April 2000F Harris LHCb Software Workshop 1 LHCb planning on EU GRID activities (for discussion) F Harris.
K.Harrison BNL, 7 May 2002 Overview of GANGA – First steps towards GANGA – Outline of required functionality – Some existing technology – Conclusions.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
29 May 2002Joint EDG/WP8-EDT/WP4 MeetingClaudio Grandi INFN Bologna LHC Experiments Grid Integration Plans C.Grandi INFN - Bologna.
WP8 Meeting Glenn Patrick1 LHCb Grid Activities in UK Grid WP8 Meeting, 16th November 2000 Glenn Patrick (RAL)
…building the next IT revolution From Web to Grid…
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
ATLAS is a general-purpose particle physics experiment which will study topics including the origin of mass, the processes that allowed an excess of matter.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.
UK Grid Meeting Glenn Patrick1 LHCb Grid Activities in UK Grid Prototype and Globus Technical Meeting QMW, 22nd November 2000 Glenn Patrick (RAL)
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.
The GridPP DIRAC project DIRAC for non-LHC communities.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
- GMA Athena (24mar03 - CHEP La Jolla, CA) GMA Instrumentation of the Athena Framework using NetLogger Dan Gunter, Wim Lavrijsen,
LHCb Data Challenge in 2002 A.Tsaregorodtsev, CPPM, Marseille DataGRID France meeting, Lyon, 18 April 2002.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
CLRC Grid Team Glenn Patrick LHCb GRID Plans Glenn Patrick LHCb has formed a GRID technical working group to co-ordinate practical Grid.
Distributed Physics Analysis Past, Present, and Future Kaushik De University of Texas at Arlington (ATLAS & D0 Collaborations) ICHEP’06, Moscow July 29,
INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.
The GridPP DIRAC project DIRAC for non-LHC communities.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
LHCb computing model and the planned exploitation of the GRID Eric van Herwijnen, Frank Harris Monday, 17 July 2000.
Moving the LHCb Monte Carlo production system to the GRID
LHCb Computing Model and Data Handling Angelo Carbone 5° workshop italiano sulla fisica p-p ad LHC 31st January 2008.
UK GridPP Tier-1/A Centre at CLRC
D. Galli, U. Marconi, V. Vagnoni INFN Bologna N. Brook Bristol
The Ganga User Interface for Physics Analysis on Distributed Resources
Gridifying the LHCb Monte Carlo production system
Summary Computing Model SICb Event Model Detector Description
Status and plans for bookkeeping system and production tools
Short to middle term GRID deployment plan for LHCb
Use Of GAUDI framework in Online Environment
Production Manager Tools (New Architecture)
Presentation transcript:

Nick Brook Current status Future Collaboration Plans Future UK plans

5th November 2001GridPP Collab Meeting 2 Needs & Requirements Extrapolated hardware profile for large scale MC production in UK End 2001Jan 2003 CPU(SI95) Disk (Tb) Robotic Tape (Tb)

5th November 2001GridPP Collab Meeting 3 Current Status UK major external Monte Carlo production centre (RAL & MAP)  UK major i/p to formulation of LHCb Grid plans Frank Harris (Oxford)75% (WP8 & external computing coordination) Nick Brook (Bristol)50%(UK coordination & analysis model) Glenn Patrick (RAL)30%(analysis model & testbed) Girish Patel (Liverpool)20%(MAP+testbed) Ulrik Egede (IC)10%(analysis model) Artur Barczyk (Edinburgh)20%(analysis model) Akram Khan (Edinburgh)20%(testbed+WP2, analysis framework) Ian McArthur(Oxford)20%(metadata management) A N Other (Oxford)100%(Gaudi/Grid- WP8) Chris Jones (Cambridge)10%(analysis model)

5th November 2001GridPP Collab Meeting 4 Monte Carlo Production CentreOS Max (ave) nos. of CPUs used simultaneously Typical weekly produced (nos. of k evts) Percentage submitted through Grid CERNLinux315(60)8510 RALLinux50(30)35100 IN2P3Linux225(60)35100 LiverpoolLinux300(250)1500 BolognaLinux20(20)350 Hope to include ScotGrid & Bristol soon

5th November 2001GridPP Collab Meeting 5 Monte Carlo Production Execute on farm Submit via Web Performance monitoring via web Update database at CERN Transfer to mass storage at CERN Data quality checking

5th November 2001GridPP Collab Meeting 6 Monte Carlo Production Execute on farm Submit via Web Performance monitoring via web Update database at CERN Transfer to mass storage at CERN, RAL, … Data quality checking WP1 submission tools WP4 environment WP1 submission tools WP3 monitoring tools WP2 metadata tools WP1 tools WP2 data replication WP5 API for mass storage Online histos production using Grid pipes

5th November 2001GridPP Collab Meeting 7 MC Production Requirements Production site aware scripts Installation kits System should be resistant crashes of: –any share filesystem used –book-keeping database system –mass storage system –file transfer technology –job submission system –LHCb executables! Scalability i.e. easy to add new MC production site Allow replication of remote datasets Monitoring and control of the LHCb MC system Interface to GANGA

5th November 2001GridPP Collab Meeting 8 Installation Kit Requirements Production Installation Kit –Installs self-contained run time environment given version of executable “call” external dynamic libraries in a “path independent” way appropriate detector database script to check installation –Original format compatible with EDG WP4 i.e. RPM’s –Production on Windows platform?? Developers Installation Kit –Installs self-contained developers environment Source code Appropriate detector database CMT, CVS, C++ installation if needed –Supports Windows Interface to GANGA

5th November 2001GridPP Collab Meeting 9 What is Gaudi? Converter Algorithm Event Data Service Persistency Service Data Files Algorithm Transient Event Store Detec. Data Service Persistency Service Data Files Transient Detector Store Message Service JobOptions Service Particle Prop. Service Other Services Histogram Service Persistency Service Data Files Transient Histogram Store Application Manager Converter Event Selector

5th November 2001GridPP Collab Meeting 10 Gaudi & The Grid World Converter Algorithm Event Data Service Persistency Service Algorithm Detec. Data Service Persistency Service Message Service JobOptions Service Particle Prop. Service Other Services Histogram Service Persistency Service Application Manager Converter Event Selector Analysis Program OS Mass Storage Event Database PDG Database DataSet DB Other Monitoring Service Histo Presenter Other Job Service Config. Service Transient Detector Store Transient Histogram Store Transient Event Store

5th November 2001GridPP Collab Meeting 11 GANGA: Grid And Gaudi Alliance GAUDI Program GANGA GUI JobOptions Algorithms Collective & Resource Grid Services Histograms Monitoring Results

5th November 2001GridPP Collab Meeting 12 GANGA Requirements Prior to job submission –configuration of Gaudi program e.g. algorithm selection, event data i/p, requested o/p,… –Grid services estimations of resource req t e.g. CPU, storage, … –user job req ts e.g. s/w needed –submitting job (or parallel sub-jobs) During execution –monitor progress – displaying of messages, histograms,… After execution –termination status and validation –e.g. MC production – o/p files on mass storage & updating of book-keeping database –e.g. analysis - return o/p to user

5th November 2001GridPP Collab Meeting 13 ATLAS & LHCb are using the same s/w framework – Athena /Gaudi Large part of proposed work has overlap e.g. GANGA grid interfaces Proposed programme has been discussed not only betweeh the 2 UK collaborations BUT also at CERN ATLAS & LHCb

5th November 2001GridPP Collab Meeting 14 Summary Proposing a challenging programme Programme developed in conjunction with central collaboration Programme developed in conjunction with ATALS as a whole & in the UK Requesting for a minimum of 8 staff years of effort (some will be common with ATLAS) UK already playing a leading role in the LHCb Grid activities UK already leading centre(s) in producing Monte Carlo for LHCb