Introduction to the Athena Software Hong Ma BNL Athena Tutorial USATLAS Software Workshop.

Slides:



Advertisements
Similar presentations
K A Assamagan Analysis Tutorial – December 19, Tucson, 2004 Overview of ATLAS Software and the Athena Framework (extracted from an earlier talk by S. R.
Advertisements

David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.
25/03/2003Simulation Application for the LHCb Experiment CHEP March 2003 Presented by: W. Pokorski / CERN Authors: I. Belyaev, Ph. Charpentier,
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL June 23, 2003 GAE workshop Caltech.
The Computing Environment. Outline Software Management –CVS –CMT –Tag-Collector –Savannah Data Structures Grid & Local cluster Athena –Projects & Packages.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL), Benedikt Hegner (CERN) 14 January
Jet Reconstruction and Calibration in Athena US ATLAS Software Workshop BNL, 27/08/03 Ambreesh Gupta, for the JetRec Group University of Chicago Outline:
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
ATLAS Software Kaushik De University of Texas At Arlington based on a tutorial by P. Calafiura (LBNL) LHC Computing Workshop, Ankara May 2, 2008.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL) 18 March 2015 Code Contributors: Michele De Gruttola, Benedikt Hegner, Clément.
LAr Athena Tutorial – November 2, 2004 Software Tutorial (Minimally modified transparencies from Offline Software Tutorial of Srini R., Hong M., David.
Gaudi Framework Tutorial, April Introduction.
Overview of LHCb applications and software environment LHCb software tutorial - March
As of 28 Juni 2005Getting Starged with GEM - Shuei Yamada 1 Getting Started with GEM Shuei YAMADA ICEPP, University of Tokyo What is GEM? Before you start.
N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER Charles Leggett The Athena Control Framework in Production, New Developments and Lessons Learned.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Event Data History David Adams BNL Atlas Software Week December 2001.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
Introduction to Gaudi LHCb software tutorial - September
David Adams ATLAS DIAL status David Adams BNL November 21, 2002 ATLAS software meeting GRID session.
24/06/03 ATLAS WeekAlexandre Solodkov1 Status of TileCal software.
Use of Gaudi in Reconstruction Weidong Li 23/06/2004.
Alexander Richards, UCL 1 Atlfast and RTT (plus DCube) Christmas Meeting 18/12/2007.
Gaudi Framework Tutorial, April Job Options and Printing.
9-13/9/03 Atlas Overview WeekPeter Sherwood 1 Atlfast, Artemis and Atlantis What, Where and How.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
1 Moore Packages, Repackaging and Design Status Michela Biglietti Univ. of Naples INFN/Naples Gabriella Cataldi INFN/Lecce.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
- Early Adopters (09mar00) May 2000 Prototype Framework Early Adopters Craig E. Tull HCG/NERSC/LBNL ATLAS Arch CERN March 9, 2000.
Aspects of LAr Reconstruction S. Rajagopalan ATLAS Week June 4, 2001.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
/MuID status report on behalf of the Moore/MuID group. Status in the releases ( Units Migrations DC1/G3 MuonGeoModel Migration DC2/G4) MuID updates Trig.
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
A New Tool For Measuring Detector Performance in ATLAS ● Arno Straessner – TU Dresden Matthias Schott – CERN on behalf of the ATLAS Collaboration Computing.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Jean-Roch Vlimant, CERN Physics Performance and Dataset Project Physics Data & MC Validation Group McM : The Evolution of PREP. The CMS tool for Monte-Carlo.
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
S. Rajagopalan, BNLATLAS software week, 2/15/00 LAr OO Reconstruction People: H. Ma, S. Rajagopalan, J. Schwindling –+ help/advise from several others.
K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.
Bologna Tutorial, April Job Options and Printing.
David Adams ATLAS ATLAS Distributed Analysis: Overview David Adams BNL December 8, 2004 Distributed Analysis working group ATLAS software workshop.
CERN Tutorial, February Introduction to Gaudi.
1 OO Muon Reconstruction in ATLAS Michela Biglietti Univ. of Naples INFN/Naples Atlas offline software MuonSpectrometer reconstruction (Moore) Atlas combined.
BESIII Offline Software Development Environment Ma qiumei * Development environment * Configuration & management tool * Software development.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
CERN Tutorial, September Overview of LHCb applications and software environment.
Software Week - 8/12/98G. Poulard - CERN EP/ATC1 Status of Software for Physics TDR Atlas Software Week 8 December 1998 G. Poulard.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
27/02/04 ATLAS weekTileCal Athena tutorial, part 21 TileCal Athena tutorial Part 2: Reading GEANT hits from ZEBRA and POOL Reading HLT and testbeam ByteStream.
UK LVL1 Meeting, RAL, 31/01/00Alan Watson 1 ATLAS Trigger Simulations Present & Future? What tools exist? What are they good for? What are the limitations?
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
Introduction to FCC Software FCC Istanbul 11 March, 2016 Alice Robson (CERN/UNIGE) on behalf of / with thanks to the FCC software group.
Athena StoreGate Tutorial: May 30, Objectives Learn how to access data objects using StoreGate How to record/retrieve by TYPE Optionally using keys.
BES III Software: Beta Release Plan Weidong Li 19 th October 2005.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
4 Dec., 2001 Software Week Data flow in the LArG Reconstruction software chain Updated status for various reconstruction algorithm LAr Converters and miscellaneous.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL May 19, 2003 BNL Technology Meeting.
David Adams ATLAS Hybrid Event Store Integration with Athena/StoreGate David Adams BNL March 5, 2002 ATLAS Software Week Event Data Model and Detector.
AOD example analysis Argonne Jamboree January 2010
FCC Software Status Readiness for FCC-ee Physics
GLAST Gaudi Review T. Burnett H.Kelly 10 Sept 02 Gaudi code review
OO Muon Reconstruction in ATLAS
Simulation and Physics
Introduction to Athena
2 Getting Started.
2 Getting Started.
ATLAS DC2 & Continuous production
Presentation transcript:

Introduction to the Athena Software Hong Ma BNL Athena Tutorial USATLAS Software Workshop

Aug 27, 2003 Hong Ma, Athena Tutorial 2 Outline Introduction to components relevant to end-users  Athena concepts  Typical dataflow  Web/documentation tour  Reconstruction End-user interface:  Customize job configuration  Running Athena job ( AthASK, next talk)  Using ntuple output  Analysis Examples at USATLAS Goal:  Understand the basic Athena concepts, availabilities of various simulation/reconstruction components, be ready to analyze the Athena ntuple output.

Aug 27, 2003 Hong Ma, Athena Tutorial 3

Aug 27, 2003 Hong Ma, Athena Tutorial 4 Athena as a Framework A skeleton of an application into which developers plug in their code and provides most of the common functionality and communications among different components.  Gaudi is a common framework used by ATLAS and LHCb. Athena is built on top of Gaudi. Responsible for  Define interface for each component;  Loading shared libraries;  Instantiate components;  Event Loop;  IO mechanism;  Job configuration …

Aug 27, 2003 Hong Ma, Athena Tutorial 5 Illustration of Components Algorithm A Algorithm B Algorithm C > Transient Event Data Store Data T1 Data T2 Data T2, T3 Data T4 Data T3, T4 Data T5 Converter Data T1 Input File Data base Converters Data T3,T5 > Transient Detector Data Store Detector Description > Particle Property Svc Particle AlgTool D

Aug 27, 2003 Hong Ma, Athena Tutorial 6 Transient Event Store CaloCluster Digits RawChannels CaloCell H H H HitCollection Digitization LArHit Converter ByteStream Reconstruction / Data Flow Converter Persistency OutputStream Algorithm AlgorithmPackagesLArRawChannel LArCellRec DataLink LArDigit ROD Emulation LArCell LArClusterRec Converter PersistencyOn-demandaccessStorage LAr Event Data Model

Aug 27, 2003 Hong Ma, Athena Tutorial 7 Packages and CVS Code is stored in packages, which are organized in hierarchical structures in CVS:  It maintains the history of each file. Access to CVS  Browse content using cvsweb server (USATLAS)USATLAS  Check out package from CVS server (>cvs co …) Package structure:  e.g. LArCellRec e.g. LArCellRec LArCellRec/ Header files (class definition) src/ Source code (implementation of classes) cmt/ cmt requirements file share/ jobOptions, data files, etc. ChangLog text file containing change history A specific version of the package is associated with a cvs tag.  e.g., LArCellRec is a tag for LArCellRec in release  User can check out the package with a tag.

Aug 27, 2003 Hong Ma, Athena Tutorial 8 CMT Configuration Management Tool  Manages the relationship between the packages Dependency between packages  Compile and build the packages creates Makefile for you.  Setting up runtime environment Env variables: PATH, LD_LIBRARY_PATH, etc.  … Hidden from user if AthASK is used

Aug 27, 2003 Hong Ma, Athena Tutorial 9 Releases Release: A complete set of code compiled, built and frozen for use  Defined by a set of tags for each package, Tag collector  Nightly builds Used by developers to work towards a release. Not guarranteed to work  Developer Release: approximately every 3 weeks(currently 6.6.0) Mostly working  Major release: approximately every 6 months (currently Major milestones, such as Data Challenges Release plan and Release Status can be found on the “Software Development” page Release plan Release Status Software Development USATLAS builds same releases as CERN  /afs/usatlas.bnl.gov/software/dist/

Aug 27, 2003 Hong Ma, Athena Tutorial 10 A brief history of ATLAS Reconstruction Some algorithms development started more than 10 years ago! Pursued through the various detector Technical Design Reports till « Physics TDR » in 1999 (still the most relevant reference document) This was « atrecon », mostly fortran code in « slug », a zebra based framework Then migration to C++ then to Athena Validation of Athena Reconstruction and on-going development (Detector Description, Event Data Model, new algorithms…) Plenty of things to do!

Aug 27, 2003 Hong Ma, Athena Tutorial 11 Reconstruction in Athena Each subsystem develops event data model and algorithms to produce the  e.g.: Inner Detector creates tracks with fitting algs High level reconstructed objects are based on objects from detector reconstruction.  e.g.: e-  reconstruction combines InDet tracks with Calorimeter clusters Then physics objects Plan for the future development of reconstruction by the Reconstruction Task ForceReconstruction Task Force

Aug 27, 2003 Hong Ma, Athena Tutorial 12 Reconstruction Algorithms (Some of these correspond to several Athena Algorithms and packages) MC Truth (Generators) InDet Reco (cluster, spactpoints) (InnerDetectors) xKalman++ (tracking) (Reconstruction) iPatrec (tracking) (Reconstruction) Calorimeter Reco (Cell, Clusters) (LArCalorimeter, TileCalorimeter) Muonbox (Muon reconstruction) (MuonSpectrometer) Moore (Muon reconstruction) (MuonSpectrometer) Jet (Reconstruction) e/gamma identification (Reconstruction) tau identification (Reconstruction) missing E T (Reconstruction) Vertexing (Reconstruction) Conversion (Reconstruction) Energy flow (Reconstruction) MuonIdentification (Reconstruction) Atlfast (Simulation)

Aug 27, 2003 Hong Ma, Athena Tutorial 13 RecExCommon All the available reconstruction algorithms are run from package RecExCommon, (no code, jobOptions only). RecExCommon is systematically run to check a release is (not) working, and used in reconstruction data challenge too. Each reconstruction task fills a block of the combined ntuple (CBNT) with all the variables needed at analysis level  This allows easy access to basic quantities  Trade-off between writing algorithms to make final physics objects, or doing it with analysis tool (PAW or ROOT) e.g., Z  ee Athena Algorithm or Z  ee ROOT macros  We do not have object persistency (besides ntuple) so full reconstruction chain needs to be rerun anytime the Algorithm is changed

Aug 27, 2003 Hong Ma, Athena Tutorial 14 Combined Ntuple (CBNT) Description of variables can be found in on reco pagepage  Example: EM cluster in e-gamma block: eg_nc: number of em clusters eg_et: ET of cluster eg_eta: eta of cluster eg_phi: phi of cluster eg_etap: eta calculated from pointing eg_zvertex: z-vertex position eg_errz: error on z-vertex …. The combined ntuple is built from many CBNT algorithms, each converts certain data object into CBNT entries E.g; CBNT_egamma class is an algorithm in Reconstruction/egammaRec package

Aug 27, 2003 Hong Ma, Athena Tutorial 15 Running the job with jobOptions Job is essentially steered by a conventional text file ( to be replaced by Python scripts after Release ) > athena jobOptions.txt Common entries in jobOptions.txt  Example of Standard Configuration #include “StandardAtlfastOptions.txt”  Prefix with env variable if not in local area #include " $ATHENACOMMONROOT/share/Atlas_Gen.UnixStandardJob.txt”  Maximum number of events to execute ApplicationMgr.EvtMax= 100;  Component shared libraries to be loaded ApplicationMgr.DLLs += { }  Top level algorithms: “Type/Name” ApplicationMgr.TopAlg += { }  Comments Preceded by //

Aug 27, 2003 Hong Ma, Athena Tutorial 16 More on jobOptions Algorithm and Service classes can declare “properties” that can be modified at runtime by jobOptions, e.g. ApplicationMgr.DLLs += {“MyReco”}; ApplicationMgr.TopAlg += {“MyAlgorithm/MyAlg1”}; MyAlg1.Threshold=50.;

Aug 27, 2003 Hong Ma, Athena Tutorial 17 Data files ATLAS Data Challenges produce large data samples requested by physics groups. Locate input files using DC1 websites  Check DC1 site for data samplesite Link to e/gamma, then to Z  ee, dataset Find the file with Magda  Use magda site for finding the logical filenamessite Search for LFN substring with “ simul” Find files like: dc simul hlt.Z_ee.zebra Retrieve data with magda command > magda_getfile dc simul hlt.Z_ee.zebra Symlink will be created in your directory

Aug 27, 2003 Hong Ma, Athena Tutorial 18 Guide for Physics Analysis at U.S.ATLAS A set of web pages that help end-users to start using ATLAS software for physics analysisweb pages  New User Guide for starting up at USATLAS ATLAS in general, and USATLAS specific  Physics Analysis Guide for all the components Supplement the existing ATLAS documentation  An example (H  ZZ*  e+e-e+e-) through the analysis chain: Generator  FastSimulation/FullSimulation  Reconstruction  Analysis  Production and Analysis Tools  Feedbacks are very welcome.

Aug 27, 2003 Hong Ma, Athena Tutorial 19 More on Analysis Guide How to generate Pythia Events using Generator software Fast simulation with ATLFAST. Analyzing ATLFAST ntuple. Production tools  For running Full Detector Simulation (ATLSIM)  For running Athena jobs in batch, (Reconstruction)  How to process large amount of data (~100k events) Analysis examples for Atlfast and reconstruction output  e.g.: Reconstruction/analysis of the DC1 SUSY sampleReconstruction/analysis of the DC1 SUSY sample