Alexander Richards, UCL 1 Atlfast and RTT (plus DCube) Christmas Meeting 18/12/2007.

Slides:



Advertisements
Similar presentations
Masterclass Introduction to hands-on Exercise Aim of the exercise Find out what happens in proton-proton collisions at the LHC as seen by the ATLAS.
Advertisements

Types of Data SimTracks: generated particles SimHits: energy depositions in a detector volume Digis: Single-channel pieces of the detector’s raw binary.
Analysis Meeting – April 17 '07 Status and plan update for single hadron scale check with minimum bias events N. Davidson.
My work PAST WORKS: 1) (Madrid) Data Analysis in L3, LEP: - Measurement of the Mass, Width and Cross Section of the W boson production at LEP, Study.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University.
Update on Corsika Simulation 29 June 2015 Fabrizio Coccetti 1.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
The RunTimeTester - where to now? Eric NZUOBONTANE Peter SHERWOOD Brinick SIMMONS 29 th July 2004.
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
Steps toward ttH (H->bb) in the Atlas ‘PhysicsAnalysis’ Environment. Chris Collins-Tooth Christian Shaw.
2004 Xmas MeetingSarah Allwood WW Scattering at ATLAS.
Software Validation Infrastructure for the ATLAS Trigger Wolfgang Ehrenfeld – DESY On behalf of the ATLAS Trigger Validation Group CHEP 2009 – Prague –
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
0 Status of Shower Parameterisation code in Athena Andrea Dell’Acqua CERN PH-SFT.
Alexander Toropin Generator Services monthly meeting 6 June 2007 GENSER status.
BeamCal Simulations with Mokka Madalina Stanescu-Bellu West University Timisoara, Romania Desy, Zeuthen 30 Jun 2009 – FCAL Meeting.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
19/07/20061 Nectarios Ch. Benekos 1, Rosy Nicolaidou 2, Stathes Paganis 3, Kirill Prokofiev 3 for the collaboration among: 1 Max-Planck-Institut für Physik,
Andreas Morsch, CERN EP/AIP CHEP 2003 Simulation in ALICE Andreas Morsch For the ALICE Offline Project 2003 Conference for Computing in High Energy and.
CHEP06, Mumbai-India, Feb 2006V. Daniel Elvira 1 The CMS Simulation Validation Suite V. Daniel Elvira (Fermilab) for the CMS Collaboration.
1 Some validation of AlpGen and TopRex Stan Bentvelsen Feb 18 th, 2004.
A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.
9-13/9/03 Atlas Overview WeekPeter Sherwood 1 Atlfast, Artemis and Atlantis What, Where and How.
1 Using Jupiter and Satellites Akiya Miyamoto KEK Jan 2006.
Analysis trains – Status & experience from operation Mihaela Gheata.
Nurcan Ozturk University of Texas at Arlington US ATLAS Transparent Distributed Facility Workshop University of North Carolina - March 4, 2008 A Distributed.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Masterclass Introduction to hands-on Exercise Aim of the exercise  Identify electrons (e), muons (  ), neutrinos( ) in the ATLAS detector  Types.
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – April 12, 2007 Outline: Reminder of plans Status of infrastructure.
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
PHENIX and the data grid >400 collaborators 3 continents + Israel +Brazil 100’s of TB of data per year Complex data with multiple disparate physics goals.
A New Tool For Measuring Detector Performance in ATLAS ● Arno Straessner – TU Dresden Matthias Schott – CERN on behalf of the ATLAS Collaboration Computing.
PESAsim – the e/  analysis framework Validation of the framework First look at a trigger menu combining several signatures Short-term plans Mark Sutton.
Masterclass Introduction to hands-on Exercise Aim of the exercise  Identify electrons, muons, neutrinos in the ATLAS detector  Types of Events.
Update on Diffractive Dijet Production Search Hardeep Bansil University of Birmingham Birmingham ATLAS Weekly Meeting 24/01/2013.
S. MuanzaSimulation Meeting 16 September 2005 Relative Tuning of the Pythia Underlying Event for Recent PDFs OUTLINE I.Introduction and Methodology II.Tools.
Jean-Roch Vlimant, CERN Physics Performance and Dataset Project Physics Data & MC Validation Group McM : The Evolution of PREP. The CMS tool for Monte-Carlo.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
FTKSim Status and plans FTK Meeting 07/13/2006 F. Crescioli, M. Dell'Orso, G. Punzi, G.Volpi, P. Giannetti.
Masterclass 2011 MINERVA Masterclass ‘Discover the Cosmos’ Teachers’ Workshop 29 th February 2012 Hardeep Bansil.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
Fast Simulation and the Higgs: Parameterisations of photon reconstruction efficiency in H  events Fast Simulation and the Higgs: Parameterisations of.
Software Tools for Layout Optimization (Fermilab) Software Tools for Layout Optimization Harry Cheung (Fermilab) For the Tracker Upgrade Simulations Working.
John MarshallPandora Development1 J.S. Marshall University of Cambridge.
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
The “Comparator” Atlfast vs. Full Reco Automated Comparison Chris Collins-Tooth 19 th February 2006.
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Introduction to the Athena Software Hong Ma BNL Athena Tutorial USATLAS Software Workshop.
27/02/04 ATLAS weekTileCal Athena tutorial, part 21 TileCal Athena tutorial Part 2: Reading GEANT hits from ZEBRA and POOL Reading HLT and testbeam ByteStream.
UK LVL1 Meeting, RAL, 31/01/00Alan Watson 1 ATLAS Trigger Simulations Present & Future? What tools exist? What are they good for? What are the limitations?
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
Introduction to FCC Software FCC Istanbul 11 March, 2016 Alice Robson (CERN/UNIGE) on behalf of / with thanks to the FCC software group.
24 Jul 01 Simulation Meeting1 Status of PMS Sarah Eno.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
John Marshall, 1 John Marshall, University of Cambridge LCD WG6 Meeting, February
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
Tracking, Computing & other Stuff. Correlation of detector hits The track segments of inner and outer MDCs are matched on Cluster level The track segments.
Simon Dean UCL Christmas Meeting 15/12/2008 "A bit of fast simulation and ttH"
AOD example analysis Argonne Jamboree January 2010
papas: CMS single particle tuning
Introduction to hands-on Exercise
Tree based validation tool for track reconstruction
Cadet Lieutenant Amanda Fort USMA Class of 2009 From Stratham, NH
Presentation transcript:

Alexander Richards, UCL 1 Atlfast and RTT (plus DCube) Christmas Meeting 18/12/2007

Alexander Richards, UCL 2 Atlfast Fast Simulation Package

3 Alexander Richards, UCL ATLAS fast simulation It includes most crucial detector aspects: jets reconstruction in the calorimeter, momentum/energy smearing for leptons and photons, magnetic fields effects and missing transverse energy It provides, starting from the list of particles in the event, the list of reconstructed jets, isolated leptons and photons and expected missing transverse energy. Optionally package provides a list of reconstructed charge tracks What is Atlfast ?

4 Alexander Richards, UCL Smearing functions replace full chain 4-5 orders of magnitude faster than full simulation What is Atlfast ?

5 Alexander Richards, UCL How does it perform? Full simulation + reconstruction takes ~½ hr per event. Atlfast test jobs in x faster than full chain 2376 s307 sTotal (includes initialisation) 200 ms12.6 msPythia execute per event 21.8 ms8.15 msAtlfast execute per event ttH(H  bb) (10k, Pythia) Z  ee (10k, Pythia) Sample

6 Alexander Richards, UCL Instructions on web  (static UCL page)  AtlfastDocumentation (Atlas TWiki portal) Easiest way is to  Set up a release directory  Set up run time environment (athena)  'get_files XXXXtoAtlfasttoYYYY.py' XXXX is Pythia or POOL YYYY is CBNT, AOD and in r12 AAN  Configure script  'athena XXXXtoAtlfasttoYYYY.py' How to run Atlfast?

7 Alexander Richards, UCL Some plots! High Pt Low Pt QCD Jet Sample

8 Alexander Richards, UCL Towards "Atlfast Phase 2" FastCaloSim  Parameterised showers in a full calorimeter Fatras  Fast tracking via hit simulation More "Atlas", less "Fast"

9 Alexander Richards, UCL Timing still prohibitive but getting better..... Project is at validation stage Towards "Atlfast Phase 2" M. Duehrssen

Alexander Richards, UCL 10 RTT Run Time Tester

11 Alexander Richards, UCL What is ATLAS RTT? “The ATLAS RTT is a tool for developers which provides them with a convenient way to test, on a nightly basis, both the status and the output that any changes to their code may have had.” Does it run? Is the output the same as expected – regression tests/root macros ATLAS RTT lets you automate: ● Running Athena (as well as non-Athena) jobs. ● Running post-job activities i.e. ROOT macros, regression tests and user specified Python scripts. ● Publishing all results to a (web served) user specified directory.

12 Alexander Richards, UCL How does it work? Several NICOS builds occur each night –’Nightlies’ When Complete the build ready flag set and RTT can begin RTT scans all packages in the release for those which require RTT tests RTT then proceeds in two steps: Firstly the Data Copier checks to make sure that any data requested by the jobs is available and if not it copies it to the running directory Secondly the RTT tests are begun and results updated in ‘near real-time’ to the results webpage.

13 Alexander Richards, UCL RTT Results results/weeklyTable/weekly.php

14 Alexander Richards, UCL RTT Results

15 Alexander Richards, UCL RTT Results

16 Alexander Richards, UCL Including RTT jobs For RTT to pick up that your package requires RTT tests you must add lines to your requirements file. RTT steered by an.xml configuration file, which must be store it in a subdirectory of your package called ‘test’..xml file may be validated on the RTT main page:  Every job must belong to a ‘jobgroup’, the name of which must be registered with one of the RTT developers. Jobs belonging to a job group are treated the same way by the RTT with respect to any post Athena actions/tests. As many jobgroups as required may be registered to your package.

17 Alexander Richards, UCL Example configuration file

Alexander Richards, UCL 18 DCube Histogram Comparison

19 Alexander Richards, UCL What is DCube? DCube is a histogram comparison package. Can be run interactively or as part of RTT Capable of comparing 1D and 2D histos with:  Kolmogorov-Smirnov test    test  Bin-by-bin comparison Results generated in user friendly web format

20 Alexander Richards, UCL How does it work? DCube is steered by.xml configuration file. Config file picked up and run in RTT by a post athena macro called DCubeRunner.xml file specifies the following:  Absolute location of a reference ROOT file  Name of the file to compare with this reference file, called the Monitored file  Which of the three types of tests to perform  The P-values to mark ‘warning’ and ‘failure’ threshold for stats tests Both reference and monitored files may contain multiple histos each of which may have any of the three tests performed on it

21 Alexander Richards, UCL DCube Results

22 Alexander Richards, UCL DCube Results

23 Alexander Richards, UCL DCube Results

24 Alexander Richards, UCL DCube Results

25 Alexander Richards, UCL Summary With RTT we have the ability to test the stability of code on a nightly basis. With the addition of DCube we can now check the ‘stability of our physics’ on a nightly basis Future plans include creating physics validation plots for both GeneratorsRTT and TestAtlfast packages.

26 Alexander Richards, UCL