Setup and run athena locally and on grid Cunfeng feng 2005.9.19.

Slides:



Advertisements
Similar presentations
ATLAS-LNF-SITE-INFO GRID User Interface –GLITE_ROOT "/afs/lnf/project/atlas/soft/soft1/glite_UI_WN“ –Setup Source /afs/lnf.infn.it/project/atlas/soft/LCG/scripts/UI-
Advertisements

Alain Romeyer - January Light higgs decay in SUSY cascade - Status report Introduction Trigger efficiency B tagging Jet calibration Invariant mass.
Steve LloydGridPP13 Durham July 2005 Slide 1 Using the Grid Steve Lloyd Queen Mary, University of London.
Dayu Zhang 9/8/2014 Lab02. Example of Commands pwd --- show your current directory This is home of venus, not your home directory Tilde: means you are.
Warped extra dimensions lepton signatures in ATLAS O.K. Baker Hampton University (K. McFarlane, V. Vassilakopoulos, T. Shin) SUSY05.
10/01/2007 Installing and Using ATLAS Distribution in LNF Release
ATLAS Software Kaushik De University of Texas At Arlington based on a tutorial by P. Calafiura (LBNL) LHC Computing Workshop, Ankara May 2, 2008.
FULL CHAIN SIMULATION of CMS DETECTOR Ijaz Ahmed National centre for Physics, Islamabad.
Very quick ATLAS software tutorial Iacopo Vivarelli (not an expert, just a user) INFN Pisa What you find here: - How to use CMT and run Athena - How to.
The Atlas Software Distribution Christian ArnaultAlessandro De SalvoSimon GeorgeGrigori Rybkine
GETTING STARTED ON THE GRID: W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED.
Enabling Grids for E-sciencE gLite training at Sinaia '06 Victor Penso Kilian Schwarz GSI Darmstadt Germany.
Tiesheng Dai & Steven Goldfarb US–ATLAS Muon Alignment & Calibration Software Workshop Boston University – 18 Dec 2008 Tiesheng Dai & Steven Goldfarb US–ATLAS.
26 April 2005Steve Armstrong1 High Level Trigger Software Tutorial Steve Armstrong Brookhaven National Laboratory 26 April 2005 ATLAS Trigger/DAQ Week.
Linux environment ● Graphical interface – X-window + window manager ● Text interface – terminal + shell.
Muon Reconstruction Tutorial Tiesheng Dai, Steven Goldfarb Dec , 2008 at Boston Univ. US Muon Alignment and Calibration Software Workshop 1.Find.
Steps toward ttH (H->bb) in the Atlas ‘PhysicsAnalysis’ Environment. Chris Collins-Tooth Christian Shaw.
How to run RSM on imtf4 As of 2010/8/2 by Kei Yoshimura (AORI)
End of term post-mortem presentation - ATLAS and me Michael Nash UCL RAL joint studentship.
Jets and Missing-ET in the Atlantis Event Display Qiang Lu, Juergen Thomas, Peter Watkins (Birmingham) Hans Drevermann (CERN) Andrew Haas (Columbia) Eric.
Stan Bentvelsen - NIKHEF P 1. Stan Bentvelsen - NIKHEF P 2.
As of 28 Juni 2005Getting Starged with GEM - Shuei Yamada 1 Getting Started with GEM Shuei YAMADA ICEPP, University of Tokyo What is GEM? Before you start.
CMT Christian Arnault - LAL - Chep /18 Introduction What is CMT, its goals Operating CMT The concepts in CMT, the internal model Status, implementation.
Generation of Radiative B-Decays Decay Channels Bs  Phi + Gamma Bd  K * + Gamma Gareth Brown, RAL PPD5/10/06 Thanks to, Bill, John, Monica and Julie.
The report on the current situation of the BESIII framework zhangxiaomei maqiumei 10/3/2004.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
INFSO-RI Enabling Grids for E-sciencE ATLAS Distributed Analysis A. Zalite / PNPI.
M. Schott (CERN) Page 1 CERN Group Tutorials CAT Tier-3 Tutorial October 2009.
AOD Data in Atlantis Event Display Qiang Lu, Juergen Thomas, Peter Watkins (Birmingham) Hans Drevermann (CERN) Andrew Haas (Columbia) Eric Jansen, Pieter.
Use of Gaudi in Reconstruction Weidong Li 23/06/2004.
Alexander Richards, UCL 1 Atlfast and RTT (plus DCube) Christmas Meeting 18/12/2007.
June 22, 2007USATLAS T2-T3 DQ2 0.3 SiteServices Patrick McGuigan
Paris package: practical aspects Installation / presentation To run a simulation Analysis To add a new module to Paris Installation / presentation To run.
Nurcan Ozturk University of Texas at Arlington US ATLAS Transparent Distributed Facility Workshop University of North Carolina - March 4, 2008 A Distributed.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Tutorial on Testbeam Software - CERN, March 10th 2005 Daniela Rebuzzi – Pavia University and INFN CTB_G4Sim Simulation.
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
Post-DC2/Rome Production Kaushik De, Mark Sosebee University of Texas at Arlington U.S. Grid Phone Meeting July 13, 2005.
Update on Diffractive Dijet Production Search Hardeep Bansil University of Birmingham Birmingham ATLAS Weekly Meeting 24/01/2013.
Analysis Tools Tutorial: Demonstration/Example/Exercise Ketevi A. Assamagan CERN, September 20 th, 2004.
22.July.2003 M.Smizanska: EvtGen in ATLAS EvtGen in ATLAS Outline: ATLAS EvtGen users: General requirements ATLAS EvtGen B-physics group requirements ATLAS.
B. Resende Top WG 28/10/05 Polarization studies in ttbar events 1 Polarization studies in tt events with full simulation 1.Physics motivations 2.Full simulation.
Linux A practical introduction. 1)Background and Getting Started Linux is an operating system with multiple providers Red Hat/CentOS (our version) Ubuntu.
1 April 2, 2004, Athena tutorial, FZU, PragueZdeňka Broklová SCT Simulation for CTB Status and HowTos Zdenka Broklova, Carlos Escobar, Peter Kodys.
BESIII Offline Software Development Environment Ma qiumei * Development environment * Configuration & management tool * Software development.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
C. Loomis – Demonstration-Dec. 12, n° 1 Testbed 1 Demonstration December 12, 2001
Advanced Athena Tutorial ADL/StoreGate ADL Exercises CERN, May/Mai 5, 2002.
CERN Tutorial, September Overview of LHCb applications and software environment.
Manifold Lab 1 Setting the environment Compiling/running programs.
Alain Romeyer - Sept Light Higgs search in SUSY cascades Introduction (Previous studies) Plans for this analysis Simulation chain Reconstruction.
27/02/04 ATLAS weekTileCal Athena tutorial, part 21 TileCal Athena tutorial Part 2: Reading GEANT hits from ZEBRA and POOL Reading HLT and testbeam ByteStream.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
User Interface UI TP: UI User Interface installation & configuration.
Bologna Tutorial, June Overview of LHCb applications and software environment.
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
Marcello Barisonzi First results of AOD analysis on t-channel Single Top DAD 30/05/2005 Page 1 AOD on Single Top Marcello Barisonzi.
Installing the ATLAS Offline Software Frederick Luehring Indiana University June 20, 2007 “Setting Up a Tier 3 Center (I)” Session.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
An AOD analysis example Esteban Fullana Torregrosa High Energy Physics Division Argonne National Laboratory.
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
Wouter Verkerke, NIKHEF Status of DC3 (CSC) production Wouter Verkerke (NIKHEF)
AOD example analysis Argonne Jamboree January 2010
The ATLAS software in the Grid Alessandro De Salvo <Alessandro
GPAMELA Alessandro Bruno.
Jets and Missing-ET in the Atlantis Event Display
gLite Job Management Christos Theodosiou
Introduction to Athena
Grid Management Challenge - M. Jouvin
Presentation transcript:

Setup and run athena locally and on grid Cunfeng feng

Setup work environmental The athena kits have been install in ui.hepg.sdu.edu.cn The athena kits have been install in ui.hepg.sdu.edu.cn You should have account in UI. You should have account in UI. Setup work directory in ui (from Li Hengne report) Setup work directory in ui (from Li Hengne report) cd /home/atlas/tools/pacman-3.11 cd /home/atlas/tools/pacman-3.11 source setup.sh source setup.sh cd /home/atlas/AtlasRelease cd /home/atlas/AtlasRelease source setup.sh source setup.sh source dist/10.0.3/Control/AthenaRunTime/*/cmt/setup.sh source dist/10.0.3/Control/AthenaRunTime/*/cmt/setup.sh cd /home/fengcf/ cd /home/fengcf/ >mkdir – p work/ >mkdir – p work/ >cd work/ >cd work/ pacman – get /home/atlas/AtlasReleases :10.0.3/AtlasRelease-slc3_ia32-opt pacman – get /home/atlas/AtlasReleases :10.0.3/AtlasRelease-slc3_ia32-opt ls ls o..pacman..o setup.csh setup.pl setup.py setup.sh trusted.cache o..pacman..o setup.csh setup.pl setup.py setup.sh trusted.cache

CVS Access Help : Help : mv /home/fengcf/.ssh /home/**/.ssh mv /home/fengcf/.ssh /home/**/.ssh get identify to CVS ( use account) get identify to CVS ( use mv /home/fengcf/work/10.0.3/setup.sh /home/**/work/ mv /home/fengcf/work/10.0.3/setup.sh /home/**/work/ or just adjust your work/setup.sh same as mine or just adjust your work/setup.sh same as mine (set CVSROOT) (set CVSROOT) source setup.sh source setup.sh cd work/ cd work/ cmt co – r AthExHelloWorld Control/AthenaExamples/AthExHelloWorld cmt co – r AthExHelloWorld Control/AthenaExamples/AthExHelloWorld ssh ( don ’ t need passward) ssh ( don ’ t need

Modifying Athena Helloworld cd work/ cd work/ source ~/atlas setup.sh source ~/atlas setup.sh cmt co – r AthExHelloWorld Control/AthenaExamples/AthExHelloWorld cmt co – r AthExHelloWorld Control/AthenaExamples/AthExHelloWorld cmt co – r UserAnalysis PhysicsAnalysis/AnalysisCommon/UserAnalysis cmt co – r UserAnalysis PhysicsAnalysis/AnalysisCommon/UserAnalysis cd Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld /src cd Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld /src vi HelloWorld.cxx vi HelloWorld.cxx cd../cmt cd../cmt cmt config cmt config source setup.sh source setup.sh gmake gmake cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/UserAnalysis /run cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/UserAnalysis /run get_files HelloWorldOptions.py get_files HelloWorldOptions.py Athena.py HelloWorldOptions.py Athena.py HelloWorldOptions.py

ATLAS analysis code install cd work/ cd work/ source ~/atlas setup.sh source ~/atlas setup.sh cmt co – r AnalysisExamples PhysicsAnalysis/Analysiscommon/AnalysisExamples cmt co – r AnalysisExamples PhysicsAnalysis/Analysiscommon/AnalysisExamples You will something like: You will something like: /home/fengcf/work/10.0.3/PhysicsAnalysis/Analysis Common/AnalysisExamples/AnalysisExamples /ls /home/fengcf/work/10.0.3/PhysicsAnalysis/Analysis Common/AnalysisExamples/AnalysisExamples /ls AnalysisExamples cmt doc python scripts src AnalysisExamples cmt doc python scripts src ChangeLog CVS mergingAOD run share ChangeLog CVS mergingAOD run share

Run ATHENA cd cmt cd cmt cmt config cmt config source setup.sh source setup.sh gmake gmake “ InstallArea ” will appear in you work/10.0.3/ after above operation. “ InstallArea ” will appear in you work/10.0.3/ after above operation. cd../share cd../share vi ttbarExample_jobOptions.py vi ttbarExample_jobOptions.py cd../run cd../run athena.py../ttbarExample_jobOptions.py athena.py../ttbarExample_jobOptions.py

ttbarExample_jobOption.py

Run again copy /home/fengcf2/atlas setup.sh /home/**/. copy /home/fengcf2/atlas setup.sh /home/**/. cd work/10.0.3/ cd work/10.0.3/ source ~/atlas setup.sh source ~/atlas setup.sh cd PhysicsAnalysis/Analysis/Common/AnalysisExaples/AnalysisE xamples /src cd PhysicsAnalysis/Analysis/Common/AnalysisExaples/AnalysisE xamples /src vi *.cxx vi *.cxx cd../cmt cd../cmt cmt config cmt config source setup.sh source setup.sh gamke gamke cd../run/ cd../run/

Modify the code We has add some code in AnalysisExamples We has add some code in AnalysisExamples You can just copy the file in my src, share, AnalysisExamples to the same directory where you work. You can just copy the file in my src, share, AnalysisExamples to the same directory where you work. cmt/gmake cmt/gmake vi share/ttbarExample_jobOptions_small.py vi share/ttbarExample_jobOptions_small.py cd run/ cd run/ athena.py../share/ttbarExample_jobOptions_small.py athena.py../share/ttbarExample_jobOptions_small.py

Rome files form: rome.AAAAAA.TYPE.DECS._NUM.END AAAAAA: AAAAAA: 0040xx and 0049xx is a single particle sample (RomeCalibrationWiki) 0040xx and 0049xx is a single particle sample (RomeCalibrationWiki)RomeCalibrationWiki 0041xx is a "background sample" (RomeBackgroundWiki) 0041xx is a "background sample" (RomeBackgroundWiki)RomeBackgroundWiki 0042xx is a sample owned by the standard model group (RomeStandardWiki) 0042xx is a sample owned by the standard model group (RomeStandardWiki)RomeStandardWiki 0043xx is a sample owned by the Higgs group (RomeHiggsWiki) 0043xx is a sample owned by the Higgs group (RomeHiggsWiki)RomeHiggsWiki 0044xx is a sample owned by the SUSY group (RomeSUSYWiki) 0044xx is a sample owned by the SUSY group (RomeSUSYWiki)RomeSUSYWiki 0045xx is a sample owned by the Top (RomeTopWiki) 0045xx is a sample owned by the Top (RomeTopWiki)RomeTopWiki 0046xx is a sample owned by the Exotics group (RomeExoticWiki) 0046xx is a sample owned by the Exotics group (RomeExoticWiki)RomeExoticWiki 0047xx is a sample owned by the B-group (RomeBWiki) 0047xx is a sample owned by the B-group (RomeBWiki)RomeBWiki 0048xx (xx =01 to 49) is a sample owned by the jet/missing Et group group (JetMissingET) 0048xx (xx =01 to 49) is a sample owned by the jet/missing Et group group (JetMissingET)JetMissingET 0048xx (xx =50 to 99) is a sample owned by b-tagging group (RomeBtagging) 0048xx (xx =50 to 99) is a sample owned by b-tagging group (RomeBtagging)RomeBtagging

TYPE: TYPE: evgen corresponding to generated events evgen corresponding to generated events simul corresponding events processed by Geant-4 simul corresponding events processed by Geant-4 digi corresponding to digitised events with no pile up (with noise) digi corresponding to digitised events with no pile up (with noise) lumi01 corresponding to digitised events with 1x10**33 pile up (with noise) lumi01 corresponding to digitised events with 1x10**33 pile up (with noise) reco is an output from reconstruction reco is an output from reconstruction

DECS: string provides a short discription of the data (e.g. ttbarWp) DECS: string provides a short discription of the data (e.g. ttbarWp) NUM: starting from NUM: starting from END: log or pool.root END: log or pool.root in case of TYPE=reco, END=pool.root for ESD in case of TYPE=reco, END=pool.root for ESD END=CBNT.root for CBNT END=CBNT.root for CBNT END=AOD.pool.root for AOD END=AOD.pool.root for AOD

Samples Rome samples : and Rome samples : and semileptonic ttbar events (l = e, mu) semileptonic ttbar events (l = e, mu) Parameters Parameters Mtop=175 GeV Mtop=175 GeV CTEQ5L(The Coordinated Theoretical-Experimental Project on QCD ) CTEQ5L(The Coordinated Theoretical-Experimental Project on QCD ) ISR/FSR on ISR/FSR on Multiple Interaction = DC2 Multiple Interaction = DC2 Q-scale = default Toprex (sqrt(M top **2+P T ttop**2) Q-scale = default Toprex (sqrt(M top **2+P T ttop**2) Generation : Generation : TopReX 4.09 and Pythia 6.226, with spin correlation TopReX 4.09 and Pythia 6.226, with spin correlation Simulation, digitization : Simulation, digitization : Initial detector geometry Initial detector geometry Reconstruction : Reconstruction : Use AOD Use AOD

Rome.*.recov10.ttbarW*._*.AOD.pool.root Without pileup Without pileup ref : W- decays to leptons (e, mu), W+ decays to jets (Wm) ref : W- decays to leptons (e, mu), W+ decays to jets (Wm) ref : W+ decays to leptons (e, mu), W- decays to jets (Wp) ref : W+ decays to leptons (e, mu), W- decays to jets (Wp) NLO cross-section:125pb NLO cross-section:125pb

Rome data Part of rome ttbar AOD data copied to /home/fengcf2/data/romeTopAOD/ Part of rome ttbar AOD data copied to /home/fengcf2/data/romeTopAOD/ rome recov10.ttbarWp._00001.AOD.pool.root rome recov10.ttbarWp._00001.AOD.pool.root Part of them with error, don ’ t us: Part of them with error, don ’ t us: the file whose size is 0 the file whose size is run/testDataSample.py include all the data file run/testDataSample.py include all the data file

On grid tar – cvlpf checkout.tar Control PhysicsAnalysis tar – cvlpf checkout.tar Control PhysicsAnalysis vi HelloWorld.cxx (copy from Control/ … ) vi HelloWorld.cxx (copy from Control/ … ) vi hello.sh vi hello.sh vi hello.jdl vi hello.jdl grid-proxy-init grid-proxy-init edg-job-submit – vo atlas – o jobID hello.jdl edg-job-submit – vo atlas – o jobID hello.jdl

On grid Hello.sh Hello.sh #!/bin/bash #!/bin/bash # Script to run AthenaHelloWorld on the Grid # Script to run AthenaHelloWorld on the Grid source $VO_ATLAS_SW_DIR/software/10.0.1/setup.sh source $VO_ATLAS_SW_DIR/software/10.0.1/setup.sh source $SITEROOT/dist/10.0.1/Control/AthenaRunTime/*/cmt/setup.sh source $SITEROOT/dist/10.0.1/Control/AthenaRunTime/*/cmt/setup.sh export CMTPATH=`pwd`:$CMTPATH export CMTPATH=`pwd`:$CMTPATH # Create the checked out package then replace the modified file # Create the checked out package then replace the modified file tar -xf checkout.tar tar -xf checkout.tar cp HelloWorld.cxx Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld /src/ cp HelloWorld.cxx Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld /src/ # Rebuild # Rebuild cd Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld /cmt cd Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld /cmt cmt config cmt config source setup.sh source setup.sh gmake gmake cd../../../../.. cd../../../../.. athena.py HelloWorldOptions.py athena.py HelloWorldOptions.py

On grid Hello.jdl Hello.jdl ############# Athena ################# ############# Athena ################# Executable = "hello.sh"; Executable = "hello.sh"; StdOutput = "hello.out"; StdOutput = "hello.out"; StdError = "hello.err"; StdError = "hello.err"; InputSandbox = {"hello.sh","HelloWorldOptions.py","checkout.tar","HelloWorld.cxx"}; InputSandbox = {"hello.sh","HelloWorldOptions.py","checkout.tar","HelloWorld.cxx"}; OutputSandbox = {"hello.out","hello.err", "CLIDDBout.txt"}; OutputSandbox = {"hello.out","hello.err", "CLIDDBout.txt"}; Requirements = Member("VO-atlas-release ", Requirements = Member("VO-atlas-release ", other.GlueHostApplicationSoftwareRunTimeEnvironment); other.GlueHostApplicationSoftwareRunTimeEnvironment); ###################################### ######################################

Using Don Quijote (ATLAS Experiment Data Management System ) Install DQ Install DQ cd cd wget wget tar xvzf dms2.tgz tar xvzf dms2.tgz dms2.py search ‘ rome.*AOD.pool.root ’ dms2.py search ‘ rome.*AOD.pool.root ’ dms2.py get rome reco.ZeeJimmy._00001.AOD.pool.root -- catalog=PoolFileCatalog.xml --copy --remote dms2.py get rome reco.ZeeJimmy._00001.AOD.pool.root -- catalog=PoolFileCatalog.xml --copy --remote (copy a file to the current directory and create a POOL catalogue file PoolFileCatalog.xml) (copy a file to the current directory and create a POOL catalogue file PoolFileCatalog.xml)

Run ATHENA locally CMT CMT mkdir cmthome mkdir cmthome cd cmthome cd cmthome source /home/atlas/AtlasReleases/CMT/v1r16p /mgr/steup.sh source /home/atlas/AtlasReleases/CMT/v1r16p /mgr/steup.sh vi requirements vi requirements cmt config cmt config

Requirements Requirements # # # LOGIN REQUIREMENTS FILE # LOGIN REQUIREMENTS FILE # Copy file into your cmthome directory and amend where shown # Copy file into your cmthome directory and amend where shown # Usage instructions are at the end of the file # Usage instructions are at the end of the file set CMTSITE CERN set CMTSITE CERN set SITEROOT /home/atlas/AtlasReleases set SITEROOT /home/atlas/AtlasReleases macro ATLAS_DIST_AREA ${SITEROOT}/dist/10.0.3/ macro ATLAS_DIST_AREA ${SITEROOT}/dist/10.0.3/ # use optimised version by default # use optimised version by default apply_tag opt apply_tag opt # Set the location of your preferred development area # Set the location of your preferred development area # You should then work in a sub directory e.g. ${HOME}/testarea/ # You should then work in a sub directory e.g. ${HOME}/testarea/ macro ATLAS_TEST_AREA ${HOME}/work macro ATLAS_TEST_AREA ${HOME}/work use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA)

In cern lxplus cd $HOME cd $HOME > mkdir cmthome > mkdir cmthome > mkdir testarea > mkdir testarea > mkdir testarea/ (this is the directory in which you will work) > mkdir testarea/ (this is the directory in which you will work) > cd cmthome > cd cmthome > source /afs/cern.ch/sw/contrib/CMT/v1r16p /mgr/setup.sh [or.csh] > source /afs/cern.ch/sw/contrib/CMT/v1r16p /mgr/setup.sh [or.csh] >vi requirements >vi requirements >cmt config >cmt config Now kill the terminal window and log back in