Status of MICE on the GRID  MICE VO u CEs  G4MICE Installation  Example test job  Station QA Analysis  Analysis jobs  File Storage  Documentation.

Slides:



Advertisements
Similar presentations
EGEE is a project funded by the European Union under contract IST EGEE Tutorial Turin, January Hands on Job Services.
Advertisements

SARA Reken- en NetwerkdienstenToPoS | 3 juni 2007 More efficient job submission Evert Lammerts SARA Computing and Networking Services High Performance.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
1 Approaching the Problem of Statistics David Forrest University of Glasgow CM23 HIT, Harbin January 14th.
1Malcolm Ellis - Video Conference - 7th December 2006 Data Challenge Report  Disclaimer  Data Challenge definition(s)  Software status u G4MICE u GRID.
Updates: Misalignment, Statistics David Forrest (Happy new year)
Analysis Meeting – – Slide 1 Beam momentum measurement using TOFs: progress report Analysis Meeting, February 2008 Mark Rayner.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
1 Statistics Toy Monte Carlo David Forrest University of Glasgow.
Tracker Misalignment Study David Forrest CM23 HIT, Harbin January 14 th.
1 Losses in the Cooling Channel Malcolm Ellis PID Meeting 1 st March 2005.
1 st Study of Tracker Misalignments with G4MICE David Forrest University of Glasgow.
1M. Ellis - MICE CM th February 2007 Software and Data Challenge  Introduction  Software Progress u Optics/Analysis u CKOV u SciFi Reconstruction.
1Malcolm Ellis - Software Meeting - 31st May 2006 Data Challenge Requirements  First list of requirements, based on Yagmur’s document: u
Oxford Jan 2005 RAL Computing 1 RAL Computing Implementing the computing model: SAM and the Grid Nick West.
1 Statistics David Forrest University of Glasgow.
1 Chris Rogers MICE Collaboration Meeting 11th Feb 2005 Tracking and Cooling performance of G4MICE.
Analysis of MICE Chris Rogers 1 Imperial College/RAL Thursday 28 October, With thanks to John Cobb.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio COMETA
Enabling Grids for E-sciencE gLite training at Sinaia '06 Victor Penso Kilian Schwarz GSI Darmstadt Germany.
1M. Ellis - MICE Video Conference - 15th March 2007 Software Report  New G4MICE Users  TOF Simulation and Digitisation  SciFi Reconstruction  Tracker.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania ICTP/INFM-Democritos Workshop on Porting Scientific.
GRID Computing: Ifrastructure, Development and Usage in Bulgaria M. Dechev, G. Petrov, E. Atanassov.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
1Malcolm Ellis - CM th October 2006 Status of Data Challenge  Don’t Shoot the Messenger!  Data Challenge – explanation  Software Tools u Design.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Nadia LAJILI User Interface User Interface 4 Février 2002.
Tracker Misalignment Study David Forrest University of Glasgow.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
22 nd September 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Sci-Fi Tracker: Progress Report Malcolm Ellis, MICE Video Conference Wednesday 6 th October 2004.
E-science grid facility for Europe and Latin America Using Secure Storage Service inside the EELA-2 Infrastructure Diego Scardaci INFN (Italy)
Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
G4MICE Status and Plans 1M.Ellis - CM24 - RAL - 31st May 2009  Firstly, a correction to the agenda:  I failed to spot a mistake in the agenda that I.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
1 Statistics David Forrest University of Glasgow May 5 th 2009.
1M. Ellis - NFMCC - 31st January 2007 MICE Analysis.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.
INFSO-RI Enabling Grids for E-sciencE Job Submission Tutorial (material from INFN Catania)
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
Your university or experiment logo here Performance Monitoring Gidon Moont e-Science, HEP, Imperial College London Talk to JRA1.
The GridPP DIRAC project DIRAC for non-LHC communities.
Development of test suites for the certification of EGEE-II Grid middleware Task 2: The development of testing procedures focused on special details of.
Software Overview 1M. Ellis - CM21 - 7th June 2008  Simulation Status  Reconstruction Status  Unpacking Library  Tracker Data Format  Real Data (DATE)
Analysis of job submissions through the EGEE Grid Overview The Grid as an environment for large scale job execution is now moving beyond the prototyping.
1 Statistics Update David Forrest University of Glasgow.
User Interface UI TP: UI User Interface installation & configuration.
Preliminery results from a 1 st study of misalignment and a fresh look at statistics David Forrest, University of Glasgow.
C++ / G4MICE Course Session 6 G4MICE Design and Domains Datacards Configurations (MiceModules) Using existing G4MICE Applications.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
M. Ellis - MICE Collaboration Meeting - Wednesday 27th October Sci-Fi Tracker Performance Software Status –RF background simulation –Beam simulation.
The Finite Difference Time Domain Method FDTD By Dr. Haythem H. Abdullah Researcher at ERI, Electronics Research Institute, Microwave Engineering Dept.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
Bulk production of Monte Carlo
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
Misalignment Study David Forrest University of Glasgow
Special Jobs: MPI Alessandro Costa INAF Catania
Simulation use cases for T2 in ALICE
login: clermont-ferrandxx password: GridCLExx
Status of MC production on the grid
gLite Job Management Christos Theodosiou
GENIUS Grid portal Hands on
Presentation transcript:

Status of MICE on the GRID  MICE VO u CEs  G4MICE Installation  Example test job  Station QA Analysis  Analysis jobs  File Storage  Documentation  Next Steps 1M. Ellis - CM th February 2008

MICE VO  VO = Virtual Organisation.  MICE VO has been setup for a while.  Now has a reasonable amount of computing resources (next slide).  To join the MICE VO you need to: u Obtain a GRID certificate u Request membership of the MICE VO using that certificate.  You can then submit jobs to the GRID. 2M. Ellis - CM th February 2008

CEs  CE = Computing Element.  We currently have computing resources provided for MICE by:  A little UK-heavy... 3M. Ellis - CM th February 2008 u Brunel u Imperial u QMUL u RHUL u Sheffield u Liverpool u ScotGRID u Glasgow u Sofia

G4MICE Installation  I have spent the past two weeks learning how to install software on the GRID and have now installed the most recent release of G4MICE (1-9-5) at: u Brunel u QMUL u RHUL u Sheffield  I hope to complete the rest in the next few weeks. 4M. Ellis - CM th February 2008

Example Test Job  Part of the installation process includes running a cycle of Simulation, Digitisation, Reconstruction and Analysis in ROOT to check that the software has installed correctly and is running.  This test has also been run by David Forrest and will be on the web as an example for new users (after a “Hello World” type of job). 5M. Ellis - CM th February 2008

Test Job – testmice.jdl [ VirtualOrganisation = "mice"; Executable = "g4mice_test.csh"; Arguments = "1-9-5"; StdOutput = "out.g4mice.test.txt"; StdError = "err.g4mice.test.txt"; InputSandbox = { "g4mice_test.csh", "cards.match", "cards.stage6" }; OutputSandbox = { "out.g4mice.test.txt", "err.g4mice.test.txt", "sample.root" }; RetryCount = 0; requirements = Member( "VO-mice-1-9-5", other.GlueHostApplicationSoftwareRunTimeEnvironment ) && other.GlueCEPolicyMaxWallClockTime>121 ; JobType = "normal"; Type = "Job" ] 6M. Ellis - CM th February 2008

Test Job – g4mice_test.csh #!/bin/csh #usage: g4mice_test.csh # Setup: set micever=${1} echo "Using G4MICE release ${micever}" source ${VO_MICE_SW_DIR}/mice-${micever}/setupmicegrid.csh echo "Generating a matched beam" ${MICESRC}/Applications/Matcher/Matcher cards.match echo "Simulating the beam" ${MICESRC}/Applications/Simulation/Simulation cards.stage6 echo "Digitising the simulated data" ${MICESRC}/Applications/Digitization/Digitization cards.stage6 echo "Reconstructing the simulated data" ${MICESRC}/Applications/Reconstruction/Reconstruction cards.stage6 echo "Generating a ROOT file" ${MICESRC}/Applications/RootHistograms/RootHistograms ls -ltrh echo "Test job is done" 7M. Ellis - CM th February 2008

Test Job – cards.match ! Cards to make a matched 2.5 pi beam in the upstream tracker in step 6 ! MiceModel MICEStage6/Stage6.dat numEvts 1000 ZOffsetStart mm !the point at which the beam is generated InputBeamFileName for0028.matched.dat !the name of the file that is generated ! NormalisedCanonicalAngularMomentum 0. LatticeStart mm !the start of the cooling channel lattice LatticeEnd mm !the end of the cooling channel lattice EnergyAtLatticeStart 226. MeV !energy of the reference particle at the lattice start TransverseEmittance 2.5 mm !transverse emittance of the beam at the start of the lattice LongitudinalEmittance 0.13 ns !longitudinal emittance of the beam at the start of the lattice ! 8M. Ellis - CM th February 2008

Test Job – cards.stage6 !****General MiceModel MICEStage6/Stage6.dat ! numEvts 1000 ! ZOffsetStart mm InputBeamFileName for0028.matched.dat !the name of the file that is generated BeamType ICOOL ! 9M. Ellis - CM th February 2008

Test Job - Operation 10M. Ellis - CM th February 2008

StationQA Analysis  To launch the “Data Challenge” I have re-run the analysis of all of the StationQA data from the tracker entirely on the GRID.  The data was transferred to a storage element at Brunel (setup by Henry) and the GRID jobs retrieved the files for each Station and ran the analysis application on them. 11M. Ellis - CM th February 2008

StationQA on the GRID  Data from 12 Stations (6-17) analysed.  Total of 12,389,135 events processed.  167 of 173 files transferred (6 failures are being investigated).  Total of GB data was transferred, unzipped and reconstructed.  Total time from starting first job to end of last job: 4 hours and 6 minutes! 12M. Ellis - CM th February 2008

Analysis Jobs  David Forrest is starting up a major production of 96 different geometrical configurations that will be simulated with high statistics to assess the impact of various misalignments and rotations on emittance measurement. 13M. Ellis - CM th February 2008

File Storage  Apart from the special storage that Henry set up for the station QA, we do not have the full infrastructure required for storing large amounts of data.  This requires an LFC to be setup.  Need to work out who will set this up, where it will be hosted... 14M. Ellis - CM th February 2008

Documentation  Now that there are usable resources, I will start to write up some documentation on the web to help people get started with getting a certificate, joining the VO and running jobs. 15M. Ellis - CM th February 2008

Next Steps  Complete installation of mice on remaining CEs.  Work with Henry and others to setup an LFC.  Post documentation on the MICE website.  Launch David’s large simulation and analysis production. 16M. Ellis - CM th February 2008