5/2/20071.  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.

Slides:



Advertisements
Similar presentations
11th April 2008TOF DA & ppChiara Zampolli. DAQ-DA Three DAQ-DAs implemented, deployed, validated, and tested: TOFda TOFnoiseda TOFpulserda DCS-DA One.
Advertisements

Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.
QA train tests M. Gheata. Known problems QA tasks create too many histograms – Pushing resident memory limit above 3GB – Train gets kicked out by some.
Chiara Zampolli in collaboration with C. Cheshkov, A. Dainese ALICE Offline Week Feb 2009C. Zampolli 1.
SSD Status P. Christakoglou (NIKHEF-UU) for the SSD collaboration Thanks to: Marco vL, Enrico, Mino, Marek and Massimo.
ALICE Trigger and Event Selection QA 1Kevin McDermott By: Kevin McDermott August 9, Michigan REU Student Program – Final Presentations.
Experience with analysis of TPC data Marian Ivanov.
Framework for Raw Data Thomas Kuhr Offline Week 29/06/2004.
PHOS offline status report Yuri Kharlov ALICE offline week 7 April 2008.
STAR Analysis Meeting, BNL, Dec 2004 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software and calibration L3 display 200 GeV February.
1 CTP offline software status (Offline week) A.Jusko and R.Lietava.
V4-20-Release P. Hristov 08/08/ Changes: v4-20-Rev-38 #85151 Memory leak in T0 DQM agent. From rev #85276 AliGRPPreprocessor.cxx: Port to.
Offline report – 7TeV data taking period (Mar.30 – Apr.6) ALICE SRC April 6, 2010.
DQM status report Y. Foka (GSI) Offline week from pp to PbPb.
Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Planning and status of the Full Dress Rehearsal Latchezar Betev ALICE Offline week, Oct.12, 2007.
1 ITS Quality Assurance (& DQM) P. Cerello, P. Christakoglou, W. Ferrarese, M. Nicassio, M. Siciliano ALICE OFFLINE WEEK – April 2008.
CERN – Alice Offline – Thu, 20 Mar 2008 – Marco MEONI - 1 Status of Cosmic Reconstruction Offline weekly meeting.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
TPC QA + experience with the AMORE framework Marian Ivanov, Peter Christiansen + GSI group.
HLT/AliRoot integration C.Cheshkov, P.Hristov 2/06/2005 ALICE Offline Week.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
Status of the Shuttle Framework Alberto Colla Jan Fiete Grosse-Oetringhaus ALICE Offline Week October 2006.
October Test Beam DAQ. Framework sketch Only DAQs subprograms works during spills Each subprogram produces an output each spill Each dependant subprogram.
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
ALICE Offline Week October 4 th 2006 Silvia Arcelli & Chiara Zampolli TOF Online Calibration - Strategy - TOF Detector Algorithm - TOF Preprocessor.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
Summary of Workshop on Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Computing Day February 28 th 2005.
Alignment in real-time in current detector and upgrade 6th LHCb Computing Workshop 18 November 2015 Beat Jost / Cern.
PHOS offline status report Yuri Kharlov ALICE offline week 7 July 2008.
Offline Weekly Meeting, 24th April 2009 C. Cheshkov & C. Zampolli.
Calibration algorithm and detector monitoring - TPC Marian Ivanov.
 offline code: changes/updates, open items, readiness  1 st data taking plans and readiness.
V4-20-Release P. Hristov 21/02/ Changes: v4-20-Rev-14 #78385 Please port AliTPCPreprocessor.cxx Rev to Release #78344 Request to port changes.
Some topics for discussion 31/03/2016 P. Hristov 1.
D. Elia (INFN Bari)Offline week / CERN Status of the SPD Offline Domenico Elia (INFN Bari) Overview:  Response simulation (timing info, dead/noisy.
AliRoot survey: Calibration P.Hristov 11/06/2013.
D. Elia (INFN Bari)ALICE Offline week / CERN Update on the SPD Offline Domenico Elia in collaboration with H. Tydesjo, A. Mastroserio Overview:
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
10/8/ HMPID offline status D. Di Bari, A. Mastroserio, L.Molnar, G. Volpe HMPID Group Alice Offline Week.
V4-19-Release P. Hristov 11/10/ Not ready (27/09/10) #73618 Problems in the minimum bias PbPb MC production at 2.76 TeV #72642 EMCAL: Modifications.
ALICE Offline Week – 22 Oct Visualization of embedding Matevz Tadel, CERN Adam Kisiel, Ohio State University.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
CALIBRATION: PREPARATION FOR RUN2 ALICE Offline Week, 25 June 2014 C. Zampolli.
V4-18-Release P. Hristov 21/06/2010.
Christoph Blume Offline Week, July, 2008
Analysis trains – Status & experience from operation
Massimo Masera INFN sezione di Torino
v4-19-Release & v4-20-Release
Calibrating ALICE.
v4-18-Release: really the last revision!
Commissioning of the ALICE HLT, TPC and PHOS systems
AliRoot status and PDC’04
Progress with MUON reconstruction
ALICE Offline Week, CERN
Experience between AMORE/Offline and sub-systems
Analysis framework - status
TPC status - Offline Q&A
Corr framework Computing in High Energy and Nuclear Physics
Use of Geant4 in experiment interactive frameworks AliRoot
CMS Pixel Data Quality Monitoring
Offline framework for conditions data
Presentation transcript:

5/2/20071

 Online  Offline 5/2/20072

 Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework  Structure of the framework  Collect and calculate parameters, fill histograms while taking data  Live display of histograms and out-of-range check or comparison with reference histograms (stored in OCDB)  Purpose  Check integrity of data  Alert the person on shift on a malfunctioning of the detectors 5/2/20073

 Online  Offline  Simulation: raw data, digits (same as online)  Reconstruction: all intermediate steps until ESD  Purpose  Check for software bugs  Provide crude alarms  Provide QA histograms which users control (visual examination) by comparing with (running) reference histograms (stored in OCDB) 5/2/20074

 Online  Offline  Structure of the framework: job level (1) 1. During simulation, calculate parameters and fill histograms, kept on local disk of WN (root session 1) 2. Run the QA tasks after simulation is done and update log file (root session 2) 3. Parse the simulation log, if error: set the job status, update Tags and optionally stop 4. During reconstruction, calculate parameters and fill histograms, kept on local disk of WN (root session 3) 5. Run the QA tasks after reconstruction is done and update log file (root session 4) 6. Parse the reconstruction log, if error: set the job status, update Tags and optionally stop 7. Run the QA on ESD, produce histograms, make tests and update the log file (root session 5) 8. Parse the ESD QA log, if error: set the job status and update Tags 9. Check all QA and optionally stop the run 5/2/20075

 Online  Offline  Structure of the framework: job level (2) 1. Run simulation (root session 1) 2. Run the QA tasks, fill QA histograms from RAW and Digits, and update log file (root session 2) 3. Parse the simulation log, if error: set the job status, update Tags and optionally stop 4. Run reconstruction (root session 3) 5. Run the QA tasks, fill QA and update log file (root session 4) 6. Parse the reconstruction log, if error: set the job status, update Tags and optionally stop the job 7. Run the QA on ESD, produce histograms, make tests and update the log file (root session 5) 8. Parse the ESD QA log, if error: set the job status and update Tags 9. Check all QA and optionally stop the run 5/2/20076

 Online  Offline  Structure of the framework: ≥ event level, ≤run level 1. Run simulations and reconstructions and associated QA tasks until the required statistics is reached 2. Merge the QA histograms (simulation, reconstruction ESD) 3. Run QA tasks 4. Parse the log, if error: set the jobs status and update Tags 5. Check all QA and optionally stop the production 5/2/20077

 Online  Offline  Requirements 1. QA objects per detector produced either during sim/rec or after 2. QA tasks per detector (simulation, reconstruction) 3. QA tasks per detector, per PWG4 (ESD QA) 4. Same QA tasks for real and sim RAW 5. Keep QA histograms in the AliEn catalog 6. New input in Tags 7. The framework must be able to set/update job status 8. The framework must be able to decide what to do in case of errors 5/2/20078

 QA Analysis tasks in $ALICE_ROOT/ESDCheck  Input = ESD; Output/det=histograms (root file) + plots+log  Detectors: EMCal, FMD, HMPID, MUON, PHOS, PMD, T0, TOF, TRD, VZERO  Missing: ITS, TPC  Train: $ALICE_ROOT/ESDCheck/ana.C  Steering macro: $ALICE_ROOT/ESDCheck/CheckESD.sh  launch the train,  parse the log,  provide summary status 5/2/20079

10 August 9, 2007

 The QA object :  one bit map per detector  Signalling problems with different levels of secverity  In different tasks among: simulation (on line data), reconstruction, ESDs, analysis 5/2/200711

 Three steps are needed 1. Creation and archiving of reference data  Valid for a set of runs 2. Creation and archiving of input data  One data set per run (sim ≡ several events; data ≡ an ALICE run) 3. Performing QA test and archiving test result  Separate job (different from the jobs which create the data)  Can be perfomed on a subset of data large than run 5/2/200712

 Data must be mergeable  Archiving is done in AliEn using the standard directory structure (not OCDB), local storage is possible too  Reference : …..QA/Ref/ (no idea yet how to deal with versions)  Data and QA: ….Run/ (no idea yet how to deal with versions)  Data are build in the event loop of the appropriate task (Sdigitizer, Digitizer, Tracker)  It is the responsibility of the detectors to implement the QA control in their tasks 5/2/200713

 QA results for all detectors and all tasks in a dingle root file with a directory structure  The framework provides  AliQualAss ::TNamed  Singleton  One bit array per detector  Naming conventions (detectors, tasks, files…)  Setting, Checking, Storing 5/2/200714

 The framework provides  AliQualAssDataMaker::TNamed  Base Class  Creation of directory structure for QA results: Init()  Saving of results: Finish()  Steer for the processing Exec()  The detectors provide  AliDetQualAssDataMaker:: AliQualAssDataMaker  Implement initialisation of data objects (TH1,….)  Implement filling of data objects  Steer the QA data making from each task producing data 5/2/200715

 The framework provides  AliQualAssDataChecker::TNamed  Steers the QA check for all detectors and all tasks  Opens Ref and data file (Setters in a QA.C macro)  Does the QA for all objects stored in the QA data file  Updates the QA result  Saves the QA results file  AliQualAssDataCheckerBase::Tnamed  Called by preceeding  Initialises the QA object and sets appropriate detector and task  Retrieves/Saves the QA result file  Does the Check 5/2/200716

 The framework provides  AliQualAssDataCheckerBase::TNamed  Called by preceeding  Initialises the QA object and sets appropriate detector and task  Retrieves/Saves the QA result file  Comparison methods ( Diff () Kolmogorov, Chi2,…)  A simple checker  Implements a simple Check (Diff of all objects (TH1) in the data file)  The detectors provide  AliQualAssDetChecker::AliQualAssDataCheckerBase  Overloads the comparison Check() 5/2/200717

 Detectors  AliDetxxxxx (SDigitizer, Digitizer, etc.)  Data member : AliDetQualAssDataMaker * fqa  Ctor: fqa->Init(AliQualAss::kHITS(kSDIGITS) ;  Event loop: fqa->SetData(hits(sdigits)) fqa->Exec()  Its different for ESDs which is the responsibility of the framework  AliReconstruction  In the event loop, same as for the other tasks 5/2/200718

 Aliroot –b –q QA.C  AliQualAssChecker qac ;  qac.SetRefDir(“…/…/…/) ;  qac.SetOutDir(“…/…/…/);  qac.Run() ;  To be run after sim.C and rec.C  The QA data file is on the local dir of the WN 5/2/200719

 Implement the AliEn file access  Versionning scheme for Reference data and of QA results data  Granularity of QA data  Correct all the misconceptions and illegal implementations which will be discovered by Peter.  What to do with the QA results  Publish  Test and action  Implement the QA online  QA data made on line in MOOD  At end of run ship the data to FXS  Preprocessor Algorithm to make the QA  Ship with the shuttle the QA results and QA data to AliEn  Have the QA test running in MOOD 5/2/200720