Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.

Slides:



Advertisements
Similar presentations
Advanced Workgroup System. Printer Admin Utility Monitors printers over IP networks Views Sharp and non-Sharp SNMP Devices Provided Standard with Sharp.
Advertisements

M. Adinolfi - University of Bristol1LHCb software week - 18/06/2009 Offline monitoring Marco Adinolfi University of Bristol.
CDF Steve Hahn January 13, CDF Operations Summary Thurs. Fri. Sat. Mon. Tues. Wed. Stores long enough for accounting in bold Don ’ t believe! Generally,
CMS ECAL Prompt Feedback Group Toyoko J. Orimoto, California Institute of Technology A Brief History: From GRUMM to First BeamThe Future of the ECAL PFG.
Data Quality Assurance Linda R. Coney UCR CM26 Mar 25, 2010.
Online Reconstruction Update Linda R. Coney UCR Mar 25, 2010.
Online Reconstruction Update Linda R. Coney UCR Dec 17, 2009.
Alarms and Events - Processing and Logging Project Mentors Suneel Kumar Venugopal Vanga.
Data Quality Monitoring for CMS RPC A. Cimmino, D. Lomidze P. Noli, M. Maggi, P. Paolucci.
CMS Alignment and Calibration Yuriy Pakhotin on behalf of CMS Collaboration.
First year experience with the ATLAS online monitoring framework Alina Corso-Radu University of California Irvine on behalf of ATLAS TDAQ Collaboration.
O FFLINE T RIGGER M ONITORING TDAQ Training 30 July 2010 On behalf of the Trigger Offline Monitoring Experts team.
Data Quality Monitoring of the CMS Tracker
L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.
CLAS12 CalCom Activity CLAS Collaboration Meeting, March 6 th 2014.
Central DQM Shift Tutorial Online/Offline. Overview of the CMS DAQ and useful terminology 2 Detector signals are collected through individual data acquisition.
Central DQM Shift Tutorial Online/Offline. Overview of the CMS DAQ and useful terminology 2 Detector signals are collected through individual data acquisition.
Central DQM Shift Tutorial Online/Offline. Overview of the CMS DAQ and useful terminology 2 Detector signals are collected through individual data acquisition.
5. Data Manager 1. Introduction 2. Data Manager Duties 3. Quality Checking 4. Problem Reporting 5. Data Monitoring 6. Histogram Presenter 7. Trend Presenter.
06/03/06Calice TB preparation1 HCAL test beam monitoring - online plots & fast analysis - - what do we want to monitor - how do we want to store & communicate.
Requirements Review – July 21, Requirements for CMS Patricia McBride July 21, 2005.
STAR Analysis Meeting, BNL, Dec 2004 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software and calibration L3 display 200 GeV February.
Real data reconstruction A. De Caro (University and INFN of Salerno) CERN Building 29, December 9th, 2009ALICE TOF General meeting.
André Augustinus 10 September 2001 DCS Architecture Issues Food for thoughts and discussion.
ATLAS Liquid Argon Calorimeter Monitoring & Data Quality Jessica Levêque Centre de Physique des Particules de Marseille ATLAS Liquid Argon Calorimeter.
Tracker data quality monitoring based on event display M.S. Mennea – G. Zito University & INFN Bari - Italy.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
Detector Diagnostics Calibration Analysis Ped/LED/Laser RadDam Analysis Detector Optimization Lumi Detector Performance Monitoring DQM On/Offline Prompt.
OFFLINE TRIGGER MONITORING TDAQ Training 5 th November 2010 Ricardo Gonçalo On behalf of the Trigger Offline Monitoring Experts team.
A.Golunov, “Remote operational center for CMS in JINR ”, XXIII International Symposium on Nuclear Electronics and Computing, BULGARIA, VARNA, September,
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
Jennifer Thompson Western Michigan University Fermi National Accelerator Lab PST Program July 29, 2008 Mentors: Steve Hahn and JJ Schmidt.
1 ECS CALO HV Control CALO Piquet Training Session Anatoli Konoplyannikov /ITEP/ Outline  ECS HV control of the ECAL/HCAL sub-detectors.  Introduction.
STAR Collaboration Meeting, BNL, Feb 2005 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software update L3 display 200 GeV February.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
ALICE Pixel Operational Experience R. Santoro On behalf of the ITS collaboration in the ALICE experiment at LHC.
Part I – Shifter Duties Part II – ACR environment Part III – Run Control & DAQ Part IV – Beam Part V – DCS Part VI – Data Quality Monitoring Part VII.
September 2007CHEP 07 Conference 1 A software framework for Data Quality Monitoring in ATLAS S.Kolos, A.Corso-Radu University of California, Irvine, M.Hauschild.
T0 offline status Alla Maevskaya for T0 team 8 March 2011 ALICE offline week.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
February 07, 2002 Online Monitoring Meeting Detector Examines Should aid in: 1.Diagnosing problems early and getting it fixed 2.Making decisions on the.
1 A first look at the KEK tracker data with G4MICE Malcolm Ellis 2 nd December 2005.
RPC DQM status Cimmino, M. Maggi, P. Noli, D. Lomidze, P. Paolucci, G. Roselli, C. Carillo.
Online Monitoring for the CDF Run II Experiment T.Arisawa, D.Hirschbuehl, K.Ikado, K.Maeshima, H.Stadie, G.Veramendi, W.Wagner, H.Wenzel, M.Worcester MAR.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
Online (GNAM) and offline (Express Stream and Tier0) monitoring produced results during cosmic/collision runs (Oct-Dec 2009) Shifter and expert level monitoring.
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
Pixel DQM Status R.Casagrande, P.Merkel, J.Zablocki (Purdue University) D.Duggan, D.Hidas, K.Rose (Rutgers University) L.Wehrli (ETH Zuerich) A.York (University.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
Prompt Calibration Loop 11 February Overview Prompt calibration loop in SCT –Provides ATLAS with conditions data used for the bulk reconstruction.
May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.
ScECAL Beam FNAL Short summary & Introduction to analysis S. Uozumi Nov ScECAL meeting.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
L1Calo EM Efficiencies Hardeep Bansil University of Birmingham L1Calo Joint Meeting, Stockholm 29/06/2011.
LHC CMS Detector Upgrade Project RCT/CTP7 Readout Isobel Ojalvo, U. Wisconsin Level-1 Trigger Meeting June 4, June 2015, Isobel Ojalvo Trigger Meeting:
Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.
ID Week 13 th of October 2014 Per Johansson Sheffield University.
Calibration algorithm and detector monitoring - TPC Marian Ivanov.
L1Calo EM Efficiency Maps Hardeep Bansil University of Birmingham L1Calo Weekly Meeting 07/03/2011.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
THIS MORNING (Start an) informal discussion to -Clearly identify all open issues, categorize them and build an action plan -Possibly identify (new) contributing.
Central DQM Shift Tutorial Online/Offline
RPC Data Certification
Experience between AMORE/Offline and sub-systems
Data Quality Monitoring of the CMS Silicon Strip Tracker Detector
Central DQM Shift Tutorial Online/Offline
CMS Pixel Data Quality Monitoring
DQM for the RPC subdetector
CMS Pixel Data Quality Monitoring
Presentation transcript:

Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM Online expert system analyzes those histograms and flags any possible error detected. The DQM Online monitor (running inside the CDF control room) displays the status of online consumers and detectors, as well as beam conditions. Colors indicate: error (red), warning (yellow), ok (green) and no decision (cyan). User is able to disable or enable different sub-detectors. An error log is kept for each run and it is available via the WWW. A voice alarm is triggered to alert the shift crew of any problems. The online monitor GUI determines the Online Good Run Bits and writes them into the online database. DQM Online decisions are monitored daily and validated by DQM representatives. Data Quality Management CSL Online Consumer Monitors (L3 Objects, % events) PhysMonTrigMonXMon YMon ACEs SciCo CO DataBaseOnline Good Run GUI DQM Responsible on call Alarm!! SPL’s CDF Collaboration ValidationExe (Streams A/B/C) WWW DataBase DQM bits DQM Online Run Summary Alarm!! After data is reprocessed… ……. RC DQM Offline (expert system) Detectors HV Status During data taking... ONLINE OFFLINE (DQM) Beam Lines ProductionExe Calibrations Look for empty channels A GUI interface (to be used by detector experts) keeps a reference database of good and bad channels and allows the DQM expert system to identify ‘already- known’ problems GUI to update problematic channels The DQM Offline system uses histograms produced during the offline reprocessing (Production+Validation) of the data, where the latest calibration and alignment constants are used to reconstruct high-level objects (electrons,. Photons, jets, J/ , etc..) employed in physics analyses. A number of critical quantities are selected, enough to provide a complete characterization of the quality of the data. The DQM Online system uses histograms produced by Consumer Monitors to make a complete diagnostic, in real-time, of the detector’s status. It monitors the basic performance of the different sub-systems (occupancies, high-voltages, dead/hot channels,etc..) It also identifies possible problems inside a run, and marks the affected run-sections differently, in order to ignore them in the physics analyses. Fundamental quantities and high-level physics objects are reconstructed taking into account the latest calibration constants and beam lines reconstructed offline. The expert system implements the logic to automatically analyze the critical histograms and evaluate the quality of the data. The DQM Online decision is also used as an input. The errors detected (either due to raw detector quantities or caused by offline reconstruction codes) are promptly reported to detector experts (SPL’s). The final DQM results are translated into a set of bits and collected on databases. In addition, complete documentation is provided via Web pages and regular reports to CDF. Lists of Good Runs are defined using the DQM decisions, that are combined according to different quality requirements as established within each physics group. J/  Reconstructed Mass The position and the width of the reconstructed J/  mass peak, and the relative size of signal and background (sideband) regions, are sensitive to the global performance of the CDF tracking system, as well as to the algorithms for track reconstruction, calibration constants and beam-line position. DQM Online (expert system) IFAE-CDF group has taken major responsibilities on data quality control of the physics data collected by the experiment. This implies the design and construction of 'online' and 'offline' DQM expert systems. They will allow IFAE to perform a real-time 'online' control check of the data being collected, as well as to validate the 'offline' reconstruction of high-level objects used in physics analyzes. Official lists of 'good runs' are provided based on DQM decisions on data quality. for the CDF Experiment Regular reports DQM Critical Histograms