EMU Reference Histogram Comparison Unit R. Cavanaugh, V. Barashko, A. Korytov.

Slides:



Advertisements
Similar presentations
Web Services at IRIS DMC Joanna Muench Linus Kamb.
Advertisements

DQM Services: Status and Plans DQM Workshop (CMS week) – 28 February 2007 Christos Leonidopoulos CERN PH for the EvF/DQM group.
GCT Software ESR - 10th May 2006 Jim Brooke. Jim Brooke, 10 th May 2006 HAL/CAEN Overview GCT Driver GCT GUI Trigger Supervisor Config DB Test scripts.
Online Monitoring and plane checkout Online monitoring is used at the mine for: –sanity checks - “is everything working” –diagnostics - rates, hot/dead.
Andrey Korytov July 2, Data Quality TB 2004 Andrey Korytov.
RPC Trigger Software ESR, July Tasks subsystem DCS subsystem Run Control online monitoring of the subsystem provide tools needed to perform on-
US FAST site test results – a global view from ROOT T. Ferguson, A. Korytov, N. Terentiev* EMU Meeting University of Florida 01/09/2004.
US Some Preliminary Test Beam Results T. Ferguson, N. Terentiev*, I. Vorobiev CMS EMU Meeting Fermilab Oct , 2004.
US FAST site EMU CSC test results – a global view from ROOT N. Terentiev (Carnegie Mellon University) Fermilab July 23, 2004.
Slide 1 Anthony Affolder US Module LT meeting June 17, 2004 UCSB Module LT Testing.
US FAST site test results – a global view from ROOT T. Ferguson, A. Korytov, N. Terentiev* EMU Meeting University of Florida 01/09/2004.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
US FAST site test results – a global view from ROOT T. Ferguson, A. Korytov, N. Terentiev* CMS EMU Meeting The Ohio State University April 16 – 17, 2004.
US LPC Muon Group CMSSW code development efforts N. Terentiev Carnegie Mellon University CMS EMU Meeting, Florida Institute of Technology February 17-18,
US FAST site test results – a global view from ROOT T. Ferguson, A. Korytov, N. Terentiev* CMS EMU Meeting The Ohio State University April 16 – 17, 2004.
CSC Online and Offline DQA Status Ken Johns, Venkat Kaushik, Xiaowen Lei (U. Arizona)
Data Quality Monitoring for CMS RPC A. Cimmino, D. Lomidze P. Noli, M. Maggi, P. Paolucci.
Web Application Architecture: multi-tier (2-tier, 3-tier) & mvc
S. Durkin, USCMS-EMU Meeting, Oct. 21, 2005 Critical Data Errors S. Durkin The Ohio State University USCMS EMU Meeting, FNAL, Oct. 20, 2005.
MuonDPG/RPC M. Maggi INFN Bari. DQM tool for the DCS data Control Analysis Tool (CAT) by Cimmino, Lomidze, Paolucci, Polese To 1.Make custom DCS data.
A. Cimmino - P. Paolucci - G. Polese / DCS meeting DQM tool for the DCS data What the RPC community needs: 1.Make online/offline DCS data.
Quality Control B. von Haller 8th June 2015 CERN.
Games Development 2 Entity / Architecture Review CO3301 Week
Data Quality Monitoring of the CMS Tracker
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
JAS3 + AIDA LC Simulations Workshop SLAC 19 th May 2003.
Status of the CSC Track-Finder Darin Acosta University of Florida.
Michael Still Google Inc. October, Managing Unix servers the slack way Tools and techniques for managing large numbers of Unix machines Michael.
Tracker data quality monitoring based on event display M.S. Mennea – G. Zito University & INFN Bari - Italy.
OFFLINE TRIGGER MONITORING TDAQ Training 5 th November 2010 Ricardo Gonçalo On behalf of the Trigger Offline Monitoring Experts team.
RPC DQA but also Monitoring for the DCS group: status and prospective for Marcello Bindi RPC L1MU Barrel DQM - 08/05/2013.
V.Sirotenko, July Status of Online Databases Currently there are 2 online Oracle Databases running on d0online cluster: 1.Production DB, d0onprd,
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
Cathode Strip Chamber (CSC) Raw Data Unpacking and Packing using bit field data classes Alex Tumanov, Rick Wilkinson September 2007.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
ASP (Active Server Pages) by Bülent & Resul. Presentation Outline Introduction What is an ASP file? How does ASP work? What can ASP do? Differences Between.
4 Dec 2008G. Rakness (UCLA)1 Online Software Updates and RPC data in the RAT …including Pad Bit Mapping and Efficiency… Greg Rakness University of California,
September 2007CHEP 07 Conference 1 A software framework for Data Quality Monitoring in ATLAS S.Kolos, A.Corso-Radu University of California, Irvine, M.Hauschild.
February 07, 2002 Online Monitoring Meeting Detector Examines Should aid in: 1.Diagnosing problems early and getting it fixed 2.Making decisions on the.
RPC DQM status Cimmino, M. Maggi, P. Noli, D. Lomidze, P. Paolucci, G. Roselli, C. Carillo.
CMS Latency Review, 13th March 2007CSC Trigger 1 Latency and Synchronization update.
Source Controller software Ianos Schmidt The University of Iowa.
Online (GNAM) and offline (Express Stream and Tier0) monitoring produced results during cosmic/collision runs (Oct-Dec 2009) Shifter and expert level monitoring.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
Pixel DQM Status R.Casagrande, P.Merkel, J.Zablocki (Purdue University) D.Duggan, D.Hidas, K.Rose (Rutgers University) L.Wehrli (ETH Zuerich) A.York (University.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
Rack Wizard LECC 2003 Frank Glege. LECC Frank Glege - CERN2/12 Content CMS databases - overview The equipment database The Rack Wizard.
S. Durkin, Software Review, March 16, 2006 FED Library S. Durkin The Ohio State University CSC Online Software Review, March 16,2005.
Monitoring Update David Lawrence, JLab Feb. 20, /20/14Online Monitoring Update -- David Lawrence1.
Correlator GUI Sonja Vrcic Socorro, April 3, 2006.
Exploring C-Chem with numeric MM and Ab-Initio methods Masood Malekghassemi.
Jan 7, 2002E. Gallas/Trigger Db1 Trigger Database and Trigger Configurations and Trigger Issues Elizabeth Gallas, Jeremy Simmons (Fermilab - Computing.
Notes in preparation by the Torino group Sara BolognesiDT Cosmic Meeting 01/11/2007  MTCC note:  calibration section  DQM section  Internal note about.
MUSIC GENRE JUKEBOX. CLIENT SPECIFICATIONS Audio Player Create, delete, and modify play lists Play, pause, stop, skip, fast forward, and rewind Send Streaming.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
1 Update on CompareTFandDMBLCTs.cc Analyzer that compares LCTs read out from the Track Finder (input FIFO) with those read out through the EMU data path.
Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
Commissioning and run coordination CMS week Commissioning plenary 28-February 2007 DQM and monitoring workshop MandateGoals.
Exploring C-Chem with numeric MM and Ab-Initio methods Masood Malekghassemi.
Online Data Monitoring Framework Based on Histogram Packaging in Network Distributed Data Acquisition Systems Tomoyuki Konno 1, Anatael Cabrera 2, Masaki.
MET Slice Monitoring Xiaowen Lei, Venkat Kaushik Ken Johns.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
6 April 2007G. Rakness (UCLA) 1 CSC runs at minus side slice test 27 Mar – 5 Apr Color scheme: Successes Problems/questions Greg Rakness University.
QC-specific database(s) vs aggregated data database(s) Outline
“Golden” Local Run: Trigger rate = 28Hz
CSC Trigger Primitives Test Beam Studies
DQM for the RPC subdetector
Pierluigi Paolucci & Giovanni Polese
Games Development 2 Entity / Architecture Review
Presentation transcript:

EMU Reference Histogram Comparison Unit R. Cavanaugh, V. Barashko, A. Korytov

EMU DQM Architecture DQM unpacking analysis DATA DQM unpacking analysis DATA DQM control and monitor Display server HIST concentrator HIST-REF comp. unit DQM DB interface DQM contr/mon log HIST files REF files DQM problem reports actions Problem correlator Run Control Warning display GUI Unpacking Analysis DATA Plot display GUI ? DQM active problems cond/config DB DQM control and monitor (Dec 11, 2004)

EMU DQM Architecture DQM unpacking analysis DATA DQM unpacking analysis DATA DQM control and monitor Display server HIST concentrator HIST-REF comp. unit DQM DB interface DQM contr/mon log HIST files REF files DQM problem reports actions Problem correlator Run Control Warning display GUI Unpacking Analysis DATA Plot display GUI ? DQM active problems cond/config DB Reference Histogram Comparisons DQM control and monitor (Dec 11, 2004)

Different EMU Types of Histograms & Canvases EMU DQM Canvas (Histograms) Hierarchy –DDU CSC Chamber (ID by crate and slot of DMB) –ALCT »8 canvases –CFEB »4 canvases –CLCT »9 canvases –SYNC »5 canvases –DMB »5 canvases –CSC Efficiency canvas 14 DDU canvases Total of 46 different “types” of canvases per DDU –Each canvas contains 1 or more histograms –Each DDU contains several chambers –Not yet finished defining additional canvases… “Summary” : produces a (global) high-level report –for all tests with references or rules –for all “types” of canvases –for all chambers.

Different Kinds of Tests using Different Reference Sources Static Reference Sources –A Previous Run –Ideal Conditions (from detector knowledge) –etc Dynamic Reference Sources –Current Run –Rules (from detector knowledge) –Etc –Important because running conditions often change Tests –Current Run vs. A Previous Run –Current Run vs. Ideal Conditions –Current Run vs. Current Run –Current Run vs. Rules –etc ME1 ME2 ME3 ME4 DT-10 DT-11 e.g. within a run, compare chamber performance against expected similar chambers

Current Design from EMU DQM Architecture RefHistComparator produces summary report every ~5 min –Updates DB RefServer continuously updates histos –Sends reference canvases to Display GUI Display GUI should be as light as possible –Should be agnostic about different canvases and references GUI easier to maintain and always works –All the hard work is done on the DisplayServer OnlineServer REF-HIST Comparator Unit DisplayServer histo list GUI Display Online Stream Staticetc “Database” Summary Ref0Server Ref1Server Ideal RefNServer

Current Design Thoughts Design a base class container for reference canvases of all chambers –Of a particular canvas type! Design different reference comparison classes for each “type” of canvas For each canvas “type”, specify associated –References –Rules –Tests –(local) Summary Results

Current Design Thoughts Contains reference canvases (of a certain type) for all chambers

Current Design Thoughts Rules and Tests used to compare reference to online canvases associated with a certain type

Current Design Thoughts Produce summary report for all tests performed for this particular type of canvas

Current Design Thoughts List of all tests performed on all types of canvases

Current Design Thoughts Produce global summary report for all tests performed for all types of canvases

Current Design Thoughts Buffers to be sent to GUI to compare online canvases with different references (0,1,…,N)

Current Design from EMU DQM Architecture RefHistComparator produces summary report every ~5 min –Updates DB RefServer continuously updates histos –Sends reference canvases to Display GUI Display GUI should be as light as possible –Should be agnostic about different canvases and references GUI easier to maintain and always works –All the hard work is done on the DisplayServer OnlineServer REF-HIST Comparator Unit DisplayServer histo list GUI Display Online Stream Staticetc “Database” Summary Ref0Server Ref1Server Ideal RefNServer

histo list HistoDisplay Current Implementation Given an online histogram, RefHistComp can –Find & read static corresponding reference histogram –Send reference histogram to GUI for human comparison RefHistComp does not yet –Automatically compare online with reference –Produce summary report –Fully work with Dynamic References EmuMonitor Data.bin OnlineServer REF-HIST Comparator Unit EmuDisplayServer Ref.root Detector Ref0Server Ref1Server

Conclusion The Ref-Hist Comparator Unit is designed to –Allow comparisons with a variety of different references Both manual and automatic Both static and dynamic –Periodically produce summary report of problems Based on rules & tests Current prototype is still rather basic –Not all functionality is implemented / debugged E.g. Dynamic refs are prototyped, but not yet ready for release –Still iterating on final design (which may depend on CMS DQM) –Currently being tested & used in the EMU slice test Prototype is somewhat particular to current EMU DQM Package Interested to understand better how these ideas fit in with the overall CMS DQM picture