OFFLINE TRIGGER MONITORING TDAQ Training 5 th November 2010 Ricardo Gonçalo On behalf of the Trigger Offline Monitoring Experts team.

Slides:



Advertisements
Similar presentations
Legal Meetings: Extended Instructions on Movica and Screencast.
Advertisements

Substitute Online Staff Training Advanced. Substitute Online – Advanced Top Navigation Options.
Anatoli Romaniouk, TRT IB meeting October 30 th 2013 TRT Tasks/Responsibilities/Manpow er issues. 1.
SurveyMonkey for National Partnerships Agreements (NPA) Educational Measurement and School Accountability Directorate (EMSAD)
Releases & validation Simon George & Ricardo Goncalo Royal Holloway University of London HLT UK – RAL – 13 July 2009.
Accessing and Using the e-Book Collection from EBSCOhost ® When an arrow appears, click to proceed to the next slide at your own pace. To go back, click.
Clara Gaspar on behalf of the LHCb Collaboration, “Physics at the LHC and Beyond”, Quy Nhon, Vietnam, August 2014 Challenges and lessons learnt LHCb Operations.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 11: Monitoring Server Performance.
CSC DQA and Commissioning Summary  We are responsible for the online and offline DQA for the CSC system, a US ATLAS responsibility  We are ready for.
First year experience with the ATLAS online monitoring framework Alina Corso-Radu University of California Irvine on behalf of ATLAS TDAQ Collaboration.
O FFLINE T RIGGER M ONITORING TDAQ Training 30 July 2010 On behalf of the Trigger Offline Monitoring Experts team.
From Olivier to commissioning team plans for the start-up of regular operations of LHCb 30/06 to 4/07 : Global commissioning week, all detectors, full.
CLEO’s User Centric Data Access System Christopher D. Jones Cornell University.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
Central DQM Shift Tutorial Online/Offline. Overview of the CMS DAQ and useful terminology 2 Detector signals are collected through individual data acquisition.
Central DQM Shift Tutorial Online/Offline. Overview of the CMS DAQ and useful terminology 2 Detector signals are collected through individual data acquisition.
Central DQM Shift Tutorial Online/Offline. Overview of the CMS DAQ and useful terminology 2 Detector signals are collected through individual data acquisition.
5. Data Manager 1. Introduction 2. Data Manager Duties 3. Quality Checking 4. Problem Reporting 5. Data Monitoring 6. Histogram Presenter 7. Trend Presenter.
Offline Tracker DQM Shift Tutorial. 29/19/20152 Tracker Shifts Overview Online Shifts at P5 (3/day for 24 hours coverage) – One Pixel shifter and one.
ATLAS Data Periods in COMA Elizabeth Gallas - Oxford ATLAS Software and Computing Week CERN – April 4-8, 2011.
Easy Chair Online Conference Submission, Tracking and Distribution Process: Getting Started + Information for Reviewers AMS World Marketing Congress /
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
Trigger Offline Monitoring Report Valeria Bartsch (Sussex), Ricardo Gonçalo (RHUL) Trigger General Meeting – 26 th May 2010.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What GGUS can do for you JRA1 All hands.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Plans for Trigger Software Validation During Running Trigger Data Quality Assurance Workshop May 6, 2008 Ricardo Gonçalo, David Strom.
Friday Oct 30Monday Nov Data09_cos Data09_calophys Data09_cos Data09_calophys Data09_calophys Some of the last.
Offline shifter training tutorial L. Betev February 19, 2009.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 11: Monitoring Server Performance.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Overview of STEP09 monitoring issues Julia Andreeva, IT/GS STEP09 Postmortem.
Trigger Offline Expert Report Simon George (RHUL), Ricardo Gonçalo (RHUL) Trigger General Meeting – 25 th November 2009.
Run Coordination Summary of the May 14, 2004 Run Coordinator Meeting CT-EC2 Run Preparation Meeting May 17, 2004 Slide 1 Peter Loch University of Arizona.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – April 12, 2007 Outline: Reminder of plans Status of infrastructure.
Muon Shift Organization Outline Class 1 Atlas Control Room Shifts Booking Present Status + Experience+ Feedback Class 2 reminder A. Polini & Z. Yan May.
Part I – Shifter Duties Part II – ACR environment Part III – Run Control & DAQ Part IV – Beam Part V – DCS Part VI – Data Quality Monitoring Part VII.
Latest News & Other Issues Ricardo Goncalo (LIP), David Miller (Chicago) Jet Trigger Signature Group Meeting 9/2/2015.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Online Monitoring for the CDF Run II Experiment T.Arisawa, D.Hirschbuehl, K.Ikado, K.Maeshima, H.Stadie, G.Veramendi, W.Wagner, H.Wenzel, M.Worcester MAR.
Shelcat Scottish Health Libraries Catalogue Training guide, March 2009.
Online (GNAM) and offline (Express Stream and Tier0) monitoring produced results during cosmic/collision runs (Oct-Dec 2009) Shifter and expert level monitoring.
Prompt Calibration Loop 11 February Overview Prompt calibration loop in SCT –Provides ATLAS with conditions data used for the bulk reconstruction.
WP1 WP2 WP3 WP4 WP5 COORDINATOR WORK PACKAGE LDR RESEARCHER ACEOLE MID TERM REVIEW CERN 3 RD AUGUST 2010 Magnoni Luca Early Stage Researcher WP5 - ATLAS.
Trigger Offline Monitoring Report Experts: Jiri Masik, Ricardo Gonçalo Shifters: Iwona Grabowska-Bold, Holger von Radziewski, Gustavo Otero y Garzon, Michael.
Jet/MET Trigger On-Call Report Ricardo Gonçalo – LIP Jet Trigger Meeting – 31/3/2015.
Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.
ATLAS (Shift) Operations Documentation and Training 24 June 2013 S. Zimmermann, ATLAS Post-LS1 Operations Workshop 1 Stephanie Zimmermann.
ID Week 13 th of October 2014 Per Johansson Sheffield University.
A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool G. Anders (CERN), G. Avolio (CERN), A. Kazarov (PNPI),
Texas Assessment Management System STAAR Alternate Manage Teacher Assignments.
How to complete and submit a Final Report through Mobility Tool+ Technical guidelines Authentication, Completion and Submission 1 Antonia Gogaki IT Officer.
MET Slice Monitoring Xiaowen Lei, Venkat Kaushik Ken Johns.
Easy Chair Online Conference Submission, Tracking and Distribution Process: Getting Started AMS WMC and AMS Annual Conferences Click on play to begin show.
M4 Operations ● Operational model for M4 ● Shifts and Experts ● Documentation and Checklists ● Control Room(s) ● AOB Murrough Landon 24 July 2007.
Central DQM Shift Tutorial Online/Offline
F. Bellini for the DQM core DQM meeting, 04th October 2012
Central Online DQM Shift Tutorial March 2017, CMS DQM group
Shift instructions August 16, 2017 Antoni Aduszkiewicz
Offline shifter training tutorial
Remaining Online SW Tasks
last modified 3/1/12LL->printed November 2012
Experience between AMORE/Offline and sub-systems
Offline shifter training tutorial
Central DQM Shift Tutorial Online/Offline
TriggerDB copy in TriggerTool
Inviting Applicants to Interviews/EVENTs
Qualtrics Survey Kenyon
HLT Jet and MET DQA Summary
Presentation transcript:

OFFLINE TRIGGER MONITORING TDAQ Training 5 th November 2010 Ricardo Gonçalo On behalf of the Trigger Offline Monitoring Experts team

Introduction 2

Aims: – The offline trigger monitoring shifter has two main tasks: Monitor the DEBUG STREAM analysis and recovery Monitor the trigger DATA QUALITY Practicals: – The trigger shifter is in constant contact with a Trigger Offline Expert on call A small team of experts rotate to make sure there is always someone on call Will also be able to answer the shifter’s questions/doubts The expert will direct the shifter’s work – Especially in case non-standard operations are needed – One shift per day from 9am to 5pm CERN time Currently in the TDAQ SATELLITE CONTROL ROOM (SCR) Look for category “TRIGGER OFFLINE MONITORING SHIFTER” (task 46640) in OTP It will be possible to do this shift remotely once the all the tools are available and the LHC is running smoothly – starting in early 2011 Organization: – The activity is overseen by Alessandro Di Mattia and is an essential part of the TRIGGER OPERATIONS area It makes sure that the trigger is working without problems and that the data collected is good for analysis 3

Offline Monitoring and Reconstruction in Tier0 ATLAS Trigger/DAQ DEBUG Streams PHYSICS Streams Trigger Reprocessing in Tier0 CASTOR Pre-reprocessing Analysis Post-reprocessing Analysis Data Quality from Tier0 Histos Data Quality from Tier0 Histos DEBUG stream analysis Trigger DATA QUALITY 4

D EBUG S TREAM M ONITORING 5

ATLAS Trigger/DAQ DEBUG Streams Trigger Reprocessing in Tier0 CASTOR Pre-reprocessing Analysis Post-reprocessing Analysis Debug Stream analysis: Events generating failures either in the DAQ infrastructure or the HLT software, and for which the HLT can’t make a decision, are sent to debug streams:  Timeouts: debug_EFHltTimeout, debug_efdProcTimeout, debug_L2HltTimeout, etc  Crashes: debug_efdPTCrash,debug_L2ForcedAccept  Algorithm errors that abort processing: debug_EFHltError, debug_L2HltError They are reprocessed in the Tier0 A set of tables and analysis histograms are produced pre- and post-reprocessing to help diagnose the error and monitor the recovery. 6

Debug Stream Monitoring: Webpage dedicated to the use of the offline shifter and expert on call Automatically displays the recorded runs and provides a nice way to keep the information about past runs Provides access to the debug stream contents and to analysis histograms before and after reprocessing Validated runs, in html or in text, useful for e- log Centralized location for useful links and documentation 7

Debug Stream Monitoring: Guides the checks to be done by the shifter for each run. Summary of debug stream analysis Are there events in the debug stream? Which? Run details Links to pre/post analysis histograms Links to T0 DQ histograms ** Cost monitoring analysis Tick on the checks done, link savannah bugs, add comments (optional) 8 ** for DQ checks, in next slides

The HLT reprocessing is controlled by the TOM interface which is also used to do ad-hoc re- processings of old runs to test new software, debug errors, etc. At times do special checks on these reprocessings Running jobs can be monitored in the conTZole Task Lister: caf.cern.ch/taskLister.htmlhttps://atlas-tz-monitoring- caf.cern.ch/taskLister.html Shifter must check failing jobs in reprocessing 9

TRIGGER DATA QUALITY ASSESSMENT 10

Offline Monitoring and Reconstruction in Tier0 ATLAS Trigger/DAQ PHYSICS Streams Data Quality from Tier0 Histos Data Quality from Tier0 Histos Trigger DATA QUALITY The trigger software is monitored online – each trigger algorithm running on each working node publishes monitoring histograms …and offline – monitoring algorithms run in Tier0 during event reconstruction and produce histograms from online trigger data and comparisons from offline, etc Trigger Slice experts take care of checking the monitoring data from each run at the moment But this will be increasingly the task of the offline trigger shifter… i.e. YOU 11

Go to Click on the stream and run that you like, e.g /L1Calo Look under HLT: each link corresponds to a trigger domain: e.g. HLT->TRIDT->EFID 12

Once you determine if a run is good or bad, update the corresponding Data Quality (DQ) flags – only the “ShiftOFFLINE” flags are updated by the shifter To update DQ flags go to:

The flags are then combined with the DQ flags set online and automatically by DQMF and used to select data for analysis using the Good Run Lists The shifter can also choose different flags for different luminosity blocks according to stable beams/hlt active. 14

DOCUMENTATI ON 15

shadow shift Go through the instructions and arrage to do a shadow shift before you take your first shift, so you can get used to the tools. 16

SUMMARY 17

What do you need in order to do this shift? – Follow this training – Get a savannah account – Go over the instructions twiki – After the training you’ll be able to book your shift in OTP – Look for “Trigger Offline Monitoring Shifter” (task 46640) in your OTP page – Shadow someone before you do your first real shift What will you do during the shift? – Check reprocessing and analysis of DEBUG STREAM – Check TIER0 Trigger histograms for OFFLINE DQ – Check results of ad-hoc reprocessings if necessary – Always be in contact with the offline trigger expert – inform her/him of what you find 18

What will you do at the end of your shift? 1.Write an informative e-log summary – Remember to specify in the subject that this is trigger offline monitoring 2.Write anything new in the Offline monitoring Whiteboard for the next shifter 19

And remember, all ATLAS data is important! – Good Data Quality Monitoring is essential for good physics data – Data reprocessings are essential to maintain and improve the trigger – The debug stream analysis is essential to debug the trigger… and it may even show new physics! 20