M. Caprini IFIN-HH Bucharest DAQ Control and Monitoring - A Software Component Model.

Slides:



Advertisements
Similar presentations
How We Manage SaaS Infrastructure Knowledge Track
Advertisements

The Control System for the ATLAS Pixel Detector
CWG10 Control, Configuration and Monitoring Status and plans for Control, Configuration and Monitoring 16 December 2014 ALICE O 2 Asian Workshop
GNAM and OHP: Monitoring Tools for the ATLAS Experiment at LHC GNAM and OHP: Monitoring Tools for the ATLAS Experiment at LHC M. Della Pietra, P. Adragna,
André Augustinus ALICE Detector Control System  ALICE DCS is responsible for safe, stable and efficient operation of the experiment  Central monitoring.
CHEP 2012 – New York City 1.  LHC Delivers bunch crossing at 40MHz  LHCb reduces the rate with a two level trigger system: ◦ First Level (L0) – Hardware.
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
DAQ WS03 Sept 2006Jean-Sébastien GraulichSlide 1 Interface between Control & Monitoring and DDAQ o Introduction o Some background on DATE o Control Interface.
VC Sept 2005Jean-Sébastien Graulich Report on DAQ Workshop Jean-Sebastien Graulich, Univ. Genève o Introduction o Monitoring and Control o Detector DAQ.
Clara Gaspar, May 2010 The LHCb Run Control System An Integrated and Homogeneous Control System.
March 2003 CHEP Online Monitoring Software Framework in the ATLAS Experiment Serguei Kolos CERN/PNPI On behalf of the ATLAS Trigger/DAQ Online Software.
L. Granado Cardoso, F. Varela, N. Neufeld, C. Gaspar, C. Haen, CERN, Geneva, Switzerland D. Galli, INFN, Bologna, Italy ICALEPCS, October 2011.
First year experience with the ATLAS online monitoring framework Alina Corso-Radu University of California Irvine on behalf of ATLAS TDAQ Collaboration.
Java Based Run Control for CMS Small DAQ Systems Michele Gulmini CHEP2000 February 2000 M. Bellato (INFN – Padova) L. Berti (INFN – Legnaro) D. Ceccato.
Large Scale and Performance Tests of the ATLAS Online Software CERN ATLAS TDAQ Online Software System D.Burckhart-Chromek, I.Alexandrov, A.Amorim, E.Badescu,
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
CERN - IT Department CH-1211 Genève 23 Switzerland t The High Performance Archiver for the LHC Experiments Manuel Gonzalez Berges CERN, Geneva.
Calo Piquet Training Session - Xvc1 ECS Overview Piquet Training Session Cuvée 2012 Xavier Vilasis.
Designing a HEP Experiment Control System, Lessons to be Learned From 10 Years Evolution and Operation of the DELPHI Experiment. André Augustinus 8 February.
DCS Overview MCS/DCS Technical Interchange Meeting August, 2000.
Summary DCS Workshop - L.Jirdén1 Summary of DCS Workshop 28/29 May 01 u Aim of workshop u Program u Summary of presentations u Conclusion.
Requirements Review – July 21, Requirements for CMS Patricia McBride July 21, 2005.
The Run Control and Monitoring System of the CMS Experiment Presented by Andrea Petrucci INFN, Laboratori Nazionali di Legnaro, Italy On behalf of the.
JCOP Workshop September 8th 1999 H.J.Burckhart 1 ATLAS DCS Organization of Detector and Controls Architecture Connection to DAQ Front-end System Practical.
Clara Gaspar, October 2011 The LHCb Experiment Control System: On the path to full automation.
1 Alice DAQ Configuration DB
Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.
XXVI Workshop on Recent Developments in High Energy Physics and Cosmology Theodoros Argyropoulos NTUA DCS group Ancient Olympia 2008 ATLAS Cathode Strip.
An Approach To Automate a Process of Detecting Unauthorised Accesses M. Chmielewski, A. Gowdiak, N. Meyer, T. Ostwald, M. Stroiński
DCS Workshop - L.Jirdén1 ALICE DCS PROJECT ORGANIZATION - a proposal - u Project Goals u Organizational Layout u Technical Layout u Deliverables.
The Joint COntrols Project Framework Manuel Gonzalez Berges on behalf of the JCOP FW Team.
André Augustinus 10 September 2001 DCS Architecture Issues Food for thoughts and discussion.
André Augustinus 10 October 2005 ALICE Detector Control Status Report A. Augustinus, P. Chochula, G. De Cataldo, L. Jirdén, S. Popescu the DCS team, ALICE.
Control in ATLAS TDAQ Dietrich Liko on behalf of the ATLAS TDAQ Group.
4/5/2007Data handling and transfer in the LHCb experiment1 Data handling and transfer in the LHCb experiment RT NPSS Real Time 2007 FNAL - 4 th May 2007.
ALICE, ATLAS, CMS & LHCb joint workshop on
7. CBM collaboration meetingXDAQ evaluation - J.Adamczewski1.
Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
1 Makes Mobile WiMAX Simple Netspan Overview Andy Hobbs Director, Product Management 5 th October 2007.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
Online Software 8-July-98 Commissioning Working Group DØ Workshop S. Fuess Objective: Define for you, the customers of the Online system, the products.
Overview of DAQ at CERN experiments E.Radicioni, INFN MICE Daq and Controls Workshop.
Peter Chochula ALICE Offline Week, October 04,2005 External access to the ALICE DCS archives.
The DIAMON Project Monitoring and Diagnostics for the CERN Controls Infrastructure Pierre Charrue, Mark Buttner, Joel Lauener, Katarina Sigerud, Maciej.
CMS Luigi Zangrando, Cern, 16/4/ Run Control Prototype Status M. Gulmini, M. Gaetano, N. Toniolo, S. Ventura, L. Zangrando INFN – Laboratori Nazionali.
Peter Chochula.  DCS architecture in ALICE  Databases in ALICE DCS  Layout  Interface to external systems  Current status and experience  Future.
Management of the LHCb Online Network Based on SCADA System Guoming Liu * †, Niko Neufeld † * University of Ferrara, Italy † CERN, Geneva, Switzerland.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Configuration database status report Eric van Herwijnen September 29 th 2004 work done by: Lana Abadie Felix Schmidt-Eisenlohr.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
TM & DVS status 29/10/2004. TM requirements (June 98) UR TMGR-1: TM shall have the ability to execute individual tests. UR TMGR-2: TM shall run on all.
The DCS Databases Peter Chochula. 31/05/2005Peter Chochula 2 Outline PVSS basics (boring topic but useful if one wants to understand the DCS data flow)
CMS Luigi Zangrando, Cern, 16/4/ Run Control Prototype Status M. Gulmini, M. Gaetano, N. Toniolo, S. Ventura, L. Zangrando INFN – Laboratori Nazionali.
A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool G. Anders (CERN), G. Avolio (CERN), A. Kazarov (PNPI),
André Augustinus 18 March 2002 ALICE Detector Controls Requirements.
Maria del Carmen Barandela Pazos CERN CHEP 2-7 Sep 2007 Victoria LHCb Online Interface to the Conditions Database.
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: Implementation Plan.
Online Software November 10, 2009 Infrastructure Overview Luciano Orsini, Roland Moser Invited Talk at SuperB ETD-Online Status Review.
Clara Gaspar, February 2010 DIM A Portable, Light Weight Package for Information Publishing, Data Transfer and Inter-process Communication.
20OCT2009Calo Piquet Training Session - Xvc1 ECS Overview Piquet Training Session Cuvée 2009 Xavier Vilasis.
The Control and Hardware Monitoring System of the CMS Level-1 Trigger Ildefons Magrans, Computing and Software for Experiments I IEEE Nuclear Science Symposium,
Scalable Readout System Data Acquisition using LabVIEW Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
Controlling a large CPU farm using industrial tools
The LHCb Run Control System
Software models - Software Architecture Design Patterns
The Performance and Scalability of the back-end DAQ sub-system
Tools for the Automation of large distributed control systems
Presentation transcript:

M. Caprini IFIN-HH Bucharest DAQ Control and Monitoring - A Software Component Model

DAQ system PANDA DAQT/FEE Workshop, April Main tasks of the DAQ sysytem Data flow (moving data from detector to storage) Selection (discard non-interesting events) Control, configuration and monitoring Control, configuration, monitoring DAQ needs a large number of parameters to describe its system topology, hardware and software components and running modes. A configuration databases could help to describe the DAQ and detector facilities. An important control task is to marshal the DAQ through its start-up and shutdown procedures so that they are performed in an orderly manner (these procedures should take the minimum amount of time to execute) During data taking, it is important to access and analyze the monitoring information (statistics data, sampled data fragments, histograms) and the errors and diagnostic messages sent by different applications User interfaces shall be provided to give a view of the status and performance of the DAQ system and allow the user to configure and control its operation

Experiment Control System LHC experiments control system experience DAQ DCS interaction PANDA DAQT/FEE Workshop, April ALICE ATLAS CMSLHCb

A software component model User requirements divided into groups related to activities providing similar functionality Groups further developed into components with well defined purposes and boundaries The components have interfaces with other components and external systems, specific functionality and their own architecture. Several domains recur across all the components (data storage, inter-process communication, graphical user interfaces,...) The component list should result after requirements gathering What follows is just a possible example, based mainly on ATLAS Online Software experience. ALICE DATE, a similar component set PANDA DAQT/FEE Workshop, April

Control & monitoring components Core components Essential functionality Priority in terms of time-scale for development in order to have a baseline sub-system that can be used for integration with the data-flow / selection Run Control Configuration Database Information sharing Message reporting Process management Graphical user interface DAQ/detector integration components Integration with other online sub-systems and sub-detectors (test beams, commissioning,...) Event monitoring Resource management (partitioning) DAQ – DCS interface Online bookkeeping Test manager PANDA DAQT/FEE Workshop, April

Run Control Functionality The Run Control component controls the data taking activities by coordinating the operations of the other components, DAQ sub-systems, external systems (FSM, hierarchical control,...) Software interfaces with the DAQ sub-systems and other software components (to exchange commands, status and information) Advanced capabilities - partitioning, error recovery (expert system),... Implementation ATLAS – CORBA communication CMS – Java, Web technologies (Web Services, SOAP,...) Web browser as user interface LHCb – based on JCOP Framework (SCADA System PVSSII & SMI++) ALICE – DATE Run Control Auxiliary tools Expert system ATLAS – Shifter Assistant LHCb - BigBrother PANDA DAQT/FEE Workshop, April

Configuration Database Functionality Used to describe a large number of parameters of the DAQ system architecture, hardware and software components, running modes and status One of the major design issues is to be as flexible as possible, parameterized by the contents of the configuration databases Implementation CMS – Oracle ATLAS – OKS (Object Kernel support – in-house developed database) ALICE – MySQL Auxiliary tools Configuration database editor PANDA DAQT/FEE Workshop, April

Information Sharing Functionality Provides an information exchange facility for software components Information from many sources can be categorized and made available to requesting applications asynchronously or on demand. Implementation LHCb, ALICE – DIM (Distributed Information Management) First version developed for Delphi Used also by JCOP Framework ATLAS – IS (Information Service) Tens of servers, thousands of information objects (including histograms) Based on CORBA Auxiliary tools Web interfaces ATLAS – WebIS, NetIS, PANDA DAQT/FEE Workshop, April

Message Reporting Functionality Provides a facility which allows all software components to report messages to other components in the distributed environment Performs transport, filtering and routing of messages. Implementation CMS – log4cplus (modeled after the Java log4j API) Loggers, appenders, layouts ATLAS – MRS (Messsage Reporting System) Message stream, CORBA Used with ERS (Error Reporting System) API Message queuing systems (ActiveMQ, AMPQ – Qpid,...) Auxiliary tools Message database ATLAS – Oracle ALICE - MySQL Message monitors ATLAS – MRSMonitor, Log Manager PANDA DAQT/FEE Workshop, April

Process management Functionality Performs basic job control of software components Capable of starting, stopping and monitoring the status (e.g. running, exited) of components independent of the underlying operating system Implemenation ATLAS – PMG (Process Manager) A PMG agent on each machine Uses a role based access management policy PANDA DAQT/FEE Workshop, April

User interfaces Functionality Allows the operator to control and monitor the status of the current data taking run in terms of it’s main parameters, detector configuration, trigger rate and state of the sub-systems Implementation PANDA DAQT/FEE Workshop, April ATLAS

Integration components Event monitoring Samples events from the data-flow to present them to the user or monitoring applications in order to verify event integrity and structure Resource management (partitioning) Allocates resources (hardware and software resources which can’t be freely shared) and allows several groups (partitions) to work in parallel without interference. DAQ – DCS interface Allows exchange of commands, information and messages between DAQ and DCS Online bookkeeping Archives information about the data recorded to permanent storage by the DAQ system Records information on a per-run basis and provides a number of interfaces for retrieving and updating the information Test manager (verification, diagnostics) Organizes individual tests for hardware and software components PANDA DAQT/FEE Workshop, April

Next steps User requirements Tehnology evaluation Databases, inter-process communication,... Architectural design Implementation, testing Platforms, languages Scalability issues IFIN-HH experience Message reporting Information sharing Graphical user interface PANDA DAQT/FEE Workshop, April