Online Data Monitoring Framework Based on Histogram Packaging in Network Distributed Data Acquisition Systems Tomoyuki Konno 1, Anatael Cabrera 2, Masaki Ishitsuka 1, Masahiro Kuze 1, Yasunobu Sakamoto 3 1. Tokyo Institute of Technology, 2. CNRS/IN2P3-APC Laboratory (Paris), 3. Tohoku Gakuin University Taipei, 10/20/2010

Introduction: Network-distributed data acquisition system In HEP experiments, DAQ subsystems and monitoring information are distributed in local area network Requirements for online monitoring 1.A lot of connections to DAQ sub-systems must be handled 2.Monitoring information must be available from outside of firewall 2010/10/202 DAQ sub-systems Local area network off site experts firewall on site shifter

Online monitor framework General software framework for online data monitoring – Collects information from network distributed systems – All information are handled as collections of histograms ”HistogramPackage” : Common interface via network – Displays to off-site experts via internet DAQ sub-systems – Create and update HistogramPackages Monitor Server – Collects HistogramPackages from DAQ sub-systems Monitor Viewer – Connects to Monitor Server and creates graphical plots – Two types with different technologies: Java, web browser 2010/10/203

HistogramPackage Common interface via network – DAQ sub-systems to Monitor Server – Monitor Server to Monitor Viewers Structure of HistogramPackage – Package name (String) : used for identification – Update serial ID (Integer) : used for checking updates – Array of Monitored Objects Histograms (1-D and 2-D) Graphs (scatter plots and time variation) All histograms are collected and sent as single package 2010/10/204

Overview of Online Monitor framework web server DAQ sub-systems Java version of Monitor Viewer TCP Local area network www HTTP XMLXML Monitor Server 5 Available from everywhere via Internet web version of Monitor Viewer

Mechanism of Monitor Server Several Monitor Skeleton threads work in parallel Each Monitor Skeleton is connected to different DAQ sub-system Monitor Provider sends all HistogramPackages to each Monitor Viewer 2010/10/206 Monitor Skelton Monitor Provider Monitor Server shared memory Monitor Viewers DAQ sub-systems thread process

Data stream to Viewer 2010/10/207 XML XML XMLXML Monitor Server Java Viewer TCP Web browser Viewer XML XML XMLXML web Server XML XML XMLXML HTTP / Ajax Monitor Server Proxy High performance Easy to access data layout

Details of Monitor Viewer Technologies – Java : Swing and Java web start – web : Google web toolkit, Ajax, Canvas (HTML5) Platform independent – Runs on Windows, Mac OS, Linux – Free from additional plug-ins or libraries (e.g. ROOT) Graphical plots are created on viewer sides – Dynamic control of plots (zooming, changing colors, …) GUI layouts are automatically generated by XML files – Panels, tables,tabs, scroll bars etc.. – Specifics of graphical objects (colors, width, font, …) – Additional objects (legend, axis, text, …) 2010/10/20

Screen shots of Monitor Viewer 2010/10/20 dummy data Java version Web browser version on Google Chrome

GUI generation (Tabbed panels) 2010/10/2010 … … … … Creates nested structures of GUI components

GUI generation (Tables) 2010/10/2011 … first table second table Creates nested structures of GUI components

Control of graphical objects (Histogram) 2010/10/2012 … Histogram Defines which histograms are drawn on the canvas

2010/10/2013 dummy data A line for reference extra y-axis Legend of objects Draw Option : AL Control of graphical objects Extra objects can be added

2010/10/20 dummy data <histo name="histo_2d" draw-option="AL" maximum="4" minimum="0" line-color="white" line-width=“4”/> <color-axis color-pattern="blue,green,yellow,red" label="OFF,STABLE,WARNING,ERROR;0.5,1.5,2.5,3.5” label-font-size="0.9" line-color="none" /> Control of graphical objects Color axis 2-D histogram Labels and color patterns of axis are controlled

Summary We developed general software framework for online data monitoring – Network-distributed systems create “HistogramPackage”s – Monitor Server collects the packages – Monitor Viewer makes graphical plots from the packages Two types of Monitor Viewer were developed – Platform independent – Available from everywhere via Internet – GUI layouts can be controlled by XML files Developed for the Double Chooz experiment – Already being used on-site for the detector commissioning 2010/10/2015

Data transition to Viewers DAQ sub-systems have triggers to start updating data 2010/10/2016 Monitor Skelton Monitor Provider Monitor Server shared memory Monitor Viewer DAQ sub-systems notify updates via condition variables notify updates via condition variables wait for updates of the packages always wait for updates of the packages always wait for updates of the package

Technologies for Monitor Viewer Java version – Swing – Java web start web browser version – HTML technologies (Ajax + Canvas) Google Web Toolkit – compiler from Java to HTML + java script – GUI components – GUI event handlers Ajax : Unsynchronized communication to web servers Canvas : Vector graphics on web pages 2010/10/2017