1. Online Data Monitoring Framework Based on Histogram Packaging in Network Distributed Data Acquisition Systems Tomoyuki Konno 1, Anatael Cabrera 2, Masaki Ishitsuka 1, Masahiro Kuze 1, Yasunobu Sakamoto 3 1. Tokyo Institute of Technology, 2. CNRS/IN2P3-APC Laboratory (Paris), 3. Tohoku Gakuin University CHEP2010@ Taipei, 10/20/2010

2. Introduction: Network-distributed data acquisition system In HEP experiments, DAQ subsystems and monitoring information are distributed in local area network Requirements for online monitoring 1.A lot of connections to DAQ sub-systems must be handled 2.Monitoring information must be available from outside of firewall CHEP@Taipei, 2010/10/202 DAQ sub-systems Local area network off site experts firewall on site shifter

3. Online monitor framework General software framework for online data monitoring – Collects information from network distributed systems – All information are handled as collections of histograms ”HistogramPackage” : Common interface via network – Displays to off-site experts via internet DAQ sub-systems – Create and update HistogramPackages Monitor Server – Collects HistogramPackages from DAQ sub-systems Monitor Viewer – Connects to Monitor Server and creates graphical plots – Two types with different technologies: Java, web browser CHEP@Taipei, 2010/10/203

4. HistogramPackage Common interface via network – DAQ sub-systems to Monitor Server – Monitor Server to Monitor Viewers Structure of HistogramPackage – Package name (String) : used for identification – Update serial ID (Integer) : used for checking updates – Array of Monitored Objects Histograms (1-D and 2-D) Graphs (scatter plots and time variation) All histograms are collected and sent as single package CHEP@Taipei, 2010/10/204

5. Overview of Online Monitor framework web server DAQ sub-systems Java version of Monitor Viewer TCP Local area network www HTTP XMLXML Monitor Server 5 Available from everywhere via Internet web version of Monitor Viewer

6. Mechanism of Monitor Server Several Monitor Skeleton threads work in parallel Each Monitor Skeleton is connected to different DAQ sub-system Monitor Provider sends all HistogramPackages to each Monitor Viewer CHEP@Taipei, 2010/10/206 Monitor Skelton Monitor Provider Monitor Server shared memory Monitor Viewers DAQ sub-systems thread process

7. Data stream to Viewer CHEP@Taipei, 2010/10/207 XML XML XMLXML Monitor Server Java Viewer TCP Web browser Viewer XML XML XMLXML web Server XML XML XMLXML HTTP / Ajax Monitor Server Proxy High performance Easy to access data layout

8. Details of Monitor Viewer Technologies – Java : Swing and Java web start – web : Google web toolkit, Ajax, Canvas (HTML5) Platform independent – Runs on Windows, Mac OS, Linux – Free from additional plug-ins or libraries (e.g. ROOT) Graphical plots are created on viewer sides – Dynamic control of plots (zooming, changing colors, …) GUI layouts are automatically generated by XML files – Panels, tables,tabs, scroll bars etc.. – Specifics of graphical objects (colors, width, font, …) – Additional objects (legend, axis, text, …) 8CHEP@Taipei, 2010/10/20

9. Screen shots of Monitor Viewer 9CHEP@Taipei, 2010/10/20 dummy data Java version Web browser version on Google Chrome

10. GUI generation (Tabbed panels) CHEP@Taipei, 2010/10/2010 … … … … Creates nested structures of GUI components

11. GUI generation (Tables) CHEP@Taipei, 2010/10/2011 … first table second table Creates nested structures of GUI components

12. Control of graphical objects (Histogram) CHEP@Taipei, 2010/10/2012 … Histogram Defines which histograms are drawn on the canvas

13. CHEP@Taipei, 2010/10/2013 dummy data A line for reference extra y-axis Legend of objects Draw Option : AL Control of graphical objects Extra objects can be added

14. 14CHEP@Taipei, 2010/10/20 dummy data <histo name="histo_2d" draw-option="AL" maximum="4" minimum="0" line-color="white" line-width=“4”/> <color-axis color-pattern="blue,green,yellow,red" label="OFF,STABLE,WARNING,ERROR;0.5,1.5,2.5,3.5” label-font-size="0.9" line-color="none" /> Control of graphical objects Color axis 2-D histogram Labels and color patterns of axis are controlled

15. Summary We developed general software framework for online data monitoring – Network-distributed systems create “HistogramPackage”s – Monitor Server collects the packages – Monitor Viewer makes graphical plots from the packages Two types of Monitor Viewer were developed – Platform independent – Available from everywhere via Internet – GUI layouts can be controlled by XML files Developed for the Double Chooz experiment – Already being used on-site for the detector commissioning CHEP@Taipei, 2010/10/2015

16. Data transition to Viewers DAQ sub-systems have triggers to start updating data CHEP@Taipei, 2010/10/2016 Monitor Skelton Monitor Provider Monitor Server shared memory Monitor Viewer DAQ sub-systems notify updates via condition variables notify updates via condition variables wait for updates of the packages always wait for updates of the packages always wait for updates of the package

17. Technologies for Monitor Viewer Java version – Swing – Java web start web browser version – HTML technologies (Ajax + Canvas) Google Web Toolkit – compiler from Java to HTML + java script – GUI components – GUI event handlers Ajax : Unsynchronized communication to web servers Canvas : Vector graphics on web pages CHEP@Taipei, 2010/10/2017