1. Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database

2. Collision data workflow Raw data (Event data) Condition data (Non event data) CMSSW 1/10/2016 Data taken from the detectors can be divided in event data (RAW data) collecting the physical responses of the detector devices to collisions, and non event data, such as the conditions of the detector (magnetic field value, status of the electronic devices, currents….) and calibration of the various subdetector components (alignment, drift time values of the drift tube, pedestals mean and error, noise, Lorentz angle of the strip). Both event data and non event data are needed to properly reconstruct all physical quantities

3. Conditions/calibrations workflow Conditions data are saved in Oracle database and transferred from online network (physically at CERN P5) to offline network (CERN network and so to the all communities and institutes) ONLINEOFFLINE Relational Databases (OMDS, Online Master Data Storage) POPCON Automatic streaming Pool-ORA db (ORCON, Offline Reconstraction Condition DB ONline Set Pool-ORA db (ORCOFF, Offline Reconstraction Condition DB OFFline Set 1/10/2016

4. Why databases for conditions?  Condition/calibration data are very important to validate and correctly analyze collision data, and a correct understating of condition quantities, and the possibility to update, recalculate and retrieve them is very critical during the overall life and activity of the experiment.  Condition/Calibration data event are almost.5 TB per year  Many efforts has been devoted to develop and testing a robust storing/transferring/retrieving system using Oracle-Database and Pool-Ora technology. Calibration/Condition data coming form online network (i.e. in the detector computers and devices’ network), from different sources (databases, txt files, root file, etc.) are packed as C++ object and moved in the Online condition database (ORCON) via a dedicated package called PopCon (Populator of Condition Objects) fully integrated in the overall CMSSW. The data are then automatically streamed to the offline database (ORCOFF) and so accessible in the offline network as C++ object. This mechanism has been intensively and succesfully used during 2008 tests with cosmic rays. 1/10/2016

5. PopCon feautures (1)  PopCon (Populator of Condition) has been ideated by V. Innocente…… The application is currently under mine responsibility and has been improved this year, deployed and applied to all subsystems  PopCon encapsulate data coming from different sources (txt, xml file as typical from calibration output of offline C++/CMSSW jobs, and relational table in OMDS, as typical for condition data) in Pool-ORA object, i.e. in C++ classes in a proper format to be stored in Oracle database, and retrievable as pool-object (i.e. compatible with ROOT framework, as the Event data themselves).  PopCon assign to every condition/calibration object an IOV (Interval of validity) as run number or timestamp (microseconds from 1/1/1970 in UTC)  PopCon assign a tag to the data. A new tag correspond to a new recalculated calibrations  All coherent tags are grouped in a global tag, and retrieved OFFLINE with Frontier technology  PopCon provide also a log every transaction. Thanks to that a complete transaction history monitor has been be set up. 1/10/2016

6. IOV Ecal Pedestals # mean rms ……………….......... ……………………... 245 10 1 246 11 2 ……………………... …………………...... calibrations 1/10/2016 Ecal Pedestals # mean rms ……………….......... ……………………... 245 13 2 246 9 3 ……………………... …………………...... 55000 56000 TAG CRAFT_EcalPed

7. IOV RPC roll currents # value …………………….. ……………………... 23 10 24 15 ……………………... …………………...... conditions 1/10/2016 RPC roll currents # value …………………….. ……………………... 23 11 24 13 ……………………... …………………...... 121134567890 123456543890 TAG CRAFT_RPCHV

8. DB activity monitoting  PopCon provide also logging information for any transaction. Thanks to that a monitor tool has been set up 1/10/2016 POPCON daily applications run during CRAFT (13/10  14/11)

9. Conclusions  Work done for detector condition/calibration data validation.  PopCon deployed successfully during data taking with cosmics data  the tool has been applied to all subdetectors during CRAFT  I’m now the official translator between Vincenzo and the CMS community ;-) 1/10/2016