1. 7/8/2016 OAF Jean-Jacques Gras Stephen Jackson Blazej Kolad 1

2. 7/8/2016 OAF Problem: To identify (and report) problems and anomalies of BI instruments. Challenges: - We need to analyze thousands of variables for hundreds of devices. - Computations are demanding in terms of database access and processing power, can take several days. 2

3. 7/8/2016 OAF Solutions: 1) A lot of ad-hoc scripts hacked by different people (often short-term at CERN). 2) Unified approach - Extract common functionality - Automatize as much as possible 3

4. 7/8/2016 Timber-Snapshots “The Logging Service persists data coming from pre-defined signals into Oracle databases, and provides an API and a generic GUI (TIMBER)” OAF 4

5. ARCHITECTURE 7/8/2016 User Interface sDaily Execution Excel configuration files Logging DB Report pdf Summary EMAIL Optional Expert Code triggers Supplies produce 5

6. FRAMEWORK SEQUENCE 7/8/2016 1)Extract Data 2)Compute extra data 3)Make summary page 4)Analyze alarms 5)Make default plots 6)Make extra plots 7)Run expert code 8)Inform Basic analysis (default plots of variables) can be made just by creating timber snapshot. 6

7. 7/8/2016 The OAF Program One single program will for any type of our instruments and solely based on the data published in the logging DB and a simple configuration excel file: Compute new data sets from the one recorded (relative values, grouping per CYCLE or BMODE, statistics, FFTs…) Detect (and alert you) warning signs encountered in your logging (missing data, wrong status, wrong settings…) Plot this data the way you want it 7

8. Compute new data sets from the one recorded (relative values, grouping per CYCLE or BMODE, statistics, FFTs…) 7/8/20168 Configuration Tab

9. Compute new data sets from the one recorded (relative values, grouping per CYCLE or BMODE, statistics, FFTs…) 7/8/2016 BSRA data limited to stable beam. 9

10. Compute new data sets from the one recorded (relative values, grouping per CYCLE or BMODE, statistics, FFTs…) 7/8/2016 BLM DAB’s temperature statistics 10

11. Detect (and alert you) warning signs encountered in your logging (missing data, wrong status, wrong settings…) 7/8/201611

12. Plot this data the way you want it 7/8/201612

13. Plot data the way you want it 7/8/201613

14. Plot data the way you want it 7/8/201614

15. Plot data the way you want it 7/8/2016 PS BWS Profile and fitting survey 15

16. Summary email 7/8/2016 Report 16

17. 7/8/201617 Error on measurement

18. Report repository 7/8/201618

19. Report Generic part – first page 7/8/201619

20. 7/8/201620 Report Generic part

21. 7/8/2016 Red – Alarm was raised Yellow – Data not consistent Brown – No alarms set 21

22. Potential Extra Usage We could try also to use this tool ‘ONLINE’ We could define a short time (ie 15 mn) dynamic DB snapshot to look at the last 15 mn DB recording to check if things are going well 7/8/201622

23. Main and Common Framework: The GUI 1.extract_data()# Get the snapshot from DB 2.compute_extra_data()# Compute extra data if any as conf. 3.analyse_alarms()# Analyse alarms as config. 4.make_plots()# makes extra plots if any as conf. 5.close_report()# close and save the report file 6.inform()# send info mail to client as conf. Green: Based on config file _ Orange: Based on DB Public snapshot 7/8/201623

24. 7/8/2016 Technical Solutions 125+ of the most popular Python packages for science, math, engineering, data analysis ( NumPy, SciPy, Pandas, IPython, Matplotlib, Numba, Blaze, Bokeh..) Completely free - including for commercial use Cross platform on Linux, Windows, Mac Installs into a single directory and doesn't affect other Python installations on your system. Doesn't require root or local administrator privileges Spyder, Ipython We use Jpypy for java – python integration Installed on bdidev2 24

25. 7/8/2016 Technical Solutions 25

26. Conclusions 7/8/201626 OAF is now ready and operational Reports will be produced for several instruments Highlights and observations regularly presented and discussed as recurrent topics of our technical boards. We are also currently developing with Ana’s collaboration dedicated reports to help our machine coordinators in their activity

27. Thank you 7/8/201627

28. 7/8/201628