1. PdmV Valdb and Refactoring of the CMS Database monitoring backend services
AlCaDB/PdmV meeting
Thursday, 26 April 2012
Student: Aidas Tilmantas
Supervisor: Andreas Pfeiffer

2. OUtline PdmV Valdb Nagios Easymon GetLumi PopCon Global Tag List
Payload Inspector

3. PDMV VALIDATIon db MOtivation
The CMS software releases need continuous and detailed validation of their Physics Performance
Up to now, the validation bookkeeping was done with twiki pages, on validation tables. This works fine, but the load for the maintenance of the pages is quite high and the synchronization between mails sent to official validation lists and the twiki itself is tedious to be kept
This is the reason why we developed the Val DB

4. PDMV VALIDATION DB Application developing
Task was divided in three parts
Web GUI (html, javascript) developed by Antanas Norkus
Database layer (Oracle, python, SqlAlchemy) developed by Martynas Mitrulevičius
Middle Layer which connects database with web gui (Python, cherrypy, javascript, ajax, REST, jinja2) developed by Aidas Tilmantas

5. PdmV VALIDATION DB Developing (middle layer)
Get and post data between database and web gui
Sending mails
Generating history page
Configure system
Security checks

6. PDMV VALIDATION DB result

7. PDMV VALIDATION DB result

8. PDMV VALIDATION DB result

9. Nagios Rewritten plugins, so they are in one place
Plugins can be executed as stand alone application through command line
Removed copy-paste code
Installation script
Configuration script

10. REFACTORING OF THE CMS DATABASE MONITORING BACKEND SERVICES
Motivation
Merge frontend/backend components
Faster working
Improve security
Redesigned services
EASYMON
GETLUMI
POPCON
GLOBAL TAG LIST
PAYLOAD INSPECTOR

11. EasyMon/GETLUMI Removed PHP code Merged backend and frontend layers
Improved security (data validation)
Same old interface
Installation script for the EASYMON

12. EASYMON

13. EASYMON

14. Popcon Merged backend and frontend layers
Improved security (data validation)
In PopCon Cron Job Tail Fetcher added errors and warnings coloring
Made PopCon Cron Job Tail Fetcher page loading faster
Removed PHP code
Cleared code

15. Popcon

16. Popcon

17. POPCON

18. Global Tag list Removed PHP code Improved security (data validation)
Cleared code
Merged backend and frontend layers
Added frontend features to backend
Much more complex

19. Global Tag LIST

20. Global tag list

21. Payload inspector Removed PHP code Merged backend and frontend layers
Cleared existing usable code
Improved security (data validation)
Fixed some old errors
Complexity as Global Tag List

22. Payload inspector

23. Payload inspector

24. summary PdmV Validation DB Nagios Easymon GetLumi PopCon
Global Tag List
Payload Inspector

25. Final word Special thanks to: Andreas Pfeiffer Salvatore Di Guida
Kostas Tamošiūnas