1. Online Software November 10, 2009 Infrastructure Overview Luciano Orsini, Roland Moser Invited Talk at SuperB ETD-Online Status Review

2. CMS DAQ Review ‘062 Topics Scope Motivation and Requirements Architecture Software Product Line Outlook –Integrated web technologies –Monitoring –Errors and Alarms –Generic Event Builder Configuration Management Conclusion

3. CMS DAQ System CMS DAQ Review ‘063 40 MHz Collision rate 100 kHz output from trigger 500+500 ports switching fabric 10 TeraOps processing cluster 1 Terabit/sec 50000 channels ~800 Gb/sec full connectivity 100 Mbytes/sec output to Petabyte archive Detectors

4. Context Diagram CMS DAQ Review ‘064 Online software Online software Detector Control System software Detector Control System software Run control software Run control software High-level trigger software High-level trigger software

5. Motivation CMS consists of a set of sub-projects –Similar to a coordinated set of small experiments –Many scenarios: central DAQ, subdetector DAQ, testbeams, Geographically dispersed participants Autonomous developments High personnel turnover High performance requirements Long lifetime and need to survive technology generations Similar tasks to be performed in each sub-detector CMS DAQ Review ‘065

6. Functional Requirements (TDR) Communication and Interoperability –Transparent use of communication protocols –Possibility to add new protocols –Concurrent use of multiple protocols Device Access –Access to custom devices –Hardware abstraction layer Configuration, control and monitoring of applications –Inspect and modify simple/complex parameters –Allow coordination of application components –Record structured information Uniform logging, error reporting, monitoring Interface to persistent data stores CMS DAQ Review ‘066

7. Non-Functional Requirements (TDR) Maintainability and Portability –Portability across operating system and hardware platforms –Add new electronics without functional changes in user software –Application code shall be invariant with respect to the physical location and the network –Encourage working with re-usable building blocks CMS DAQ Review ‘067

8. Scalability 8 Scalability –Operate within requirements if size or volumes change –Take advantage of additional resource availability –Overhead introduced by the software environment must be constant for each transmission operation and small with respect to the underlying communication hardware in order not to introduce unpredictable behaviour bad good within requirements linear Performance System size

9. Architecture Foundation CMS DAQ Review ‘069 Uniform building block One or more executives per computer contain application and service components Executive Configuration XML HTTP SOAP HTTP SOAP Control and GUI I2O/ B2IN I2O/ B2IN Fast control and data Application Components Application Components Service Plug-ins Service Plug-ins Device s Custom device access

10. Architecture Foundation (II) CMS DAQ Review ‘0610 Executive Replicated building blocks Scalable cluster system architecture

11. Software Distribution Core framework CMS DAQ Review ‘0611 Reusable applicationsCMS specific applications coretools powerpackworksuite

12. Online Software Coretools Powerpack Layered View CMS DAQ Review ‘0612 Worksuite Platforms Event Builders Event Builders Front-end Controllers Front-end Controllers Data Monitoring Data Monitoring Error and Alarming Job Control External System Interfaces Hardware Access Hardware Access OS Abstraction Communication Subsystems Communication Subsystems Executive Framework Executive Framework Operating Systems Operating Systems Networking Infrastructures Networking Infrastructures Hardware Device Interfaces Hardware Device Interfaces Configuration Management Support User Interfaces User Interfaces Detector Specific Applications Detector Specific Applications

13. Timeline CMS DAQ Review ‘0613 2008 2006 2004 2002 2000 Need for common platform arises (3 operating systems, many different develoments) First version of XDAQ - I 2 O communication kernel XDAQ 2 – Web enters DAQ (SOAP) XDAQ 3 – experiment wide adoption XMAS – monitoring, orthogonal to applications Commissioning and first beam event successfully achieved Well consolidated after eight years of development and use

14. Outlook Integrated web technologies Monitoring Errors and Alarms Generic Event Builder CMS DAQ Review ‘0614

15. HyperDAQ CMS DAQ Review ‘0615 Access through embedded HTTP Navigate and inspect the whole cluster

16. HyperDAQ (II) CMS DAQ Review ‘0616

17. HyperDAQ (III) CMS DAQ Review ‘0617

18. Data Monitoring Concept CMS DAQ Review ‘0618

19. Scalable Architecture CMS DAQ Review ‘0619

20. Flashlist Viewer CMS DAQ Review ‘0620

21. Errors and Alarms CMS DAQ Review ‘0621 Alarms/acknowledged Acknwoledge errors and alarms In selected subtree of model Coloured if subtree has errors

22. Errors and Alarms (II) CMS DAQ Review ‘0622

23. Generic Event Builder CMS DAQ Review ‘0623 Configurable in size and network technology Customization at boundaries through pluggable components High-Level Trigger/Event filter services Readout unit components Event Manager Builder Networks Trigger Run Control Readout specific software component Builder unit components

24. Configuration Management Identification –definition of packages –versioning Traceability –Status accounting –Documented change history –Tickets Planning –Milestones –Priorities, People Release –Source and binary releases –Parallel releases –Upgrades CMS DAQ Review ‘0624

25. Configuration Management Tools CMS DAQ Review ‘0625 WEB Services E-Groups

26. Parallel Releases CMS DAQ Review ‘0626

27. Change Process Workflow CMS DAQ Review ‘0627

28. Roadmap CMS DAQ Review ‘0628

29. Conclusion CMS DAQ Review ‘0629