1. LIGO-G040245-00-E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004

2. LIGO-G040245-00-E DMT Overview DMT – Detector characterization platform in C++ »Designed to monitor IFO performance: state, sensitivity, noise, etc. »Multiple channel streaming input. »Signal processing, detector characterization class libraries. »Monitor programs written by Detector Characterization group »Interactive development, analysis and graphics using ROOT Online use (in LIGO control room) »Run continuously on ~10 Solaris SMP nodes (reference platform) »Stream of current IFO data received directly from DAQ. »Real-time, low latency response »Operator feedback: alarms, IFO state, sensitivity, noise summaries »Output: real-time triggers (transient descriptors), statistics trends »Near real-time calibration

3. LIGO-G040245-00-E Online DMT Data Flow

4. LIGO-G040245-00-E Example: Online Figures of Merit

5. LIGO-G040245-00-E Growing Use – Offline Analysis Offline analysis uses »Run “monitors” with different configurations on entire raw data samples. –Data quality investigations –Transient detection »Use detector specific codes in offline GW search pipelines. Impediments to offline use »Linux installation difficult (no binary distribution, no reference platform). –Impacts development as well as universal use »No standard offline environment defined »Unable to use LSC computational clusters »Global data access and publication not provided »Sensitive data – administrative nightmare »Local job submission only »Single data stream input (multiple inputs useful for IFO correlations). ITR2003 DMT sub-project will enable this use

6. LIGO-G040245-00-E Offline DMT Data Flow

7. LIGO-G040245-00-E ITR2003 Mission Grid enable DMT »Improve portability »Interface to Globus tools and LDR »Condor enable »Develop remote submission capabilities »Install on LSC clusters Without adversely affecting the primary DMT mission »Maintain Solaris compatibility »Transparent access to DAQ broadcast stream »Interface to ROOT Graphics »Operator feedback, Database Interfaces

8. LIGO-G040245-00-E Participants Erik Katsavounidis (MIT PI) Lee Samuel Finn (PSU PI) John G. Zweizig (Caltech) Junwei Cao (MIT, ITR2003) Anonymous Hire (PSU) Part time hire (UWM) »25% for deployment, other time as available

9. LIGO-G040245-00-E Technical Linux portability »Manage configuration issues with autoconfigure and automake »Generate package binary distributions (e.g. rpms) »Periodic build »Standardize offline runtime environment. »Decouple from ROOT and operator feedback packages Data access transparency »Interface to directory / LDR Running on the grid »Use Condor features (checkpointing, etc) »Process management »Remote submission

10. LIGO-G040245-00-E Technical 2 Related cluster administration functions »Package installation / maintenance »Usage prioritization. »Clusters at observatories & tier 2 centers. Validation »Component tests for nightly build Nuts ‘n Bolts »Multiple data streams »Rationalize dependencies (fftw-3, …) »Etc?

11. LIGO-G040245-00-E Stakeholders LSC »Extend DMT availability to LSC offline analysis. –Improve portability. –Formalize use of DMT on LSC Linux clusters –Enable remote submission / data access. »Certificate based authorization –Protect data access. –Eliminate case by case (users x nodes) administration Grid community »Demonstrate gridification of an existing Scientific software package »Grid middleware use in real scientific applications allows feedback to grid community e.g. which tools/features are useful/needed »Productive readjustment of priorities, more useful middleware

12. LIGO-G040245-00-E Plans (2004) Improve portability & versioning of DMT software »Implement build procedure using autoconfigure, automake. »Automate periodic builds & tests of current version. »Build & maintain binary RPMs (APTs?) for LSC reference platform. »Define standard execution environment. Interface DMT to grid utilities »Data access / publishing »Certificate based user authorization Verification »Build library of component tests for periodic verification. Cluster support (MIT, PSU, UWM) »Package installation

13. LIGO-G040245-00-E Plans (2005) Set up DMT to use Condor features »Disable message system (alarms, graphics) »Set up to run as “standard” Condor job Remote submission architecture »Wrapper/supervisor for condor jobs »Web interface for submission. Cluster support (PSU, UWM, MIT)

14. LIGO-G040245-00-E Plans (2006-7) Continue development of remote submission architecture »Wrapper/supervisor for condor jobs »Web interface for submission Cluster support (MIT, PSU, UWM)