1. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 1 The GLAST Data Handling Pipeline “Pipeline II” Daniel Flath for the GLAST Collaboration Stanford Linear Accelerator Center Gamma-ray Large Area Space Telescope

2. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 2 Outline Introduction to GLAST Computing and GLAST Pipeline Components Processing Task Examples Conclusion

3. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 3 GLAST Key Features Huge field of view –LAT: 20% of the sky at any instant; in sky survey mode, expose all parts of sky for ~30 minutes every 3 hours. GBM: whole unocculted sky at any time. Huge energy range, including band 10 GeV - 100 GeV Will transform the HE gamma-ray catalog: –by > order of magnitude in # point sources –spatially extended sources –sub-arcmin localizations (source-dependent) Large Area Telescope (LAT) GLAST Burst Monitor (GBM) spacecraft partner: General Dynamics Two GLAST instruments: LAT: 20 MeV – >300 GeV GBM: 10 keV – 25 MeV Launch: Feb 5, 2008. Cape Kennedy 565 km, circular orbit 5-year mission (10-year goal)

4. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 4 GN HEASARC GSFC DELTA 7920H White Sands TDRSS SN S & Ku LAT Instrument Science Operations Center GBM Instrument Operations Center GRB Coordinates Network Telemetry 1 kbps Alerts Data, Command Loads Schedules Mission Operations Center (MOC) GLAST Science Support Center GLAST Spacecraft Large Area Telescope & GBM GPS GLAST MISSION ELEMENTS

5. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 5 e+e+ e–e–  Overview of LAT Precision Si-strip Tracker (TKR) 18 XY tracking planes. Single-sided silicon strip detectors (228  m pitch) Measure the photon direction; gamma ID. Hodoscopic CsI Calorimeter (CAL) Array of 1536 CsI(Tl) crystals in 8 layers. Measure the photon energy; image the shower. Segmented Anticoincidence Detector (ACD) 89 plastic scintillator tiles. Reject background of charged cosmic rays; segmentation removes self-veto effects at high energy. Electronics System Includes flexible, robust hardware trigger and software filters. Systems work together to identify and measure the flux of cosmic gamma rays with energy 20 MeV - >300 GeV. Calorimeter Tracker ACD [ surrounds 4x4 array of TKR towers]

7. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 7 Motivation: General Computing Requirements Data rate: –400Hz total (5Hz Signal) –12GB raw data, total, over 8 daily downlinks Prompt Processing: –Reconstruct downlink within 1hr of receipt –Provide results to collaboration, other missions for: Analysis, Monitoring Flaring, bursting source detection Follow-up observation, confirmation –Result: 500GB reconstructed data per day Monte Carlo: –Ongoing throughout mission, ~100TB/yr

8. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 8 SLAC Pipeline Components Pipeline Server Oracle Pipeline Web Interface Line Mode Client Catalog Web Interface IN2P3 Job Control Batch Farm INFN Job Control Batch Farm Data Portal Command Client Data Catalog Oracle SLAC Job Control Batch Farm Client read-only

9. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 9 Example: A “Simple” Task getIntervalData diffuseResponses liveTimeCube launchRoiAnalysis DRP_monitoring roiAnalysis getRoiData exposureMap combineExpMaps sourceAnalysis launchEnergyBandAnalysis fitEnergyBand energyBandAnalysis fitEnergyBand energyBandAnalysis roiAnalysis getRoiData exposureMap combineExpMaps sourceAnalysis launchEnergyBandAnalysis drpExpMap exposureSubMap drpExpMap exposureSubMap drpExpMap exposureSubMap drpExpMap exposureSubMap Script Process Jython; Runs as thread inside Server Process. Launches Subtasks, sets variables, registers datasets with Data Catalog SubTask Provides parallelism Execution Condition Batch Process Compute intensive: Dispatched to farm. Results collected via email. Success, Failure, (all)-Completed Sub-SubTask

10. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 10 The Real Deal: Downlink Prompt Processing Reconstruction Digitization Merge Register Verify Clean Calibration Monitoring

11. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 11 Usage Plots: Activity Summary

12. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 12 Usage Plots: Task Activity Detail

13. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 13 Processing Plots: Single Process Statistics Maintain a record of: Total time (Wall Clock) Wait (Pending) time CPU time used Node name (machine class) Expect this to be ~1.0 if our process is not I/O bound  CPU Factors show up

14. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 14 Pipeline Front End: Stream View

15. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 15 Technologies Used Database –Oracle –Java (and PL/SQL) Stored Procedures Servers and Client Libraries (Pipeline, Data Catalog) –Java Web: –Apache/Tomcat servers –JSP for web pages DisplayTag for tabular data AIDA TLD for plotting Custom TLDs expose Pipeline client methods –Java Servlets Serve GraphViz State diagrams

16. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 16 Conclusion Pipeline is currently in extensive use: –Monte Carlo Production –Integration and Test raw data processing monitoring Software not coupled specifically to GLAST or SLAC –Could be used elsewhere –Additional batch farms incorporated by implementing simple Job Control (Java)-Interface –Contact if you are interested To see GLAST Pipeline II, Data Catalog (and much more!) in action: –http://glast-ground.slac.stanford.edu For more on DisplayTag (plotting in web pages): –Victor Serbo: “JAIDA, JAS3, WIRED4 and the AIDA tag library” -- EP7, Carson Hall A, Thursday August 6 17:30

17. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 17 Acknowledgments Software Development Team: Daniel Flath Charlotte Hee Karen Heidenreich Tony Johnson Igor Pavlin Max Turri Brave Users: Warren Focke Tom Glanzman

18. GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 18 Supplemental: GLAST Data Catalog