1. Document: LAT-PR-01967 Section 6 SAS Subsystem 1 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 GLAST Large Area Telescope: Science Analysis Software Richard Dubois Stanford Linear Accelerator Center richard@slac.stanford.edu Gamma-ray Large Area Space Telescope

2. Document: LAT-PR-01967 Section 6 SAS Subsystem 2 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Outline Introduction to SAS SAS Mission as defined by Level 3 Requirements and Milestones Instrument Simulation and Event Reconstruction Support of Engineering Tests Level 1 Pipeline progress High Level Science Tools development progress Mission Ground Systems End-to-end testing Preparation for LAT Ground System Peer Review and CDR Cost and Schedule Concerns Summary

3. Document: LAT-PR-01967 Section 6 SAS Subsystem 3 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Level III Requirements Summary Ref: LAT-SS-00020

4. Document: LAT-PR-01967 Section 6 SAS Subsystem 4 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Science Analysis Software Overview Data Pipeline –Prompt processing of Level 0 data through to Level 1 event quantities –Providing near real time monitoring information to the IOC –Monitoring and updating instrument calibrations –Reprocessing of instrument data Performing bulk production of Monte Carlo simulations Higher Level Analysis –Creating high level science products from Level 1 for the PI team Transient sources Point source catalogue –Providing access to event and photon data for higher level data analysis Interfacing with other sites (sharing data and analysis tool development) –Mirror PI team site(s) –SSC Supporting Engineering Model and Calibration tests Supporting the collaboration for the use of the tools

5. Document: LAT-PR-01967 Section 6 SAS Subsystem 5 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 SAS Organization Instrument Project Office R.Dubois Manager 4.1.D SLAC T.Burnett Sim/Recon 4.1.D.1 UW H.Kelly ACD 4.1.D.1.5 GSFC M.Strickman CAL 4.1.D.1.6 NRL, France T.Usher TKR 4.1.D.1.7 SLAC, UCSC, Italy T.Burnett Sources 4.1.D.1.1 UW F.Longo GEANT4 4.1.D.1.4 Italy T.Burnett Architect UW E.do Couto e Silva Calibrations 4.1.D.6 SLAC S.Digel Science Tools 4.1.D.4 Stanford R.Schaefer (SSC) K.Young (SLAC) Databases J.Chiang (UMBC) T.Burnett Observation Simulatior D.Band (SSC) S.Digel (SU) Analysis Tools P.Nolan (SU) Source Detecttion I.Grenier (CEA/Saclay) Catalog Analysis M.Hirayama (SSC) Pulsar Analysis D.Band (SSC) GRB Analysis H.Kelly Analysis Tools 4.1.D.2 GSFC A.Schlessinger Release MAnagement 4.1.D.2.9 SLAC Performance Metrics in conjunction with S.Ritz GSFC A. Schlessinger DPF 4.1.D.5 SLAC

6. Document: LAT-PR-01967 Section 6 SAS Subsystem 6 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 SAS in the Ground System DPF is robotic backbone of IOC/SAS process handling – Performs L1 & L2 processing Keep everything on disk DPF server and database can handle multiple arbitrary sequences of tasks: L1 pipeline; reprocessing; MC; ….

7. Document: LAT-PR-01967 Section 6 SAS Subsystem 7 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Processing Flow Data Pipeline Sim Raw Data Level 0 Recon Level 1Science Tools Level 2

8. Document: LAT-PR-01967 Section 6 SAS Subsystem 8 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Level 1 Sim/Recon Chain Real Data 3 GeV  Level 1

9. Document: LAT-PR-01967 Section 6 SAS Subsystem 9 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Multiple Scattering in Converter Layers 100 MeV gammas –Mean angle: ~17 mr –Separation at next layer: ~550  m –Strip pitch 228  m –Barely resolvable into separate strip hits @100 MeV! MS blows up the opening angle significantly! –Mean angle: ~ 140 mr –Separation at next layer: ~4.5 mm –Easily resolvable Note design: –Blue is “front” 12 3% X0 layers –Green is “back” 4 18% X0 layers Last 2 have no radiator –To optimize interaction rate vs resolution T.Usher 100 MeV  vertical Multiple scattering critical to tracking at low E Use Kalman filter to account for large MS contributions Apparent opening angle x2 scale change!

10. Document: LAT-PR-01967 Section 6 SAS Subsystem 10 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Tracking Reconstruction Example 100 MeV Gamma T.Usher

11. Document: LAT-PR-01967 Section 6 SAS Subsystem 11 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Sim/Recon Toolkit PackageDescriptionProviderStatus ACD, CAL, TKR Recon Data reconstruction LAT90% done In use ACD, CAL, TKR Sim Instrument simLAT95% done In use GEANT4Particle transport sim G4 worldwide collaboration In use xmlParametersWorld standardIn use RootC++ object I/OHEP standardIn use GaudiCode skeletonCERN standardIn use doxygenCode doc toolHEP standardIn use Visual C++/gnuDevelopment envsWorld standardsIn use CMTCode mgmt toolHEP standardIn use cvswebcvs web viewerHEP standardIn use cvsFile version mgmtWorld standardIn use

12. Document: LAT-PR-01967 Section 6 SAS Subsystem 12 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Software Development Enable distributed development via cvs repository Extensive use of electronic communications –Web conferencing (VRVS), Instant Messaging (icq) CMT tool permits equal development on Windows and Linux –Superior development environment on Windows; compute cycles on linux documentation and coding reviews enforce coding rules “Continuous integration” –Eliminate surprises for incoming code releases –Build code every night; alert owners to failures in build or running of unit tests. Results tracked in database. –Developing comprehensive system tests in multiple source configurations. Track results in database; web viewable.

13. Document: LAT-PR-01967 Section 6 SAS Subsystem 13 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Nightly Builds Past release Release in progress Future release Display created from database query Performing builds for Science Tools now also Build status Unit test status

14. Document: LAT-PR-01967 Section 6 SAS Subsystem 14 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 System Tests Comparison of current to previous release.

15. Document: LAT-PR-01967 Section 6 SAS Subsystem 15 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 SAS Timeline 2003200420052006 LAT CDR EM CU Beam Test LAT-GS Peer Rev DC 1 DC 2 LAT-GS CDR FSW FE-Sim MC LAT Cosmic Ray Tests GRT 1 GRT 4 Sim/recon, Proto pipeline Sim/recon, Proto SciTools, Pipeline, Data xfer to SSC CU-Validated Sim/recon, SciTools, Final pipeline, Data xfer to SSC DC 3

16. Document: LAT-PR-01967 Section 6 SAS Subsystem 16 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Engineering Tests Support – EM – mid 2003 References –LAT-MD-00446 – SVAC Plan –LAT-MD-01587 - SVAC EM Tests spec, section 6.1 –LAT-MD-00570 – I&T – SAS ICD for EM –LAT-TD-01340 – SAS Calibration Infrastructure –LAT-TD-01588 – Calibration Algorithms for EM –LAT-TD-00582 – EM Geometry for Simulations Required deliverables –TKR, CAL subsystem calibration algorithms –Calibration infrastructure for time dependent parameters –Flexible geometry facility to describe EM unit –Reasonable fidelity simulation/reconstruction –Disk & CPU resources for simulation and analysis –Would like to run processing with the pipeline. Not required. Ready for EM Complete

17. Document: LAT-PR-01967 Section 6 SAS Subsystem 17 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Engineering Model Mini-Tower (5 trays of material, 3 pairs of active silicon) EM - 18 MeV on-axis photon (from VDG)

18. Document: LAT-PR-01967 Section 6 SAS Subsystem 18 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 TKR - Number of TRACKSTKR – number of CLUSTERS Differential distribution Signal dominates Differential distribution Signal dominates     Cuts: TKR trigger Negative values are not shown I&T / E. do Couto e Silva

19. Document: LAT-PR-01967 Section 6 SAS Subsystem 19 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 FSW MC Support for FE-Sim – late 2003 FSW has requested a full orbit’s worth of background to test the Front End Simulator –~50 Million events –~1200 CPU-days @ 2 secs per event –~500 GB output Needed around Aug 2003 – resources in place MC/Sim already in place Must interface FSW code to output flight format data Complete Complete In progress 1 man-week

20. Document: LAT-PR-01967 Section 6 SAS Subsystem 20 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Engineering Tests Support – CU – mid 2005 See –LAT-MD-00446 – SVAC Plan –LAT-MD-01587 - SVAC EM Tests spec, section 6.1 –LAT-MD-00571 – I&T – SAS ICD for CU –LAT-TD-01589 – Calibration Algorithms for CU –LAT-TD-00583 – CU Geometry for Simulations Required deliverables –ACD subsystem calibration algorithms –Flexible geometry facility to describe CU –Good fidelity simulation/reconstruction –Disk & CPU resources for simulation and analysis –Processing Pipeline and Data Catalogue Complete Complete In planning – 1 man month Database complete Promised by SLAC

21. Document: LAT-PR-01967 Section 6 SAS Subsystem 21 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 CU – 500 MeV angled electron (from test beam) 500 MeV e-

22. Document: LAT-PR-01967 Section 6 SAS Subsystem 22 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Level 1 Pipeline Goal is to do early prototyping using EM and MC simulation runs as undemanding clients –Provide a general robot that can be configured to run any of the task chains we need L1, L2 processing MC simulations Data reprocessing I&T/IOC tasks –Underlying database design complete Design interfaces to make the pipeline portable –Generic database usage –Interfaces to submit processes to do the work Done by DC1 if OPUS works out –In use by Hubble, FUSE, Integral, Chandra, BeppoSax, and SIRTF –1 FTE-year budgeted to write from scratch if not – ready for CU Docs: database: LAT-TD-00553LAT-TD-00553 server: LAT-TD-00773LAT-TD-00773 diagnostics: LAT-TD-00876LAT-TD-00876 Functional Reqs in draft now Evaluating STScI/Hubble OPUS pipeline Heritage from SLD experiment at SLAC

23. Document: LAT-PR-01967 Section 6 SAS Subsystem 23 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Pipeline Server Layout

24. Document: LAT-PR-01967 Section 6 SAS Subsystem 24 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Working with Mission Ground Systems Contact via biweekly GOWG meetings Series of End-to-End tests being planned –SAS involved with GRT1 and GRT4 –GRT1 (11/04) First transmission of Level 0 data from MOC to IOCs –GRT4 (9/05) Required Level 1 processing with transfer of results to SSC Will have been done in CU and DC1 –Support Mission GS PDR etc

25. Document: LAT-PR-01967 Section 6 SAS Subsystem 25 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Development of Science Tools Extensive planning on which tools are needed to do science - and their requirements –One set of tools for all – “astronomy standard” –Had external review (9/2002) to see if we are on the right track No major problems noted http://www-glast.slac.stanford.edu/ScienceTools/reviews/sept02/report/review_091602.pdf In progress with the SSC –Joint oversight group –Sorted out technical basis (HEASARC standards; support of community; re-use of LAT developments) Effort ramping up now Selected Level 1 database technology –Meets performance requirements –Starting to implement at GSFC

26. Document: LAT-PR-01967 Section 6 SAS Subsystem 26 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Science Tools for High-Level Analysis Gamma rays in 1-day scanning observation (~150k >30 MeV), color coded by energy Hundreds of sources even in this short time: What are their fluxes? Which are flaring? Bright diffuse emission of the Milky Way + Galactic and extragalactic point source populations Annual rate (all energies) ~10 8 gamma rays/year

27. Document: LAT-PR-01967 Section 6 SAS Subsystem 27 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Main Science Tools PackageDescription LikelihoodWorkhorse model fitting for detection & characterization of cosmic gamma-ray sources Level 1 database accessExtracts desired event data Exposure calculationUses IRFs, pointing, livetime etc. for deriving calibrated source fluxes Source identificationIdentifies gamma-ray sources with cataloged counterparts at other wavelengths GRB analysisTemporal and spectral analyses of burst profiles Pulsar analysisPhase folding & period searching of gamma-ray pulsars and candidates Observation simulatorHigh level simulation of observations of the gamma- ray sky with the LAT

28. Document: LAT-PR-01967 Section 6 SAS Subsystem 28 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Science Tools Toolkit PackageDescriptionProviderStatus PIL, PIL++IRAF parameter access HEASARCIn use cfitsio, CCFitsFITS file manipulation HEASARCIn use XSPEC, SherpaFor GRB spectral modeling HEA standardsUnder consideration Rootgui etcHEP standardUnder consideration pythonScriptingWorld standardUnder consideration doxygenCode doc toolWorld standardIn use Visual C++/gnuDevelopment envsWorld standardsIn use CMTCode mgmt toolHEP standardIn use cvswebCvs web viewerWorld standardIn use cvsFile version mgmtWorld standardIn use

29. Document: LAT-PR-01967 Section 6 SAS Subsystem 29 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Data Challenges Now traditional in HEP experiments –exercise the full analysis chain prior to needing it –involve the collaboration in science prep early Doing planning now –Fall 2003 - DC1 1 day’s data through full instrument simulation and first look at Science Tools –Fall 2004 – DC2 1 month’s background/1 year signal Test more Science Tools; improved Pipeline –Spring 2006 – DC3 run up to flight – test it all! –DC1 Plans Focus effort through Analysis Group (S.Ritz) and kickoff workshop in mid-summer –Including geometry and simulation validation Sept collaboration meeting as milestone for start

30. Document: LAT-PR-01967 Section 6 SAS Subsystem 30 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Prep for GS Peer Review and CDR SAS was baselined in PDR Ground Systems CDR has been scheduled for 2/2004, with Peer Review in 11/2003 Expectations for Peer Review –Successful EM support –Level 1 Prototype operational Functional requirements; Design documents ready –Science Tools Major components understood, with schedule, manpower and milestones Plan to schedule next external review to be coincident with Peer Review –ICD with SSC

31. Document: LAT-PR-01967 Section 6 SAS Subsystem 31 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Processing Flow Recap Data Pipeline Sim Raw Data Level 0 Recon Level 1 Science Tools 95% done In use 90% done In use In planning/progress Estimate 40 man-Yr effort Available from SSC and LAT collaboration ~80-90% done if Opus works out Level 2 Prototype database being implemented

32. Document: LAT-PR-01967 Section 6 SAS Subsystem 32 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 4.1.D Science Analysis Software Cost/Schedule Summary

33. Document: LAT-PR-01967 Section 6 SAS Subsystem 33 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 CCB Actions Affecting 4.1.D Change Request #DescriptionStatus LAT-XR-01146-01UW ManpowerApproved, $283K LAT-XR-01148-02NRL Resource Leveling Approved, $0K LAT-XR-01752-02SLAC/HEPL Labor Escalation Rates Approved -$16K

34. Document: LAT-PR-01967 Section 6 SAS Subsystem 34 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Cost by Fiscal Year WBS 4.1.D without contingency

35. Document: LAT-PR-01967 Section 6 SAS Subsystem 35 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Budget, Cost, Performance

36. Document: LAT-PR-01967 Section 6 SAS Subsystem 36 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Cost/Schedule Status ItemIn k$ Budget at Complete3,595 Budgeted Cost for Work Scheduled (a)1,257 Budgeted Cost for Work Performed (b)1,246 Actual Cost for Work Performed1,093 Cost Variance15312% of (b) Schedule Variance-12-1% of (a) Status as of March 31, 2003:

37. Document: LAT-PR-01967 Section 6 SAS Subsystem 37 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Concerns Manpower is the major concern –No technological risks –“just” a matter of implementing and supporting the solutions we have designed for –Infrastructure group is thin, and hard to find people willing to do it. SLAC, GSFC are providing much of that support –Mitigation We concentrate on early starts to critical elements with incremental improvements over time. Reuse appropriate software from other projects as much as possible As much automation of repetitive tasks as possible

38. Document: LAT-PR-01967 Section 6 SAS Subsystem 38 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Summary SAS driven by Engineering Tests and LAT Integration –EM support ready; CU looking good –Sim/Recon ready Science Tools under development –In concert with the SSC –Drive schedule with Data Challenges Level 1 Pipeline early start –Trying to have prototype in place for EM, FSW & DC1 support this year –End-to-end tests scheduled with Mission Ground Systems Internal validation, Beam tests and Data Challenges in place to ensure successful end-to-end functionality well before launch.

39. Document: LAT-PR-01967 Section 6 SAS Subsystem 39 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Backups

40. Document: LAT-PR-01967 Section 6 SAS Subsystem 40 GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Components of the Environment User Interface aspects of the standard analysis environment, such as Image/plot display (UI2), Command line interface & scripting (UI4), and GUI & Web access (UI5) are not shown explicitly. 1 This tool also performs periodicity tests and the results can be used to refine ephemerides 2 These tools can also take as input binned data from other instruments, e.g., GBM; the corresponding DRMs must also be available. Pulsar ephem. (D4) Level 1 (D1) LAT Point source catalog (D5) Interstellar em. model (U5) Pointing/livetime history (D2) Astron. catalogs (D6) Level 0.5 IRFs (D3) Alternative source for testing high- level analysis Alternative for making additional cuts on already- retrieved event data Pt.ing/livetime simulator (O1) Observation simulator (O2) Pt.ing/livetime extractor (U3) Data sub- selection (U2) Data extract (U1) Exposure calc. (U4) Likelihood (A1) Map gen (U6) Src. ID (A2) Event display (UI1) Pulsar profiles (A3) 1 Catalog Access (U9) Pt.ing/livetime extractor (U3) Pulsar phase assign (U12) Pulsar period search (A4) GRB spectral-temporal modeling (A10) Source model def. tool (U7) Arrival time correction (U10) GRB temporal analysis (A7) 2 GRB LAT DRM gen. (U14) GRB spectral analysis (A8) 2 GRB event binning (A5) GRB unbinned spectral analysis (A9) GRB visual- ization (U13) IRF visual- ization (U8) Ephemeris extract (U11) GRB rebinning (A6) 2