Operations Testing in the ISOC Service Challenges are a successor and extension to the successful Data Challenge model Broader set of objectives Continue.

Slides:



Advertisements
Similar presentations
9 v 2012Kavli IPMU1 Computational Astrophysics at the Kavli Institute for Particle Astrophysics and Cosmology at Stanford Roger Blandford.
Advertisements

Experiences From The Fermi Data Archive Dr. Thomas Stephens Wyle IS/Fermi Science Support Center.
GLAST LAT ISOCMonthly Status Review - ISOC, 29 October GLAST Large Area Telescope Instrument Science Operations Center Monthly Status Review 29.
GLAST LAT ProjectManager’s Face to Face - ISOC, 17 March GLAST Large Area Telescope WBS 4.1.B Instrument Science Operations Center Manager’s Face.
1 GLAST Large Area Telescope Monthly Mission Review LAT Flight Software Status June 6, 2007 Jana Thayer Stanford Linear Accelerator Center Gamma-ray Large.
GLAST LAT SLAC DoE Review June 13, 2007 R.Dubois1 GLAST Large Area Telescope: Science Analysis Systems and Collaboration Computing Needs Robert Cameron,
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT ISOCMonthly Status Review - ISOC, 1 August GLAST Large Area Telescope Instrument Science Operations Center Monthly Status Review 1 August.
GLAST Large Area Telescope - OperationsDOE Review, 15 June GLAST Large Area Telescope Operations Review Rob Cameron Instrument Science Operations.
GLAST LAT ProjectLAT Operations Planning, 23 March GLAST Large Area Telescope LAT Operations Planning 23 March 2005 Rob Cameron
GLAST LAT ProjectISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.1 Requirements 1 Gamma-ray Large Area Space Telescope GLAST Large.
GLAST Large Area Telescope ISOC Review 15 February 2006 FSW Activities, Organization, and Resource Needs Jana Thayer Stanford Linear Accelerator Center.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 4.3 Pipeline, Data Storage and Networking Issues1 Gamma-ray Large.
GLAST LAT Project 1S. Ritz Discussion: To Where From Here? DC2 Closeout Meeting 2 June, 2006 S. Ritz Gamma-ray Large Area Space Telescope.
July 7, 2008SLAC Annual Program ReviewPage 1 GLAST: Status and Prospects S. W. Digel Co-lead ISOC Science Operations Co-chair KIPAC GLAST Physics Department.
GLAST LAT Project Engineering Meeting – ISOC Peer Review 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review ISOC Detail.
RFA 18 – Automation of Operations Software Specific Request –Specify plans and requirements for automation of operations software, and describe the software.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
Section 15-1GLAST Ground System Design Review August 18&19, 2004 ISOC Organization ISOC Manager R Cameron Commanding, H&S Timeline Planning Command Generation.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 3 LOF Operations Concept 1 Gamma-ray Large Area Space Telescope GLAST.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.
Page 1HMI Team Meeting – January 26, 2005 HMI Mission Operations Rock Bush HMI Stanford Program Manager Stanford University
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 21 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST Large Area Telescope - OperationsDOE Review, 15 June GLAST Large Area Telescope Operations Review Rob Cameron Instrument Science Operations.
GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)
LAT ISOCDOE Status Review, 12 Oct GLAST Large Area Telescope LAT Instrument Science Operations Center Rob Cameron Stanford Linear Accelerator Center.
1 GLAST is now Fermi Gamma-ray Space Telescope First Light Introduction Dave Thompson NASA GSFC on behalf of the Fermi Mission Team see
GLAST Science Support CenterAugust 9, 2004 GLAST Users’ Committee Meeting—1 J.P. Norris GLAST Science Support Center Status.
GLAST LAT ProjectMonthly Status Review - ISOC, 1 September GLAST Large Area Telescope WBS 4.1.B Instrument Science Operations Center Monthly Status.
The GLAST Science Support Center’s Role in Supporting the User Community [24.10] Thomas E. Stephens (GSFC/L-3GSI) for the GLAST Science Support Center.
Serving Data to the GLAST Users Community Thomas E. Stephens (GSFC/RSIS) for the GLAST Science Support Center Abstract.
GLAST Science Support CenterAugust 9, 2004 Users’ Committee Meeting GSSC USER SUPPORT David Band – GSSC.
Serving Data to the GLAST User Community Don Horner (L3 GSI/GSFC) and the GLAST Science Support Center Team Data Properties and Impact on Data Serving.
Swift HUG April Swift data archive Lorella Angelini HEASARC.
1 GLAST The Gamma-ray Large Area Space Telescope Status of the Mission F.Longo see
GLAST LAT ProjectMonthly Status Review - ISOC, 3 Nov GLAST Large Area Telescope WBS 4.1.B Instrument Science Operations Center Monthly Status Review.
LAT ISOCISOC Review, 15 February GLAST Large Area Telescope Instrument Science Operations Center Introduction to GLAST and the LAT ISOC Rob Cameron.
GLAST Ground Software CHEP 2007, Victoria, Daniel Flath 1 The GLAST Data Handling Pipeline “Pipeline II” Daniel Flath for the GLAST Collaboration Stanford.
GLAST Mission - LAT ProjectDOE/NASA Review March 31, 2004 Section ISOC 1 GLAST Large Area Telescope: ISOC Subsystems WBS: 4.1.B David Lung Stanford Linear.
GLAST Large Area Telescope LAT Flight Software System Checkout TRR Test Suites (Backup) Stanford Linear Accelerator Center Gamma-ray Large Area Space Telescope.
LAT ISOCISOC Review, 15 February GLAST Large Area Telescope Instrument Science Operations Center Commanding, Health and Safety Rob Cameron Stanford.
Mission Status - S. Ritz 1 GLAST The Gamma-ray Large Area Space Telescope Mission Status DC2 Kickoff 1 March 2006 S. Ritz Gamma-ray Large Area Space Telescope.
1 Getting Involved with GLAST Workshop, CFA, 06/21/ C. Shrader, NASA/GSFC GLAST Data & Software Release plans + Science Support Center Services C.
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
GLAST LAT ProjectIDT Face-to-Face Agenda S. Williams 1 Face to Face Meeting Session Topic: LAT Operating Modes Date: March 19 Time: 13:30 Convener: Scott.
GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Document: LAT-PR Section 5 IOC Subsystem 1 GLAST Large Area Telescope: IOC Subsystems WBS: 4.1.B.
GLAST Large Area Telescope – ISOC Overview and StatusDOE Annual Review, 13 June GLAST Large Area Telescope Instrument Science Operations Center.
GLAST Large Area Telescope LAT Flight Software System Checkout TRR FSW Overview Sergio Maldonado FSW Test Team Lead Stanford Linear Accelerator Center.
Monitoring GLAST Operations: Building tracking displays for the LAT Instrument Science Operations Center By Christina Ketchum.
GLAST Science Support Center May 8, 2006 GUC Meeting AI#28. SAE Release Schedule David Band (GSSC/JCA-UMBC) Julie McEnery (GSFC)
Web Based Data Quality Monitoring for the Fermi Gamma-Ray Space Telescope Tony Johnson
GLAST LAT ISOCNotes for Italian meeting, 15 december Notes about ISOC and the italian contributions Gamma-ray Large Area Space Telescope.
The GLAST Science Support Center
GLAST Large Area Telescope Instrument Science Operations Center
GLAST Large Area Telescope:
“Running Monte Carlo for the Fermi Telescope using the SLAC farm”
GLAST Large Area Telescope:
GLAST Large Area Telescope
GLAST Large Area Telescope
Proposal for LAT Year 1 Data Release Plan
GLAST Large Area Telescope
GLAST Large Area Telescope
GLAST Large Area Telescope
Launch and On-orbit Checkout
GLAST Large Area Telescope
Data Challenge 2: Aims and Status
LAT Instrument Operations Center
GLAST Large Area Telescope Instrument Science Operations Center
Presentation transcript:

Operations Testing in the ISOC Service Challenges are a successor and extension to the successful Data Challenge model Broader set of objectives Continue to provide simulation datasets to the LAT collaboration for science analysis development Provides realistic datasets for ISOC science operations testing and rehearsals Detailed preparation and rehearsal of initial on-orbit instrument commissioning activities Multiple simulated datasets are in preparation 1-year dataset for extended science analysis testing Combined sky-survey and inertially pointed observations Short-duration, high-fidelity simulations for detailed testing Science operations tests and rehearsals Receipt and processing of Level 0 data Exercise of complete Level 1 processing chain Exercise of Level 2 automated science processing Duty scientist support activities Instrument reconfigurations Calibrations Response to LAT anomalies Automated Science Processing ASP: Automated Level 2 processing on reconstructed LAT event (Level 1) photon data, to search for, detect and characterize transient sources Detection of untriggered gamma-ray bursts Refined measurements (positions, light curves, spectra) for previously detected gamma-ray bursts Detection, characterizing and monitoring of flaring blazars and other sources ASP examples: multi-timescale AGN light curves and GRB position refinement from processing of simulated data For more details, see poster 19.13, J. Chiang et al. The ISOC and GLAST Operations The main ISOC operational interfaces are to the GLAST Mission Operations Center (MOC) and the GLAST Science Support Center (GSSC) LAT observations and other routine operations are planned on weekly periods LAT data down-linked from GLAST and delivered to the ISOC several times per day. The ISOC supports automated data receipt and ingest for “lights-out” data processing. LAT Data Processing Pipelined processing infrastructure is used for processing LAT event data Implemented on SLAC computer farm, benefiting from existing large-scale computing infrastructure for particle physics experiments Expect to apply 400 CPUs to LAT processing The data volume for processing the full down-linked LAT science dataset is shown below Approximately 1% of events in LAT science datasets will be celestial photons. It is possible to apply coarse filtering of background data in early processing to reduce disk and CPU needs. All Level 0 data are archived. LAT Configuration and Maintenance The ISOC maintains a flight-like hardware and software testbed for the LAT on-board data acquisition and processing electronics Detector front-end simulators allow for flight-like event data and rates in the lab The LAT testbed is used for several purposes: development, test and validation of LAT data collection configurations development and test of LAT flight software verification and validation of LAT commanding LAT Testbed Front-end simulators The GLAST LAT Instrument Science Operations Center Gamma-ray Large Area Space Telescope Robert A. Cameron (Stanford/SLAC) for the GLAST LAT Instrument Science Operations Center Acknowledgements This work is supported by Stanford University and the Stanford Linear Accelerator Center (SLAC) under DOE contract DE-AC03- 76SFO0515 and NASA grant NAS Non-US sources of funding also support the efforts of GLAST LAT collaborators in France, Italy, Japan and Sweden. LAT ISOC Functions The LAT ISOC is organized to: Support operation of the Large Area Telescope (LAT) Produce and deliver LAT Level 1 data and selected Level 2 science data to the LAT Collaboration and to the scientific community through the GLAST Science Support Center Main Functions: LAT command-sequence planning and construction Monitoring of LAT instrument health and safety Maintain and modify LAT flight software and the LAT Testbed LAT performance verification and optimization Receiving and archiving Level 0 data Process and archive LAT Level 1 and Level 2 data Maintain and optimize the software that produces LAT science data products Recon CPU Merit tuple size MonteCarlo size Digi size Recon size Per event0.06 sec0.5 kB28 kB1.5 kB8.6 kB Per day650 hrs19 GB1100 GB58 GB333 GB Per year 7 TB252 TB21 TB121 TB All-sky image of simulated 1-year LAT dataset Abstract The Gamma-ray Large Area Space Telescope (GLAST) is scheduled for launch in late Operations support and science data processing for the Large Area Telescope (LAT) instrument on GLAST will be provided by the LAT Instrument Science Operations Center (ISOC) at the Stanford Linear Accelerator Center (SLAC). The ISOC supports GLAST mission operations in conjunction with other GLAST mission ground system elements and supports the research activities of the LAT scientific collaboration. The ISOC will be responsible for monitoring the health and safety of the LAT, preparing command loads for the LAT, maintaining embedded flight software which controls the LAT detector and data acquisition flight hardware, maintaining the operating configuration of the LAT and its calibration, and applying event reconstruction processing to down-linked LAT data to recover information about detected gamma-ray photons. The SLAC computer farm will be used to process LAT event data and generate science products, to be made available to the LAT collaboration through the ISOC and to the broader scientific community through the GLAST Science Support Center at NASA/GSFC. ISOC science operations will optimize the performance of the LAT and oversee automated science processing of LAT data to detect and monitor transient gamma-ray sources. White Sands Complex/GFEP TDRS Ground Stations USN: Hawaii;Australia Mission Operations Center GLAST Science Support Center GSFC Launch Site KSC Gamma-Ray Burst Coordinates Network (GCN) GSFC GBM Instrument Ops Center MSFC/NSSTC LAT Instrument Science Ops Center SLAC Spacecraft I&T Facility Spectrum Astro HEASARC GSFC GPS RT HK Telemetry Command Data HK Data Dumps RT HK Telemetry Alerts/Alarms Sci & HK Data Dumps Command Data GPS Timing & Position Data TLM: Ku-band 40 Mbps S-band 1,2,4,8 kbps 1 kbps CMD: S-band 4 kbps 0.25 kbps TLM: 2.5 Mbps CMD: 2 kbps T&C Data Flows Test & Sim Data Sustaining Eng Data Level 0 Data Contingency Cmd As-Flown Timeline Level 0 Data Observing Plan ToO Orders As-Flown Timeline Burst Alerts Level 0 Data Contingency Cmd As-Flown Timeline Burst Alerts Level 1/2 Data LAT Commands/Loads Level 1/2 Data GBM Commands/Loads Archive Data FDF GSFC L&EO Support Science Community Science Products, Help GCN Notices Burst Messages GLAST GCN Notices BAP Merge Events Extract Context Extract EBF MOC FastCopy L0 Archive Ingest L0 data Create digi files Analyze charge injection data (LCI) Create recon files and perform event classification Analyze calibration data (LPA) MOOD/MOOT (config DB) Get Calibration from DB Create data analysis ntuples Automated Science Processing Data Receiving Calibrations and L1 processing Output Data Products to LAT Collaboration and GSSC Access more information and results at the LAT ISOC website: flux (8h bin) flux (1day bin) Data Challenges Data Challenges are used by the ISOC and the LAT Collaboration to develop, test and demonstrate Level 1 and Level 2 processing The full LAT collaboration participates in data analysis Exercises the GLAST science analysis software suite Data Challenge 1 (2004) simulated 1 day of LAT data Data Challenge 2 (2006) simulated 55 days of LAT data Delivered L1 event data to GSSC Generated LAT pointing history and livetime Developed and exercised LAT source catalog pipeline Populated data servers at GSSC and ISOC Joint data production/simulation/analysis with GLAST Burst Monitor (GBM) instrument team ~200,000 CPU-hours on SLAC compute farm to generate background and sky data DC2 datasets used for test/development of ISOC science ops Develop diagnostics, trending, reports etc. For more information, see poster 19.24, J. McEnery et al.