1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.

Slides:



Advertisements
Similar presentations
Title: ICON L0 from MOC to SOC automation Author: MOC/SOC Resides: SOC Description: This is a script that copies the ICON L0 files from the MOC to the.
Advertisements

Solar-B FPP 1 Ted Tarbell, TRACE Operations 3 February 2003 MODA Mtg, ISAS The TRACE Model for Operations Ted Tarbell
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
Mission Operations and Data Flow Overview Koji Mukai Astro-E2 Guest Observer Facility.
GLAST LAT ProjectISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.1 Requirements 1 Gamma-ray Large Area Space Telescope GLAST Large.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
09 May 2014page 1 ROCC to PPL ICD Initial Definition ExoMars Rover Operations Control Center ROCC.
Leicester Database & Archive Service J. D. Law-Green, S. W. Poulton, J. Osborne, R. S. Warwick Dept. of Physics & Astronomy, University of Leicester LEDAS.
Science Operations Status Maria Santos-Lleo EPIC cal & ops meeting, Madrid March, 2010.
STEREO Science Center SWG – Dec 2004 William Thompson NASA Goddard SFC Code Greenbelt, MD
Data Processing and User Software Ken Ebisawa (Astro-E2 GOF) presentation and demonstration.
October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.
CXC Implementing 2007 NRC Portals of the Universe Report Chandra X-ray Center Recommended Best Practices Roger Brissenden and Belinda Wilkes 25 April 2012.
Data management in the field Ari Haukijärvi 2nd EHES training seminar.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
IXYZ Frank Marshall NASA/GSFC 25 April 2012 April 25, 20121Implementing Portals of the Universe.
SGS: Activities and Requests Helen Middleton. Hermean Environment Working Group Meeting | SGS Team | Key Largo | 16/05/2013 | Slide 2 Contents 1.ESAC.
Transiting Exoplanet Survey Satellite Daryl Swade Archive Peer Review June 18, 2014.
Aquarius Project Status 7 th Aquarius/SAC-D Science Team Meeting 11 April 2012.
2-1 DMS Requirements Status Daryl Swade DMS Systems Engineer Nov. 6, 2013 S&OC Data Management System Design Review 3.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
Swift HUG 14 Feb Swift archive Lorella Angelini/HEASARC.
ALMA Integrated Computing Team Coordination & Planning Meeting #4 Santiago, November 2014 Reporting Software Principles M Chavan, ESO R Soto, ALMA.
The SOC Pilot and the ATOA Jessica Chapman CASS Observatory Operations Research Program Leader 28 June 2011.
Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.
Final Version Micro-Arcsecond Imaging Mission, Pathfinder (MAXIM-PF) Mission Operations Tim Rykowski Jeffrey Hosler May 13-17, 2002.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
Consortium Meeting La Palma October ICC Status Tanya Lim 1 SPIRE Consortium Meeting La Palma, Oct. 1 – ICC Status Tanya Lim RAL.
L. NExScI Operational Readiness Rafael Millan-Gabet Project Scientist, NExScI & Mihseh Kong, NExScI Software Engineer David Imel, IPAC & NExScI Manager.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
April , 2006 HEASARC Users Group Steve Drake RXTE Archive at HEASARC Status and Plans Steve Drake.
06-1L Suzaku Suzaku UG - 13 Dec, 2007 Suzaku processing and archive Lorella Angelini/HEASARC.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
 2001 Prentice Hall Business Publishing, Accounting Information Systems, 8/E, Bodnar/Hopwood Chapter 10 Electronic Data Processing Systems.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG April 2008 Meudon, France.
GLAST Science Support CenterAugust 9, 2004 Users’ Committee Meeting GSSC USER SUPPORT David Band – GSSC.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
HEASARC and Related Data Center Activities Nicholas White HEASARC Director.
Swift HUG April Swift data archive Lorella Angelini HEASARC.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Introduction / Context.
April , 2006 HEASARC Users Group Mike Corcoran HETE-2.
FASR Software Considerations Gordon Hurford SSL AUI – August 2007.
29 Nov 2006PDS MC NSSDC MOU history PDS-NSSDC MOU circa 1994 Reviewed in Jan 2003, June 2004, Oct 2005, Nov 2006 Add words to remove HQ changes Change.
April , 2006 HEASARC Users Group Roger Brissenden 1 HEASARC Supported Activities at SAO Roger Brissenden.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
Toward the Senior Review Rob Petre. Senior Review proposal details Due March 12, 2008 Competing against: XMM, INTEGRAL, RXTE, Swift, Galex, WMAP, Spitzer.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG March 27-28, 2007.
The HEASARC Coordinate data, software, and media standards with other astrophysics sites. Established December 1990 The HEASARC Charter: Maintain and disseminate.
PDS Geosciences Node Page 1 Archive Status MRO and Phoenix Ed Guinness PDS Management Council August 13, 2007 Ed Guinness.
PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.
Solar Probe Plus A NASA Mission to Touch the Sun March 2015 Instrument Suite Name Presenter's Name.
GLAST Science Support Center May 8, 2006 GUC Meeting Status of GLAST User Support David Band (GSSC/JCA-UMBC)
1 Transiting Exoplanet Survey Satellite Daryl Swade Archive Team Meeting June 16, 2014.
CD FY09 Tactical Plan Status FY09 Tactical Plan Status Report for Neutrino Program (MINOS, MINERvA, General) Margaret Votava April 21, 2009 Tactical plan.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
Archiving, Distribution and Analysis of Solar-B Data Masumi Shimojo SOLAR-B Project ・ NSRO/NAOJ and The SOLAR-B MODA Working Group Masumi Shimojo SOLAR-B.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG November 2007 Pasadena, California.
06-1L Suzaku Suzaku UG - 3 May, 2007 Suzaku processing and archive Lorella Angelini/HEASARC.
TERRA UPDATE Launch Date NSIDC DAAC Launch Readiness MODIS Snow and Ice Products General Product Release Timeline.
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
The HETE-2 Archive Mike Corcoran HEASARC User Group Feb 14, 2003 HETE-2: A small satellite designed to detect and localize gamma- ray bursts Instruments:
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
Chang, Wen-Hsi Division Director National Archives Administration, 2011/3/18/16:15-17: TELDAP International Conference.
R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.
AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.
GLAST Large Area Telescope:
Leigh Grundhoefer Indiana University
Presentation transcript:

1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC

2 SUZAKU HUG 12-13April, 2006 Suzaku Suzaku launched on 10 July X-ray Spectrometer (XRS keV) -X-ray Imaging Spectrometer (XIS keV; 4 units) - Hard X-ray Detector (HXD keV) August : loss of the XRS usability -Observing program changes : -New SWG program (finalized in Oct 2005) -New AO1 (closing on 6 Jan 2006) (validity April 2006-March 2007) -AO1 results made public on March Changes in Mission Phases: now in the extended phase -Suzaku in Senior review in April 2006

3 SUZAKU HUG 12-13April, 2006 HEASARC role Populate and maintain the Suzaku science and calibration data archive Provide the following services –Public access to the Suzaku archive –Science data analysis software environment –Web server for the Guest Observer Facility –Database system for the Suzaku tables –Long-term archive MOU and ICD document roles & responsibilities and details the interface between HEASARC and Suzaku GOF Suzaku data archive present at HEASARC and DARTS (ISAS/JAXA)

4 SUZAKU HUG 12-13April, 2006 Archival Data Data sets part of Suzaku archive –Science & housekeeping data organized by observation => each containing Level 1 (unfiltered), 2 (filtered), 3 (products) for all instruments for a specific proposal target –Monitoring and/or Trend data organized by type –Calibration data using CALDB infrastructure File format: –Science, housekeeping and calibration data are provided in FITS format (OGIP standard) –Preview of summary products (e.g. GIF) –HTML used to record processing Database tables ASCII (TDAT) –To select data via the Web based search facility (BROWSE)

5 SUZAKU HUG 12-13April, 2006 Archive population Two processing & archive sites : GSFC and ISAS/JAXA –Special Checksum to verify same data output between the processing site –Plan of archive verification between data at HEASARC and DARTS to ensure serving the same data (procedure re-use from Swift) GSFC processing site sent data & databases to the HEASARC via DTS Timescale for data and databases –1 week after an observation is completed (typical observation 1-2 days) –Database tables (suzamastr and suzaxislg) & trend when an update is available (estimated daily) Archive access via : –HEASARC Web Browse and FTP Data volume estimated up to 2-3 Gbyte/day

6 SUZAKU HUG 12-13April, 2006 Initial Mission Phase During the SWG Phase data access to the SWG team –Data encrypted in the archive & key distributed to the Team. GO data –Data in the archive encrypted & key distributed to the GOs. One year proprietary period. First public data foreseen ~ 1.5 year into the mission –End of the proprietary period data are decrypted at the archive sites. – HEASARC and DARTS needs to coordinate this operation

7 SUZAKU HUG 12-13April, 2006 Operational plan : status (1) At HEASARC the hardware configuration is in place: –DTS machine & relevant software (DTS and DAS) –Physical disks in place (total volume 1.3TB) & mounted on the DTS machine and on the FTP area -backup procedure in place (daily and weekly rsync) Established the DTS label for the different transfers –Data, Database & for the different type of trend data known DTS data transferring test with processing site (10 Jan 2006) Database ingest mechanism in place (not tested yet) -Reuse of the Swift software

8 SUZAKU HUG 12-13April, 2006 Operational plane : status (2) Version 1 processing is under testing. It uses : –The 1st software and CALDB releases to be distributed shortly Databases : –suzamaster first draft ready for the end2end test –suzaxislog not yet implemented Distribution mechanism of the encryption key to the US GO to be tested The first end2end test starts next week (April ) –Transfer data from the Japan to US processing site –Processing of the data at the US site –Creation of the database at the US site –Data encryption and test the mechanism of encryption key distribution => Processing and archive operational in May

9 SUZAKU HUG 12-13April, 2006 Software and CALDB HEASARC ingests calibration data in CALDB via the automatic ingest procedure : –Deliveries and updates provided by the GOF –Access via the HEASARC CALDB page dedicated to Suzaku or via FTP or remote access HEASARC imports the Suzaku software into the HEAsoft package for distribution –Deliveries and updates provided by the Software Team via CVS –Access via the HEASARC software distribution page or via FTP 1st Suzaku software & CALDB releases planned for: 1st week of May

10 SUZAKU HUG 12-13April, 2006 Software Interface Test software interface docs/software/lheasoft/ astroe2.html

11 SUZAKU HUG 12-13April, 2006 Access via ftp or at heasarc web site /docs/heasarc/caldb/astroe2