L. NExScI Operational Readiness Rafael Millan-Gabet Project Scientist, NExScI & Mihseh Kong, NExScI Software Engineer David Imel, IPAC & NExScI Manager.

Slides:



Advertisements
Similar presentations
Configuration Management
Advertisements

Peter Griffith and Megan McGroddy 4 th NACP All Investigators Meeting February 3, 2013 Expectations and Opportunities for NACP Investigators to Share and.
More CMM Part Two : Details.
Title: ICON L0 from MOC to SOC automation Author: MOC/SOC Resides: SOC Description: This is a script that copies the ICON L0 files from the MOC to the.
Kepler Martin Still (NASA Ames) 25 April Portals to the Universe: Lessons Learned Meeting - Apr 25, STScI - Martin Still mission duration3.5.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.
MPARWG Deborah K Smith DISCOVER MEaSUREs Project Remote Sensing Systems.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
LBTI ORR Pre-Briefing to the Board April 14,
Conferences - Hosting/co-hosting science conferences - Exhibit and present project output and services at community conferences Training Workshops - Data.
J. Large Binocular Telescope (LBT) Operational Readiness
C. Executive Summary Phil Hinz Principal Investigator.
SSSC 02/18/2010 P. Marcum Science Utilization Policies SOFIA SCIENCE UTILIZATION POLICIES Pamela M. Marcum SOFIA Project Scientist SSSC Feb 19, 2010.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Exoplanet Exploration Program Large Binocular Telescope Interferometer (LBTI) Operational Readiness Review (ORR) PI: Phil Hinz, UA PS: Rafael Millan-Gabet,
ASPERA-3 April. 25, 01 Monthly Status Report ASPERA Monthly Status ReportMonthly 4_25/ Page 1 Monthly Status Report Report due 4/25/01 Schedule statused.
Transiting Exoplanet Survey Satellite Daryl Swade Archive Peer Review June 18, 2014.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
2-1 DMS Requirements Status Daryl Swade DMS Systems Engineer Nov. 6, 2013 S&OC Data Management System Design Review 3.
LBTI HOSTS Science Operations Plan Draft 0 – Feb
SI team data access Scott Horner 28 September 2009.
FGM report 9 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Paul French, Chris Carr, Tim Oddy, André Balogh I mperial College London March.
Geosciences Node Ed Guinness MC Face-to-Face Meeting Washington, DC March 27-28, 2012.
1 SPSRB Decision Brief on Declaring a Product Operational Instructions / Guidance This template will be used by NESDIS personnel to recommend to the SPSRB.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Status FUV Detector “1-bounce design” NUV Detector HST aberration fully-corrected Calibration.
Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.
ExOB Discussions on Development Test Center WRF ExOB Meeting U.S. Naval Observatory, Washington, D.C. 28 April 2006.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
M u l t I b e a m III W o r k s h o p M u l t I b e a m III W o r k s h o p National Geophysical Data Center / World Data Centers NOAA Slide 1 End-to-End.
B. Review Board Charter and ORR Success Criteria Muthu Jeganathan Project Manager, JPL.
April , 2006 HEASARC Users Group Steve Drake RXTE Archive at HEASARC Status and Plans Steve Drake.
ARCSS Data Management Support Overview and Update James Moore Steve Williams NCAR Earth Observing Laboratory 3-5 October 2007.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006
SCIOPS 2013 Reinhard Hanuschik, ESO Garching The VLT Quality Control Loop.
WGISS /09/2015 DATA PRESERVATION – CNES APPROACH B. Chausserie-Laprée.
GLAST Science Support CenterAugust 9, 2004 Users’ Committee Meeting GSSC USER SUPPORT David Band – GSSC.
N. Summary Phil Hinz Principal Investigator. Performance N-2.
Swift HUG April Swift data archive Lorella Angelini HEASARC.
F. LBTI Current Performance and Compliance with ORR Entrance Criteria Phil Hinz Principal Investigator.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Data Standards Development August 29, Topics 1.Current Status 2.What was delivered for Build 2c 3.How was IPDA supported 4.What mission support.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.
GLAST Science Support Center June 21, 2007 Getting Involved with GLAST GLAST Guest Investigator Program David Band, GSSC CRESST/GSFC/UMBC.
18 th GIST Meeting 14 th –16 th May 2003 Ground Segment (GGSPS) Report 1 GERB Ground Segment B.C.Stewart RAL.
Transiting Exoplanet Survey Satellite December 8, 2014 TESS Kickoff.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
GLAST Science Support Center November 17, 2006 GUC Face-to-Face Meeting GLAST GI Program (with revised schedule) David Band, GSSC.
Data Processing & Quality Control Group [ Faculty Meeting Sept Data Processing & Quality Control Quality Control Group head: Reinhard.
An Early Release Science Program Janice C. Lee STScI Science Mission Office JWST Science Working Group Meeting 29 April 2015.
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
Implementation Review1 Archive Ingest Redesign March 14, 2003.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
1 Universities Space Research Association Science Instrument Pipeline Requirements SSSC 2009 September 29 Erick Young Director SOFIA Science Mission Operat.
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
NASA Exoplanet Science Institute The Keck Observatory Archive ndex.shtml A collaboration between NExScI and the.
ATom data management plan: Data products and submission requirements Observed data and model products will be submitted in NetCDF or ICARTT format www-air.larc.nasa.gov/missions/etc/ESDS-RFC-019-v1.1_0.pdf.
ROCC Operations and The PSA RSP Archive Concept Review 28 September 2017 Tanya Lim Archive Scientist.
ATom data management plan:
The RSP Archive System RSP Archive Concept Review 28 September 2017
Instrument PDR Summary of Objectives
Observing with Modern Observatories (the data flow)
DOD’S PHASED SYSTEM DEVELOPMENT PROCESS
Commissioning Data – Who and Why?
Presentation transcript:

L. NExScI Operational Readiness Rafael Millan-Gabet Project Scientist, NExScI & Mihseh Kong, NExScI Software Engineer David Imel, IPAC & NExScI Manager Chas Beichman, NExScI Director

NExScI Compliance This presentation discusses NexScI readiness to assume responsibility for the archive Relationship to ORR Success Criteria: Satisfies requirement for NExScI to perform processing and archiving of LBTI-produced data Concerns: None Liens: None L-2

NExScI Responsibilities (1/3) (PLRA 2014 Section 3.1.3) NExScI shall be responsible for 1.Developing common formats for data products and coordinating with UA to archive data products: a.Interface with UA to receive NASA LBTI data b.Archive the NASA LBTI data at NExScI c.Provide interface for science community access to the archived data d.Monitor data product quality assessments conducted by UA as a service to observers L-3 All part of the archive service: Developed FITS file formats and keywords for LBTI nulling data Automatic data transfers and ingestion Automatic implementation of periods of exclusive data use and public release Web interface to the archive as well as scripted data access HTML summary tables and browse plots

NExScI Responsibilities (2/3) (PLRA 2014 Section 3.1.3) NExScI shall be responsible for 2.Selecting HOSTS Science Team members: a.Prepare call for proposals b.Conduct peer review c.Select proposals d.Manage science deliverables L-4 Call for proposals issued in Feb 2012 and selections announced in June 2012 Followed standard peer-review and selection procedures LBTI Project PI (UA) and NASA Project Scientist at NExScI co-lead the HOSTS Science Team Defined a set of 6 deliverables for the Science Team Main ST activities to date: o Monthly telecons + focused telecons (e.g., on the analysis pipeline) o Participation in observing runs o Developed target list (Weinberger et al. ApJ, 2015) o Developed exozodi model (Kennedy et al. ApJ, 2015) o Developed quantitative mission success criteria (Mennesson) DeliverableDue DateComment Preliminary target list9/2014Published paper Weinberger et al., ApJ, 2015 Final target list3/2015Tied to start of operations Report on data calibration methods5/2016After 1 year of experience with the data Report on interpretation and implications for exo-Earth imaging 9/2015 9/2016 9/2017 Incremental releases Final report and plans for publications3/2018

NExScI Responsibilities (3/3) (PLRA 2014 Section 3.1.3) NExScI shall be responsible for 3.Providing oversight and guidance to the ExEPO to protect the LBTI’s science objectives and implement NASA HQ policies L-5 NExScI shall be responsible for 4.Providing management oversight of LBTI during the Operations Phase: a.Generate monthly report of science and operations status b.Provide point of contact to UA and ExEPO for resolution of issues and concerns The Project Scientist at NExScI provides these functions for ExEP and HQ NExScI is prepared to assume management oversight functions Plan is to transition at the end of the Science Validation Phase

Science Data Management (PLRA 2014 Section 3.4) Addresses archival obligations and data rights for Commissioning data HOSTS HOSTS/LEECH Non-NASA users L-6 Periods of exclusive data use are implemented in the archive, data goes public when they expire Note: HOSTS/LEECH periods of exclusive data use same as for HOSTS Consistent with these obligations, the current version of the archive supports LBTI nulling data Small additional archive development needed to support LEECH data planned for FY16 o If LMIRCam data are needed to mitigate PWV, this task may be de-scoped, or replaced with modifications needed to support the new ancillary data for nulling, if needed

Data Rights Implementation L-7 Project ID associated with each observation at the observatory via the Observe Web tool Project ID keyword in header of each Level-0 image; then propagated to L1/L2 files by the pipeline

Data Requirements (PLRA 2014 Section 4.2) Addresses data archiving and public distribution obligations described before, plus types of data and timeliness of transfers and archive ingestions: All scientific data generated by the NASA HOSTS survey shall be provided from the LBTI observatory to NExScI for archiving and distribution. An instrument data management plan shall be developed by NExScI and UA to address the total activity associated with the flow of NASA science data, from planning through acquisition, processing, data product generation, and validation, to archiving and preservation. NExScI shall develop common formats and coordinate archiving of data with UA. NExScI shall provide an interface to UA to receive NASA LBTI data. NExScI shall provide a link to the archived data for distribution to the various observers for calibration and analysis. Three types of data products shall be archived; the delivery timescales in each case are appropriate to the needs of the HOSTS survey: 1.Level 0: Merged raw images; delivered from the observatory to NExScI within 72 hrs of observation 2.Level 1: Internally calibrated science data, delivered from the observatory to NExScI within 20 work days of observation. Internally calibrated data consists of: cleaned Level 0 images (dark subtracted, bad pixels removed, flat fielded, background subtracted) and files containing derived quantities (null and stellar fluxes, associated errors, diagnostic quantities) 3.Level 2: Externally calibrated science data, delivered from the observatory to NExScI within 40 work days of observation. Externally calibrated data files contain fully calibrated nulls and associated errors (effects of instrument’s transfer function removed), and result from processing multiple Level 1 files obtained on the target star and its calibrator stars. L-8 Data Management Plan: delivered and in signature cycle (NExScI, UA, JPL, HQ) The data pipeline (UA) automatically takes Level 0 data and outputs the Level-1 and -2 products as described above Detailed data formats documented in ICD and documentation for archive users Demonstrated automatic data transfers and archive ingestion for the three levels of data, and under the required times, on several occasions during the commissioning phase

LBTI NExScI Archive Demo (1/4) L-9 Password-protected login for PIs Data search by criteria, or from lists of dates or objects Search L0, L1, or L2 data

LBTI NExScI Archive Demo (2/4) Level-0 Images L-10 Dynamic HTML tables Data download options

LBTI NExScI Archive Demo (3/4) L1 Nightly Summary, OB Summary, and Processed Image Cubes L-11

LBTI NExScI Archive Demo (4/4) Level-1 and -2 Browse Plots L-12

Holdings The archive currently contains all commissioning and science verification data taken in nulling mode All data (science and engineering) are available to instrument and Science Team members Some of the science verification data taken during commissioning (12-month period of exclusive data use) is of good quality and can be made public now L-13

Plan L-14 ORR Apr 28May 28 Archive public FY 15FY 16 Oct Archive ops (data ingestions) Development frozen Archive ops and maintenance (data ingestions) Resume development: –Bug fixes and user feedback –Expected evolution of data files during SVP –LEECH data FY 17 Oct Archive ops & maint (data ingestions) FY 18 Oct Extensions to other LBTI modes or LBT instruments pending GO decision

Summary L-15 PLRA IDDescriptionStatusComment Data formats, interface to UA, NExScI archive ✔ Archive will be made public following ORR board report Archive dev frozen after ORR until FY16 due to funding invested instead in additional resources towards instrument commissioning success Data still expected to evolve during SVP Level of funding supports only minor archive modifications post public release HOSTS Science Team selection and activities ✔ Project Scientist functions ✔ Management oversight at NExScI ✔ Deferred to end of SVP 3.4Data rights and data to be archived ✔ LEECH work deferred to FY16 Other modes pending GO program decision 4.2Types of data products and timeliness of transfers. Data Management Plan ✔