PLATO Data Center: Purpose and Structure Laurent Gizon (PDPM) Hamed Moradi (PDC Project Office)

Slides:



Advertisements
Similar presentations
A Search for Earth-size Planets Borucki – Page 1 KEPLER; Data Validation and Follow Up Observations CoRoT Symposium W.J. Borucki & the Kepler Team 5 February.
Advertisements

GENIUS kick-off - November 2013 GENIUS kick-off meeting The Gaia context: DPAC & CU9 X. Luri.
Stellar analysis system (SAS*) WP370 T. Appourchaux Institut d’Astrophysique Spatiale, Orsay *SAS= Special Air Service or Son Altesse Sérénissime.
HAWCPol / SuperHAWC Software & Operations J. Dotson July 28, 2007.
RVS First Look ( WP6200) J.-M. Désert, G. Hébrard, A. Lecavelier, R. Ferlet, A. Vidal-Madjar Institut d’astrophysique de Paris (IAP) Workshop RVS Calibration.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
NGAO Status R. Dekany January 31, Next Generation AO at Keck Nearing completion of 18 months System Design phase –Science requirements and initial.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.
30 March 2006Birmingham workshop1 The Gaia Mission A stereoscopic census of our Galaxy.
PLAnetary Transits and Oscillations of stars Thierry Appourchaux for the PLATO Consortium
For the asteroseismology channel The database contains all the stars brighter than m V = 9.5 (~ objects) with extensive data from: The CDS/Simbad.
PLAnetary Transits and Oscillations of stars PLATO Consortium kick-off meeting.
ELISA Data Processing Centre Volker Beckmann APC, Francois Arago Centre A. Petiteau, E. Porter, G. Auger, E. Plagnol, P. Binétruy.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
The Blind Test in colors C. Moutou, R. Cautain, D. Blouin, A. Lanza, S. Aigrain, H. Deeg, …
Data processing group. General study of data processing architecture: - overall definition of the data processing functions - share of tasks between on-board.
LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
SGS: Activities and Requests Helen Middleton. Hermean Environment Working Group Meeting | SGS Team | Key Largo | 16/05/2013 | Slide 2 Contents 1.ESAC.
Transiting Exoplanet Survey Satellite Daryl Swade Archive Peer Review June 18, 2014.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
1 Workshop First look, calibrations, reference sources IAP – 24 November CU6 structure 2.Aims of the workshop / open questions.
IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”
PLATO Main Electronics Units (MEU) based on inputs from P. Plasson and the system team J. Miguel Mas-Hesse Centro de Astrobiología (CSIC-INTA)
All rights reserved © Altec ExoMars 2018 Rover Operations Control Centre Planned Organization of ROCC Operations I. Musso.
AST 443/PHY 517 : Observational Techniques November 6, 2007 ASTROMETRY By: Jackie Faherty.
CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
MAST Users Group – July 2009 MAST will provide the archive user interface for Kepler data, primarily light curves and target pixel data. ASB Staffing for.
Diversity of Data in the Search for Exoplanets Rachel Akeson NASA Exoplanet Science Institute California Institute of Technology.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Observation of the photocentre position variations with CoRoT - Scientific motivations and expected performance C. Moutou (LAM) – H. Deeg (IAC) – M. Ollivier.
Plato meeting MSSL Wed+Thur 15+16/Oct/08 UK interests/activities Alan Smith and Dave Walton UCL/MSSL.
 PLATO PLAnetary Transits & Oscillations of stars Data onboard treatment PPLC study February 2009 on behalf of Reza Samadi for the PLATO data treatment.
RVS Calibration Workshop, Paris RVS RVS Calibration RVS Calibration & First Look Workshop, Paris Mark Cropper.
The CoRoT ground-based complementary archive The CoRoT ground-based complementary archive Monica Rainer, Ennio Poretti M. Rosa Panzera, Angelo Mistò INAF.
Travis Metcalfe (NCAR) Asteroseismology with the Kepler Mission We are the stars which sing, We sing with our light; We are the birds of fire, We fly over.
A STEP Expected Yield of Planets … Survey strategy The CoRoTlux Code Understanding transit survey results Fressin, Guillot, Morello, Pont.
LSST Scheduler construction plan Francisco Delgado Sr. Software Engineer Telescope & Site.
Exoplanet Science Don Pollacco QUB. Overview PLATO’s objectives and space Work packages in the definition phase Timescales and aims of the definition.
Swift HUG April Swift data archive Lorella Angelini HEASARC.
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.
Early science on exoplanets with Gaia A. Mora 1, L.M. Sarro 2, S. Els 3, R. Kohley 1 1 ESA-ESAC Gaia SOC. Madrid. Spain 2 UNED. Artificial Intelligence.
PSF in-flight calibration - PN IFC/CNRRingberg, April 2-4, 2002 PSF in-flight calibration for PN camera Simona Ghizzardi Silvano Molendi.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
Proposal: staged delivery of Scheduler and OpSim V1 (2016) meet most of the SRD requirements – Deliver a system that can be extended with an improved scheduler.
Chair : M. Deleuil. 3.5º Main target m v  6 Secondary targets m v < 9 Exoplanet field 2.8º N Focal plane:
1 Transiting Exoplanet Survey Satellite Daryl Swade Archive Team Meeting June 16, 2014.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
Corot:Ubatuba Nov The Ground Segment: Data Processing. Software development in laboratories. Brazilian contribution. Michel Auvergne Réza Samadi.
GENIUS Kick-Off meeting December 4th 2013 WP-620 Simulated catalogue data Francesc Julbe UB – IEEC, Barcelona.
E. Solano. GAIA Meeting, Menorca, Oct 2009 GAIA and the Virtual Observatory Enrique Solano, LAEX/CAB (INTA-CSIC) Spanish VO Principal Investigator.
Creation of the Archiving Component of a Memorandum of Understanding (MOU) Template for International Missions IPDA MOU project members.
Euclid Big Data Opportunities Tom Kitching (UCL MSSL) – Euclid Science Lead.
Calibration meeting summary
I&T&C Organization Chart
JWST Pipeline Overview
SGS for OUSIM Meeting goals:
3677 Life in the Universe: Extra-solar planets
Ground Segment for WSO/UV
N0--> N1 Chain Includes corrections of all the known instrumental perturbators - electronics: offset, EMI, gain - Time integration - Sky background -
Launch and On-orbit Checkout
04/02/2019 The Use of Grid Technology in Large Scale Data Processing Collaboration Environments S.G. Ansari S.G. Ansari 04/02/2019.
PSS verification and validation
Integration & Test Instrument Operations Coordination
GLAST Large Area Telescope Instrument Science Operations Center
CHEOPS - CHaracterizing ExOPlanet Satellite
Presentation transcript:

PLATO Data Center: Purpose and Structure Laurent Gizon (PDPM) Hamed Moradi (PDC Project Office)

The PDC is in charge of the validation, calibration, and analysis of the PLATO observations. It delivers the final PLATO science Data Products.

SGS Structure Mission Operations Center (MOC, flight-critical)Mission Operations Center (MOC, flight-critical) Science Operations Center (SOC, mission-critical)Science Operations Center (SOC, mission-critical) PLATO Data Center (PDC, science-critical)PLATO Data Center (PDC, science-critical) Science Preparatory Activities (scientific specification of software)Science Preparatory Activities (scientific specification of software)

PLATO Ground Segment Operations Ground Segment Mission Operations Centre Ground Station Network Science Ground Segment Science Operations Centre SOC PLATO Data Center PDC PLATO Science Preparation Management PSPM

The definition phase objectives of the SGS are to establish the technical (PDC) and scientific (PSPM) requirements baseline for the SGS and to develop the operations concept, architecture and interfaces. The definition phase activities of the PDC and PSPM are organized according to the following guidelines: –PSPM provides the scientific specifications of the software –PDC translates the scientific specifications into technical specifications –PDC implements the technical specifications –PSPM checks that the PDC software is consistent with the initial scientific specifications. This validation by PSPM occurs within the PDC – a normal part of the development QA process.

Data Levels Telemetry: Baseline: 109 Gb/day uncompressed (8.7 Mb/s compressed, during 3.5 hr each day). Level 0: Depacketized light curves, centroid curves, and selected imagettes (~1600), for each telescope (32+2) Level 1: Analysis of imagettes to validate and optimize performance of on-board treatment. Implementation of on- ground instrumental corrections, such as CCD corrections and jitter corrections. Then computation of average light curves and centroid curves for each star (science-ready). Level 2: PLATO science Data Products (next table). Final DP is a list of confirmed planetary systems, fully characterized by the transit curves, the stellar seismic parameters, and the follow-up observations. High scientific added value.

PLATO Data Products

Ancillary Observations Essential information for the success of the mission: input catalog, follow-up observations, etc. Support for on-board processing, on-ground calibration, and scientific data analysis Stellar properties: effective temperature, absolute luminosity, radius [Gaia], chemical abundances, v sin i, activity, properties specific to multiple stars. Follow-up observations to confirm planets (at several wavelengths when possible) Other relevant complementary observations: hires spectra, astrometry, imaging, spectro-polarimetry, etc.. The ancillary data are in support of the processing activities and are accessed by the PDC via the main data base.

Ancillary observations: star catalogs stellar parameters follow-up observations spectroscopy radial velocities interferometry astrometry (Gaia) DP0 DP1 DP5 DP4DP3 DP2 DP6 Exoplanet Analysis System

Main Data Base centralizes DPs and ancillary data MPS) PDC develops and implements code at ESA SOC to produce DP1 Data Processing Centers (PDPCs) manufacture DP2-DP6 Distribution of DPs and long term archive under SOC responsibility PDC Architecture

PLATO Instrument Manager MOC SOC PDC L. Gizon, MPS Stellar Analysis System T. Appourchaux, IAS data treatment Algorithms R. Samadi, LESIA main database & system architecture R. Burston, MPS Exoplanet Analysis System N. Walton, IoA science activities data treatment implementation I. Pardowitz, MPS PLC Science Team+PDPM ancillary database R. Burston, MPS data access coordination SOC includes a processing center for the validation and calibration of the data ESA overall coordination (oversight) of science data releases, data access and distribution PDC designs and implements software to be run at the SOC

PDC WBS 1 Central Data Base 5 Data Processing Centers

WP32 Data Processing Algorithms (Talk by Samadi) WP35 Ancillary Data Management (Talk by Deleuil) WP36 Exoplanet Analysis System (Talk by Walton) WP37 Stellar Analysis System (Talk by Appourchaux)

WP31 System architecture and main database (Burston) System architecture, archives, data base, system managementSystem architecture, archives, data base, system management Data flow design and management, export system, networkData flow design and management, export system, network Simulation of data streamSimulation of data stream

WP33 Data Processing Development (Pardowitz) Write and implement core-processing software that will run at the SOC Requires a good understanding of system interfaces with SOC and operational procedures For phase A, study jitter correction to prove feasibility

WP34 Input Catalog (Giommi) Implementation of the PLATO input catalogue, under Italian responsibility. This activity is related to the target and field characterization activity in the PSPM segment of the PMC. WP34 delivers the validated PIC to the PDC-DB

WP38 Data Analysis Support Tools (Gizon) PDC documentation management Tools to support the analysis of individual light curves and to provide feedback to L2 processing pipelines (exoplanet and stellar). PDPC-M is the place were consortium scientists inspect light curves, assess DP validity and update ranking of planet candidates Search tools and VO activities Internal PDC web site In particular, PDC web site makes FU info accessible to FU observers

Time table Regular meetings with ESA to specify interfaces PDC-SOCRegular meetings with ESA to specify interfaces PDC-SOC End Feb 2011  5 th PDC Meeting in K-Lindau. Identify final problems. Invite PSPM Leaders.End Feb 2011  5 th PDC Meeting in K-Lindau. Identify final problems. Invite PSPM Leaders. WP Leaders deliver reports to LG by March 2011WP Leaders deliver reports to LG by March 2011 PDC document delivered to PCL in May 2011PDC document delivered to PCL in May 2011 June 2011: Decision on PLATO selectionJune 2011: Decision on PLATO selection End June 2011, Phase B1 meeting.End June 2011, Phase B1 meeting. December 2011: End phase B1December 2011: End phase B1 November 2018: Launch of PLATONovember 2018: Launch of PLATO years in space3+2+1 years in space Several releases of DPs during and after space missionSeveral releases of DPs during and after space mission PDC must remain operational up to ~3 yrs after the end of the space mission in order to confirm last planets.PDC must remain operational up to ~3 yrs after the end of the space mission in order to confirm last planets.

Cost

Thank you

Data validation –Validate onboard software: Check onboard processing using ground copy of onboard software and the imagettes of ~1600 starsCheck onboard processing using ground copy of onboard software and the imagettes of ~1600 stars Validate distortion matrix model, 2D sky background model, PSF model fitsValidate distortion matrix model, 2D sky background model, PSF model fits Validate computation of masks and windowsValidate computation of masks and windows –Validate onboard setup: Fine tuning of onboard software algorithm. For example choose number of parameters needed to describe PSF. Especially during configuration mode.Fine tuning of onboard software algorithm. For example choose number of parameters needed to describe PSF. Especially during configuration mode. –Monitor health of each telescope and assess quality of the data

Data corrections –Correction for jitter. Performed independently for each telescope; requires PSF knowledge, stellar catalog, and distortion matrix. –Integration time correction, sampling time correction –Statistical analysis over the 40 telescopes to identify cosmic ray hits, hot pixels, and possibly deficient telescopes –Average light curves and centroid curves over all telescopes (weighted average). –Compute error based on scatter –The ~1600 stars for which imagettes are available receive a more sophisticated treatment. PSF fits to improve photometry (contamination from neighboring sources taken into acount).  Imagettes are downloaded for all stars for which a serious planetary candidate has been identified. –Long term detrending probably moved to PDC

Data volumes Telemetry rate: 109 Gb/day uncompressedTelemetry rate: 109 Gb/day uncompressed Over a 6 yr mission: 30 TB uncompressedOver a 6 yr mission: 30 TB uncompressed The volume of archived L0, L1 and HK data is expected to be times this amount (reformatting and calibration history), i.e TBThe volume of archived L0, L1 and HK data is expected to be times this amount (reformatting and calibration history), i.e TB The volume of the science data products is likely to be negligible in comparison (although the complexity of the data may be high).The volume of the science data products is likely to be negligible in comparison (although the complexity of the data may be high). Ancillary data base: basic stellar observations and parameters, spectra, Gaia specific obs, etc. How big?Ancillary data base: basic stellar observations and parameters, spectra, Gaia specific obs, etc. How big?  The overall data volume should not exceed a few PB, which is not problematic.