ESA UNCLASSIFIED – For Official Use ESA AVHRR Data Holdings and Ongoing Curation Activities Mirko Albani, Sergio Folco.

Slides:



Advertisements
Similar presentations
ESWW4, 5-9 th November 2007 Draft Proposal: Space Weather as part of an Optional Space Situational Awareness Programme A.Glover, E. Daly, R. Marsden, A.
Advertisements

1 The ESA SCIENTIFIC TESTBED in CASPAR S. ALBANI (ESA) CASPAR Workshop, Rome, september 2009.
Space/GMES and Climate Change Mikko Strahlendorff, GMES Bureau.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group Session LTDP Activities & DSIG Introduction WGISS-37 Meeting Cocoa Beach (Florida-US)
1 Phases & Impact on other Projects Definition and Scope –Relationship between Appraisal Policy/ Procedure, Technology and Management Overview, Components.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group WGISS-39 Meeting Persistent Identifier Piloting Session Tsukuba, Japan (JAXA) –
VENUS (Vegetation and Environment New µ-Spacecraft) A demonstration space mission dedicated to land surface environment (Vegetation and Environment New.
Data Stewardship Interest Group WGISS-39 Meeting
ESA Report to DAI/IPR WG Gian Maria Pinna ESA/ESRIN DAI/IPR meeting Colorado Springs January 2007.
APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department, European Space Agency) ESA Long Term Data Preservation.
1 Working Group on Archives and Records Management WGARM.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group WGISS-39 Meeting Data Purge Alert Procedure Tsukuba, Japan – May, 2015 Mirko.
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
The ‘INCA KIP’: Knowledge Innovation Project for an Integrated system for Natural Capital and ecosystem services Accounting UNCEEA June 2015 Anton.
CEOS Disaster Risk Management Implementation Phase Status Ivan Petiteville (ESA) on behalf of CEOS DRM Team CEOS SIT-28 Meeting Hampton, Virginia, USA.
UN/CS/RAI/USAA/DB01/ Development of a Strategic Plan for a Digital Archives Programme Common Services Working Group on Archives and Records.
Slide 1 WGISS CEOS WGISS 21, Budapest 8-12 May 2006 WGISS Contribution to GEO WGISS Contribution to GEO Ivan Petiteville.
Purpose and objectives: AVHRR LAC expert meeting Bojan R. Bojkov Head, Sensor Performance, Products and Algorithms Directorate for Earth Observation ESA/ESRIN.
AVHRR 1 km Data Set Consolidation Consolidating 30 years of EO data hosted by multiple data holders 28 th LTDP WG Meeting Frascati (ESA/ESRIN) 04–05 November.
ENV proposal meeting, Geneva, Sep. 24, Proposal Objectives Joost van Bemmelen, ESA
Introduction 1. Purpose of the Chapter 2. Institutional arrangements Country Practices 3. Legal framework Country Practices 4. Preliminary conclusions.
Draft GEO Framework, Chapter 6 “Architecture” Architecture Subgroup / Group on Earth Observations Presented by Ivan DeLoatch (US) Subgroup Co-Chair Earth.
GEO ADC meeting, Washington DC, USA, Sep Slide # 1 DA DA Virtual Constellations Ivan Petiteville, CEOS GEO ADC Meeting, Washington DC,
EUROPEAN COMMISSION Washington June 2004 Space exploration in the context of the European Space Policy Jack Metthey Director for Space and Transports.
WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.
ATT Contribution to GEO Archive Task Team WGISS – 22 Sep 11 – 15, 2006 Annapolis, USA.
Committee on Earth Observation Satellites CNES Plenary Agenda Item #21 29 th CEOS Plenary Kyoto International Conference Center Kyoto, Japan 5 – 6 November.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group WGISS-40 Meeting Preservation of SW & Documents at CEOS Agencies Approaches and Lessons.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
EDLproject WP3 “Developing the European Digital Library” LIBER – EBLIDA workshop Digitisation of Library Material in Europe Copenhagen, October.
M. Lautenschlager (M&D/MPIM)1 WDC on Climate as Part of the CERA 1 Database System Michael Lautenschlager Modelle und Daten Max-Planck-Institut.
GEO Work Programme 2016 WGISS#40 HARWELL (UKSA) 28 SEP - 02 OCT 2015 MIRKO ALBANI, ESA.
Cloud-based e-science drivers for ESAs Sentinel Collaborative Ground Segment Kostas Koumandaros Greek Research & Technology Network Open Science retreat.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group ESA – EO Data Stewardship Maturity Matrix WGISS#41 Meeting, Canberra, (AUS) 14–18 March,
Fulvio Marelli - ESA and future An example of data lifecycle: sensed data need to be acquired…
1. 2 NOAA’s Mission To describe and predict changes in the Earth’s environment. To conserve and manage the Nation’s coastal and marine resources to ensure.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group EO Data Associated Knowledge Preservation WGISS-41 Meeting - Canberra, (AUS) 14–18.
Exploitation of ISS Scientific data EGI-Aparsen Workshop March Science Park– Amsterdam – The Netherlands Cooperative ISS Research data Conservation.
IPDA Architecture Project International Planetary Data Alliance IPDA Architecture Project Report.
QA4EO in 10 Minutes! A presentation to the 10 th GHRSST Science Team Meeting.
European network for Health Technology Assessment | JA | EUnetHTA European network for Health Technology Assessment THL Info.
Towards a European Shared Environmental Information System in Support of Environmental Policies: INSPIRE: an Inspired revolution for a knowledge-based.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
Development Account: 6th Tranche Strengthening the capacity of National Statistical Offices (NSOs) in the Caribbean Small Island Developing States to fulfill.
ESA UNCLASSIFIED – For Official Use Scientific exploitation…. Ws input to the round table DD/MM/YYYY.
Status of Sentinel-3 activities at EUMETSAT SIT-31 Agenda Item # 13 ESA/ESRIN, Frascati, Italy 19 th -20 th April 2016 Committee on Earth Observation Satellites.
Agency ESA, version 1, Date 6 June 2016 Coordination Group for Meteorological Satellites - CGMS Joint CEOS/CGMS Working Group on Climate 4-year Work Plan.
Data Stewardship Interest Group WGISS-43 Meeting
NASA Earth Science Data Stewardship
“PRESERVATION DOMAIN” Data Stewardship Interest Group
Data Stewardship Interest Group WGISS-43 Meeting
10 year investment plan ERGEG approach and contribution
Data Stewardship Interest Group WGISS-42 Meeting
Data Stewardship Interest Group WGISS-42 Meeting
Europe’s Environment Assessment of Assessments EE-AoA 2011
WGISS Connected Data Assets
WGISS Report Andrew Mitchell - NASA CEOS Plenary 2016
Technology for Long-Term Digital Preservation
Summit 2017 Breakout Group 2: Data Management (DM)
Data Stewardship Interest Group WGISS-44 Meeting
Exploitation of ISS Scientific data - sustainability
INPE, São José dos Campos (SP), Brazil
WGISS-WGCV Joint Session
Data Stewardship Interest Group WGISS-45 Meeting
CEOS Background & Mission
Data Stewardship Interest Group WGISS-45 Meeting
Data Consolidation group conclusions
The ESA Earth Observation Long Term Data Preservation (LTDP) Programme
EOSC-hub Contribution to the EOSC WGs
WISE and INSPIRE By Albrecht Wirthmann, GISCO, Eurostat
Presentation transcript:

ESA UNCLASSIFIED – For Official Use ESA AVHRR Data Holdings and Ongoing Curation Activities Mirko Albani, Sergio Folco

ESA UNCLASSIFIED – For Official Use Long Term Data Preservation (LTDP) Main Drivers at ESA Data and Knowledge Preservation Preserve any mission acquired data & associated knowledge as humankind asset safeguarding MSs investment & effort in space R&D & operational data acquisition. With the assumption/awareness that one can never anticipate the exploitation value of the data asset in the future. Preservation to be addressed in all EO mission phases; incremental approach for past/current missions, systematic planning/approach for future ones. Data Valorization Make sure full content of the ESA archives is fit for contemporary purpose and maintained accessible and usable in the long term. Valorize the data assets for current/future exploitation through building long time series of coherent data and data collections for specific applications; pursue multi-disciplinary data use and “cross-fertilization”.

ESA UNCLASSIFIED – For Official Use ESA LTDP Programme Activities (EO Part) LTDP Programme: approved at ESA Ministerial Council in Nov 2012; joint programme with other ESA directorates. 1.EO Historical Missions Datasets Consolidation, Access, Preservation & Curation: consolidation and archiving of ESA EO Historical Missions data & associated knowledge, data discovery & access, reprocessing & alignment to current missions when feasible. 2.LTDP Specific Developments and Evolutions: specific evolution and development activities necessary to meet programme objectives. 3.LTDP Coordination and International Cooperation: implement basic activities to sustain the European LTDP cooperative framework for national and international missions.

ESA UNCLASSIFIED – For Official Use ESA EO Long Time Data Series Holdings (excerpt) Missions in red are covered within the LTDP Programme

ESA UNCLASSIFIED – For Official Use European LTDP Framework EC Projects ESA membership Standards WGISS DSIG Task IN-02 LTDP Activities International Context (since 2008)

ESA UNCLASSIFIED – For Official Use ESA AVHRR Data Holdings ESA has been acquiring & archiving data from NOAA POES satellites since 1981 at Maspalomas, Matera and Tromsoe stations. 6 organizations (NOAA, ESA, USGS, NASA, CSIRO, SMC) coordinated HRPT receiving stations to acquire and compile the 1Km data set during the “1Km” project started in Apr 1992 and ended in Sep 1996 (23 stations worldwide) ESA Coordinated Stations

ESA UNCLASSIFIED – For Official Use ESA AVHRR Data Holdings Status and activities Status Volume: ~23 TB (NOAA 7-19) mixture of Level 0, Level 1A and Level 1B Preserved in the past on a best effort basis Archived at ESA facilities: part ingested in robotic tape libraries, part on heritage media Not accessible to users at this time via ESA dissemination systems On-going Activities as part of the ESA LTDP Programme: Consolidation of ESA AVHRR Data Assets (including associated knowledge) AVHRR Pilot Curation Project under the auspices of the GSCB aimed at: o Compiling an overall inventory of AVHRR data over Europe o Defining a common approach among European data holders as a first step towards the generation of a “Coherent European AVHRR Dataset”: AVHRR Dataset Curation Feasibility Study (DLR & UniBERN)

ESA UNCLASSIFIED – For Official Use ESA AVHRR Data set consolidation USGS Tromsoe Maspalomas ESA Stations Matera Local Archive ESRIN Data Repatriation all NOAA 1km / 8mm 1981 to present Ongoing Activities 1992 to 1996 Niamey Nairobi La Reunion Manila Scanzano Terranova Bay Cairo Kuala Lumpur Oberpfaffenhofen Detailed inventories under consolidation Level 0 dataset consolidation procedure defined with experts Transcription, extraction and repatriation activities ongoing

ESA UNCLASSIFIED – For Official Use 1.Compile the overall AVHRR data inventory for the data available at ESA and acquired in the frame of national European projects with complete spatial and temporal coverage information identifying gaps and missing data. 2.Assess L0 and higher-level products common data and metadata formats, content and structure. 3.Assess the available pre-processing calibration files, geometric correction, atmospheric correction, taking also into account all the processing chains available. 4.Gather user requirements for L1a, L1b and L2 thematic products, and for the discoverability and accessibility of AVHRR long time data series. 5.Review and consolidate the preliminary reprocessing baseline with AVHRR international experts. 6.Assess the feasibility and cost-benefit of the harmonization of a European coverage AVHRR coherent dataset. MORE DETAILED PRESENTATION TOMORROW AVHRR Pilot Curation Project Activities

ESA UNCLASSIFIED – For Official Use Main challenges Availability (and related conditions) of AVHRR data from European organizations to contribute to the joint and cooperative effort of building up a “Coherent European AVHRR Dataset” o Data Access Policy, Physical Storage Location, IPRs Agreement on baseline approach for the “Coherent European AVHRR Dataset” generation Management of “Coherent European AVHRR Dataset and associated knowledge”: o Common and agreed principles and guidelines o Possibility to have single entry points for users to discover and access the Coherent Dataset (on-line) – Federated discovery and access

ESA UNCLASSIFIED – For Official Use Next Steps Completion of ESA AVHRR data holdings consolidation according to tailored procedure reviewed by expert users Completion of European coverage analysis considering data from all organizations and definition of technical approach and principles for joint contribution to the “Coherent European AVHRR Dataset” KO of dedicated project on “European AVHRR Dataset” o LAC FDR generation according to Curation Feasibility Study and today’s meeting results: scope and activities TBD o Joint publication, dissemination, archiving and management Use project lessons learned and experience as input for the preparation of future ESA EO Programmes