COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – ESIP Winter 2014 1 2014 ESIP Winter Meeting | Washington DCJanuary 10 2014 Dan Pilone

Slides:



Advertisements
Similar presentations
ECHO Browse Reclassification Document ID: ECHO_Ops_Con_023 Version: 2.
Advertisements

What is ECHO? HTTP-based Search and Ordering Using ECHOs REST and OpenSearch APIs How Can.
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
EOSDIS Common Metadata Repository (CMR) Unified Metadata Model for Collections (UMM-C) Meeting June 12, 2014.
NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.
University of Rochester / River Campus Libraries eXtensible Catalog (XC) Project Funding Agency: Andrew W. Mellon Foundation Principal Investigators: Ron.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.
Ensuring Credibility of NASA’s Earth Science Data Session Title: IN11D. Data Curation, Credibility, Preservation Implementation, and Data Rescue to Enable.
ECHO Open Search ECHO Technical Interchange 05/01/13 9:00am EST Doug Newman.
Digital Object Identifiers for EOSDIS data ESIP Winter Meeting Jan 6, 2011 John Moses, ESDIS
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
Status of the Antarctic Master Directory SCADM Meeting, August 22, 2014.
GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.
1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.
Global Imagery Browse Services Overview AMSR Science Team Meeting Matt Cechini, GIBS Lead Helen Conover, AMSR-E SIPS.
1 Maintaining the momentum of OpenSearch in Earth Science data discovery Doug Newman (NASA ECHO) & Dr Chris Lynnes (GES DISC) 12/11/13 10:50am PT IN32A-03.
1 EOS Clearinghouse Robin Pfister, NASA/GSFC CEOS WGISS May 10-14, 2004.
PDS 2010 Project Update Dan Crichton MC Face-to-Face Washington DC March 25-26, 2010.
Architecture Renovation Yoshiyuki Kudo (JAXA) WGISS-37.
1 1 ECHO Extended Services WGISS – 23 Hanoi, Vietnam May 15, 2007.
EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC
Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.
NASA’s EOSDIS Clearinghouse - ECHO - WGISS – 24. Status ECHO 9 is operational ECHO 10 Focused on a re-architecture of Ingest services.
What is CWIC? Authors: Doug Newman Andrew Mitchell
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
Retrieving and Transforming ISO Metadata ESIP Summer 2014.
NASA Perspectives on Data Quality July Overall Goal To answer the common user question, “Which product is better for me?”
Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.
ESDIS METADATA ARCHITECTURE STUDY DISCUSSION Presented by Kevin Murphy and the Metadata Architecture Study Team Members 2013 ESIP Summer Meeting | Chapel.
EOSDIS User Registration System (URS) 1 GES DISC User Working Group May 10, 2011 GSFC, NASA.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
2 Introduction LANCE UWG 10/20/15 Karen Michael EOSDIS System Manager/LANCE Manager
ASDC Ingest Automation Efforts through Collaboratory for quAlity Metadata Preservation (CAMP) Presented by: Aubrey Beach (Booz Allen Hamilton, NASA ASDC)
CWIC Developers Meeting January 28 th 2014 Calin Duma CSW and OpenSearch from the CWIC Start client perspective.
Evolving a Legacy System Evolution of the Earth Observing Data and Information System M. Esfandiari 1, H. Ramapriyan 1, J. Behnke 1, E. Sofinowski 2 1.
ECHO AND ISO ESO SIG June 18, 2013 Raytheon EED Program | ESO SIG: ECHO and ISO.
LPDAAC/USGS_EROS CMR Metadata Reconciliation Meeting March 4-5, 2015.
NSIDC CMR Metadata Reconciliation Meeting December 10-11, 2014.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
Science Review Panel Meeting Biosphere 2, Tucson, AZ - January 4-5, 2011 Vegetation Phenology and Vegetation Index Products from Multiple Long Term Satellite.
GEOSS Common Infrastructure Initial Operating Capability Directions and Discussion Presented to GEO ADC Geneva May
What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.
1 ECHO ECHO 9.0 for Data Partners Rob Baker January 23, 2007.
ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.
Location Guide & Text Me a Call Number integration to Primo Presented By Dhanushka Samarakoon Marjorie Devlin.
1 Raytheon EED Program | ECHO Technical Interchange 2013.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
ECHO AND ISO ECHO Technical Interchange Meeting April 30 & May 1, 2013 Raytheon EED Program | ECHO Technical Interchange 2013.
DM_PPT_NP_v01 Configuration Management of UMM Models January 2016.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert.
Location Keyword Analysis and Approach to Fixing Records: A Case Study GCMD Science Coordinators CGSync Technical Tag Up Meeting
Rule-Based Approach for Earth Science Metadata Quality Assurance (QA) Tyler Stevens and Ellen Neff NASA’s Global Change Master Directory (GCMD) WYLE Information.
1 Retirement of Legacy Features Why? –Improved usability and performance for Access Controls, Order Option Definitions, etc. through MMT GUI instead of.
DAAC Roles with Common Metadata Repository (CMR) ESDIS System Engineering Technical Interchange November 2014 Copyright © 2014 Raytheon Company. All Rights.
ESDIS Standards Office Yonsook Enloe, CTSI 3/2/ FGDC Meeting1.
AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.
ESDRs Distribution and User Support – Miscellaneous Topics
EOS ClearingHOuse Robin Pfister Code 423, NASA/GSFC
CAP-378 and “Conhecer para não ignorar”
NSIDC DAAC Accessioning and “De-commissioning” Plans
NASA Langley Research Center, Hampton VA
Copyright 2012 Lola Olsen & Tyler Stevens.
Metadata Management Tool
WGISS-45 International Directory Network (IDN) Report
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
ESIP Winter Meeting 2016 January 2016
Presentation transcript:

COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – ESIP Winter ESIP Winter Meeting | Washington DCJanuary Dan Pilone

In a world where metadata matters… ESIP Winter Meeting | Washington DCJanuary

URS GIBS EMS EOSDIS Discovery Tools DAACs Near Real Time (LANCE) ??? CMR ESIP Winter Meeting | Washington DCJanuary

Seriously? Another catalog? ESIP Winter Meeting | Washington DCJanuary

No ESIP Winter Meeting | Washington DCJanuary

ESIP Winter Meeting | Washington DCJanuary

So why are we doing this? ESIP Winter Meeting | Washington DCJanuary

Emphasis on Metadata Quality 2014 ESIP Winter Meeting | Washington DC 8 January

ESIP Winter Meeting | Washington DCJanuary

Reconciliation Progress and Plans Science Coordinators will assess differences between associated records and work from easiest to hardest with providers Initial pass will associate ECHO 10 Collections with GCMD DIFs Assessment and correlation between ECHO and GCMD holdings has started GCMD is programmatically monitoring ECHO for new Collections and Updates DIF support added to ECHO ESIP Winter Meeting | Washington DCJanuary

Handling Metadata Changes Science Coordinator will work with Data Providers to make changes at Metadata source CMR will support pluggable Ingest Adapters to allow in- line updates to ingested metadata if needed Science Coordinator can make updates to metadata on behalf of providers when approved by owner 11 January ESIP Winter Meeting | Washington DC

Initial Metadata Targets LANCE (NRT) MEaSUREsMODAPS ESIP Winter Meeting | Washington DCJanuary

Emphasis on Performance ESIP Winter Meeting | Washington DCJanuary

Current Holdings Collections: ~4k + ~24k Granules: ~140M Growth: Current 500k+ granules/week Future ~1 million granules/day during MODIS Collection 6 Reprocessing As of 12/18/ ESIP Winter Meeting | Washington DC 14 January

Client breakdown for a week in Oct ESIP Winter Meeting | Washington DCJanuary

16 January ESIP Winter Meeting | Washington DC

CMR Transition ECHO components progressively replaced with CMR components Early work to focus on search performance Updated requirements effort starting soon Initial requirements based on MASI and MASII studies CMR will build on ECHO and GCMD capabilities January ESIP Winter Meeting | Washington DC 17

Metadata Concept Support ESIP Winter Meeting | Washington DCJanuary

19 Extensibility 2014 ESIP Winter Meeting | Washington DCJanuary

ECHO 10GCMD DIFEMS ISO19115 UMM Ingest Adapter VisualizationDocumentationServicesParameters ESIP Winter Meeting | Washington DCJanuary

How Will This Affect Me? ESIP Winter Meeting | Washington DCJanuary

Metadata Providers You won’t have to reconcile multiple systems Most systems will continue to work ECHO FTP ingest going away Current formats will continue to function You will need to be engaged in the adaptation process You will need to support controlled vocabularies You will have a voice through the Technical Committee 22 Streamlined Processes, More Engagement 2014 ESIP Winter Meeting | Washington DCJanuary

Client Developers 23 More Metadata, Better Quality Richer, higher quality metadata will be available Existing APIs will be supported Standards-compliant APIs will be available Metadata will be available in an ISO19115 compliant format 2014 ESIP Winter Meeting | Washington DCJanuary

End Users 24 More Metadata, Better Quality Richer, higher quality metadata will be available Unified view of EOSDIS holdings Easier access through a variety of clients, data casting, etc Metadata will be available in an ISO19115 compliant format 2014 ESIP Winter Meeting | Washington DCJanuary

Questions? ESIP Winter Meeting | Washington DCJanuary