2. NASA's Earth Observing Data and Information System (EOSDIS)
Copernicus Big Data Workshop
13 March 2014
Brussels, Belgium
Kevin Murphy
EOSDIS System Architect
NASA Goddard Space Flight Center

3. EARTH SCIENCE DATA OPERATIONS
National Aeronautics and Space Administration
EARTH SCIENCE DATA OPERATIONS
MISSION OPERATIONS
DATA TRANSPORT TO
DATA CENTERS/SIPSs
SCIENCE OPERATIONS
DATA ACQUISITION
FLIGHT OPERATIONS, DATA CAPTURE,
INITIAL PROCESSING, BACKUP ARCHIVE
1 pt
0 pt
SCIENCE DATA PROCESSING,
DATA MANAGEMENT,
INTEROPERABLE DATA,
ARCHIVE, AND DISTRIBUTION
DISTRIBUTION AND
DATA ACCESS
Research
Tracking and Data
Relay Satellite (TDRS)
Education
EOS Data Operations
System (EDOS)
Data Processing
Value-Added
Providers
EOS Spacecraft
EOSDIS
Data Centers
Infrastructure
(Search, Order,
Distribution)
Interagency
Data Centers
White Sands
Complex (WSC)
Direct Broadcast (DB)
Earth
System Models
EOS Operations
Center (EOC)
Mission Control
International
Partners
EOS Polar
Ground Stations
Instrument Teams and Science Investigator-led
Processing Systems (SIPSs)
Decision Support
Systems
Direct Broadcast/
Direct Readout
Stations
NASA INTEGRATED SERVICES NETWORK
(NISN) MISSION SERVICES

4. EOSDIS as a Seamless, Efficient User Driven System
Present NASA’s EOSDIS as an interoperable system of systems where users can select, view, interact and download the data they need transparently from all subsystems in support of interdisciplinary Earth Science research.
Supplement current data system capabilities with new interoperable technologies to create a foundation for future evolution.
Support technology infusion of tools developed by internal programs and by industry
EOSDIS capabilities and feature development is prioritized through DAAC User Working Groups (science experts) and input from community data system programs
From global EOSDIS perspective to the need for GIBS.
Data
Metadata as a Service
Imagery as a Service
Data as a Service
Partnerships commercial clouds
Today
Tomorrow
Working Towards

5. Central Reusable Capabilities
Earthdata: the EOSDIS website (
Metadata Services
ECHO: Searchable catalog of granule metadata for NASA datasets (OpenSearch, CSW, OGC interfaces)
Global Change Master Directory (GCMD): Searchable catalog of over 26,000 NASA and International dataset collections
User Tools (e.g.)
Reverb – search and order tool
Global Imagery Browse Services (GIBS) – full resolution imagery derived from NASA products in a standardized manner to any web-connected client (Open Sourced)
Worldview - highly responsive interface to explore GIBS imagery and download the underlying data
Giovanni – Quick-Start Exploratory Data Analysis
Metrics System (EMS): collects and reports on data ingest, production, archive, and distribution across all EOSDIS data centers
User Registration System: provides a centralized and mechanism for user registration and account management for all EOSDIS system.

6. Examples of Relevant DAAC Capabilities
Sentinel 1 (ASF DAAC)
ASF DAAC offers a variety of SAR-derived higher level products via easy-to-use Web interfaces
MapReady Toolkit
Sentinel 2 (LPDAAC)
(?)
Sentinel 3 (ODPS, LAADS, LPDAAC, …)
SeaDAS - science processing from Level-1B through Level-3 with a host of NASA standard and alternative ocean product algorithms (including source code). Also data product analysis and visualization based on ESA's BEAM tool.
Match-up to field data - Level-1/Level-2 browser will identify all data granules for which coincident field data exists in the NASA SeaBASS in situ bio-optical archive, and provide the data as a unified order.
In situ SeaBASS archive for product validation and the NOMAD database for bio-optical algorithm development
Sentinel 5p
Giovanni
Subsetting and reformatting
SeaDAS - science processing from Level-1B through Level-3 with a host of NASA standard and alternative ocean product algorithms (including source code). Also data product analysis and visualization based on ESA's BEAM tool.  
NRT Image Support - if we did get NRT data, we provide regional data extraction and mapped image delivery services, primarily targeted support active field campaigns. 
Match-up to field data - Level-1/Level-2 browser will identify all data granules for which coincident field data exists in the NASA SeaBASS in situ bio-optical archive, and provide the data as a unified order.
Online Validation Tool - online, automated validation analysis for NASA-processed Level-2 products.
In general, S3 users will also have access to the in situ SeaBASS archive for product validation and the NOMAD database for bio-optical algorithm development:

7. NASA Sentinel Gateway Leveraging Existing EOSDIS Capabilities
For Sentinel 1, 2(?), 3, 5P, NASA will leverage proven gateway and redistribution capabilities, currently used for S-NPP
Single network interface relieves bandwidth load on European networks and
Long term archival and end user distribution by DAACs (e.g. Sentinal-1 by ASF DAAC).
Provides metric reports back to the EC/ESA on product distribution and usage
Leverages entire suite of NASA’s EOSDIS capabilities including capturing and reporting metrics on distribution and usage of Sentinel products by U.S. scientists

8. Copernicus Support Levels
Two support levels for mirroring Sentinel (A and B series) data have been investigated based on guidance.
Level 1 Support: Develop gateway and improve networks to support the transfer, ingest, archival and distribution
L? products for Sentinel 1
L1 products for Sentinel 2, 3 and S5P
Level 2+ Support: NASA processing centers (e.g. SIPS) create higher level products that are ingested, archived and distributed from designated DAACs.
Costs presented are in addition to Level 1 Support.
Assumption: Science Team involvement and funding to develop higher level products would be required, but are not included in MMOPS overguide submission

9. Gateway for S1, S2, S3, S5P @ GSFC
Level 1 Support
EOSDIS Systems
Metric Reports
EMS
URS
GIBS
CMR
ASF – S1
L0 and L1
Gateway for S1, S2, S3, GSFC
OBPG – S3
L0 and L1
LAADS – S3
Data DAACs
LPDAAC – S2
CDDIS – S3
Terms:
S1,2,3,5P - Sentinel 1, 2, 3, 5P
ASF – Alaska Satellite Facility
OBPG – Ocean Biological Processing Group
LAADS – Level 1 and Atmosphere Archive and Distribution System
LPDAAC – Land Processes DAAC
CDDIS – Crustal Dynamics Data and Information System
URS – EOSDIS User Registration System
GIBS – Global Imagery Browse Services
EMS – EOSDIS Metrics System
CMR – Common Metadata System
DHuS – Copernicus Data Hub System
US Gov.
- NOAA
- NRL
- Other

10. NASA Gateway for Copernicus Missions
ESDIS will develop a NASA Sentinel Data Gateway, which will:
Pull data from the Copernicus Data Hub server (Level 0 or Level 1 data)
Ingest the data, perform checksums to ensure data integrity, and create links in outbound directories for access by DAACs, SIPS, and other external users (e.g., NRL, NOAA)
Alert operator of missing or defective data
Present status via a web interface of ingested and missing data
Store the data temporarily (32 days)
Export information to the EOSDIS Metrics System to support data accountability activities
Enforce user registration using the User Registration System (URS)

11. Sentinel 1 A/B Instrument: C-band SAR (5.405 GHz)
Level-0 products are available to data users in Stripmap (SM), Interferometric Wide swath (IW) and Extra Wide swath (EW)
Wave (WV) product only available as L2 product (not included)
Applications: Monitoring sea ice, oil spills, marine winds & waves, land-use change, land deformation among others, and to respond to emergencies such as floods and earthquakes
DAAC: Alaska Satellite Facility
NASA Internal Use Only

12. Sentinel 2 A/B (?)
Instrument: MSI – Multi-Spectral Imager optical payload with visible, near infrared and shortwave infrared sensors
Assuming L1B products
Applications: land-cover maps, land-change detection maps and geophysical variables that use, for example, leaf area index, leaf chlorophyll content and leaf water content will be provided. Images of floods, volcanic eruptions and landslides
Assume no higher level products, so no Level 2+ support.
DAAC: Land Process DAAC
NASA Internal Use Only

13. Sentinel 3 A/B Instruments: OLCI (Ocean and Land Color Instrument)
SLSTR (Sea and Land Surface Temperature Radiometer)
SRAL (Synthetic Aperture Radar Altimeter)
MWR (Microwave Radiometer)
DORIS (Doppler Orbitography and Radiopositioning Integrated by Satellite)
LRR (Laser Retroreflector)
GNSS (Global Navigation Satellite System)
Assuming all L1B products (L1A preferred)
Applications: Monitoring sea ice, oil spills, marine winds & waves, land-use change, land deformation among others, and to respond to emergencies such as floods and earthquakes
DAACs L1 Support: OBPG, LAADS, PO.DAAC, and CDDIS
Assume no higher level products, so no Level 2+ support.
NASA Internal Use Only

14. Sentinel 5P
Instruments: TROPOMI (Tropospheric Ozone Monitoring Instrument) and UVNS (Ultraviolet Visible Near-infrared Shortwave)
Applications: Atmospheric composition studies, tropospheric monitoring and air quality, ozone monitoring and climate monitoring, through the study of atmospheric chemicals
DAAC Level 1 Support: GES DISC
Assume no higher level products, so no Level 2+ support.
NASA Internal Use Only