LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert LP DAAC Mission Manager (605)

Agenda NASA ESDIS and LP DAAC Ingest and Archive Processing Capability Access Methods 2

NASA LP DAAC at USGS EROS Part of a large distributed network of EOSDIS Data Centers Ingest, archive, process, and distribute ASTER and MODIS data – International relationship with Japan (METI) to support ASTER Data – Distribute large volume of data to research community Co-located at EROS to support the land remote sensing community – Data destined to transition to USGS Long Term Archive – Technical and scientific collaboration Operated under a NASA / DOI interagency agreement Support a broad user base – Casual User, Research Users, Applications Users (> 26,000 in FY11) – Interest in cross-dataset access (ASTER, MODIS, Landsat, etc) – Over 300 products in 2.1 PB archive (all on-line) 3 NASA Land Processes Distributed Active Archive (LP DAAC) 3

What is ESDIS?

6

Central Reusability Capabilities Earthdata: The EOSDIS Website ( Metadata Services – ECHO: Searchable catalog of granule metadata for NASA datasets (OpenSearch, CSW, OGC interfaces) – Global Change Master Directory (GCMD): Searchable Catalog of over 26,000 NASA and international dataset collections – Common Metadata Repository (CMR): replacement of ECHO with adds granule, service, and bundle metadata User Tools (e.g.) – Reverb - Search and Order – Global Imagery Browse Services (GIBS) - Full resolution imagery derived from NASA products in a standardized manner to any web-connected client (open sourced) – Worldview - Highly responsive interface to explore GIBS imagery and download the underlying data – Giovanni - quick-Start Exploratory Data Analysis – Earthdata Search (beta) - future replacement of Reverb. Metrics System (EMS): Collects and reports on data ingest, production, archive, and distribution across all EOSDIS data centers. User Registration System (aka Earthdata login): provides a centralized and mechanism for user registration and account management for all EOSDIS system. 7

Archive VIIRS Sentinel 3 JPSS 2 JPSS 1 ECOSTRESS MEaSURES 2012  1 Petabyte: 5 years of EOS data (at 46 mbps)  2 Petabytes: All US academic research libraries

FY2014 Number of Products Distributed by Discipline 9 EOSDIS Yearly Total Data Volume (PB) and Number of Products (Billions) Distributed to End Users Data Distribution FY14

EOSDIS Data Products Distributed - FY14 10

Clients (EarthData Search) 11

Clients (Global WELD) 12

OSTP Big Earth Data Initiative (BEDI) Initiative: – “…improve the discoverability, accessibility, and usability of data and information derived from Federal civil Earth observations...” – “…making open and machine-readable the default for government data…” NASA Focus areas: – Catalog and data discovery improvements – Improve web services for direct data access (including visualization) – Implement throughout NASA centers on high-impact data Identifiers, metadata, cataloging, linking with services LP DAAC activities: – Standardize metadata across DAACs through implementation of Common Metadata Repository (CMR) – Data browse accessible through Global Image Browse Service (GIBS) Mobile application - Landcast – Assign Digital Object Identifiers (DOI) to all dataset – Operationalize services through standard protocols (OpenDAP) Middle-wear to simplify use of services and demonstrate relevance to Earth science. (“aggregator” for multi-source information and data). 13

OPeNDAP: Just give me what I want! Open Source Project for a Network Data Access Protocol OPeNDAP services allow users to request only the portion of the data files they are interested in. Application for Extracting and Exploring Analysis-Ready Samples (AppEEARS) – Middle-wear Python application suite to perform higher-level access and lower level analysis directly on archived data through OpenDAP. Pixel level example: “Extract time series of VI and LST from 10 flux tower locations from the beginning of Terra Mission through the current date” – Data are located in 7 different MODIS Level 3 tiles 8-day LST (686 date values), monthly VI (180 date values) 7 * ( ) = 6,062 granules (212 GB) – Process through sample selector 1 hour, 10 minutes Downloaded ASCII file is 409 KB (7 orders of magnitude less!) 14

AppEEARS 15

LandCast: Phone Ap - Slider Comparison

Questions???