1. EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC
ESDIS Project, Science Systems Development Office

2. EOSDIS Context Distributed Active Archive Centers (DAACs)
ACCESS
Distributed Active Archive Centers (DAACs)
Instrument Science Team Facilities
(SCFs and SIPSs)
Data Assimilation Model
Adapted from
REASoN

3. EOSDIS Data Availability Timeline

4. Earth Science Data and Information System (ESDIS) Project - GSFC Code 423
Objective - Develop and Operate Earth Observing System Data and Information System (EOSDIS)
A production capability for standard science data products from EOS instruments
An “active archive” of Earth science data from EOS and other past and present Earth science missions
A distributed information framework (data centers, system elements, interfaces and data model) supporting EOS investigators and other users in science, government, industry, education, and policy
Organizations: ESDIS Project meets its requirements by funding and managing several organizations including
“Large” industrial: Raytheon (EMD)
Distributed Data Centers - NASA Centers (GSFC, JPL, LaRC), other government agencies (EDC, ORNL), Universities (ASF, NSIDC, SEDAC)
Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, LaRC, MSFC), NCAR
Project Components:
SDPS - System for ingesting, processing, archiving and distributing data
Data Centers - Science System Operations
EOSDIS Networks - Transportation of mission & science data
SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data products for delivery to Data Centers
Web Site:

5. Unique Data Sets: Total number of unique data sets distributed in the fiscal year
Distinct Users of EOSDIS Data and Services: Total unique users across EOSDIS Data Users and Web Visitors, per data center and summed
Web Site Visits: Sum of web visits for data centers where a visit represents a user session not broken by more than 30 minutes and a duration of at least one minute
Average Archive Growth: Sum across reporting data centers of the data volume added to the individual archives divided by the days in the year
Total Archive Volume: Sum across reporting data centers of the data volumes in the archive as of end of the fiscal year
End User Distribution Products: Total number of products distributed from all reporting data centers
End User Average Distribution Volume: Sum across reporting data centers of the data volume distributed for the fiscal year divided by the days in the year

6. Trends in data access
About 812 million products distributed in total for all Fys
About 9.5 PB distributed in total for all FYs

7. Volume Distributed - Top 10 Products
FY2009 Annual Report

8. Files Distributed - Top 10 Products
FY2009 Annual Report

9. EOSDIS Metrics Reference
All kinds of other metrics information about EOSDIS can be found at:

10. Recent Progress
ECS 7.23 is operational at the sites which host ECS (Land Processes DAAC, Souix Falls, SD, Atmospheric Sciences Data Center, Langley, VA, and National Snow and Ice Data Center, Boulder, CO)
Migration to all disk archive is complete for the ECS systems; backup is LTO tape, but not used for near-line access
There were corruption issues that needed to be resolved with a combination of backups/ reprocessing
Much of the data was written ‘pre-checksum’ so research needed to be performed before we felt confident that that data was ‘ok’, e.g., Level 0 (non HDF) data;
Focus now is on enhancing data access -
EED Contract awarded 4/1 – for sustainment and development for the EOSDIS which includes ECS Science Data Processing System and the EOS Clearinghouse (metadata repository)
Began supporting ICEBridge by working on initial set of data types; integrating into NSIDC ECS system

11. Plans for the next year EED
- Hardware end-of-life issues being addressed with technology refreshes
- ECHO metadata model to be made ISO compliant – will help us support new data systems which have ISO support required
- Data access enhancements to support conversion services provided by the data centers which will include subsetting, reprojection and reformatting on data distributed from the ECS
- Improved search client
- EOSDIS Coherent Web presence
- OpenDAP access to ECS data
- Enhancements to support HDF as an archive format
The HDF Group
New grant beginning 7/15;