Presentation is loading. Please wait.

Presentation is loading. Please wait.

AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC 28-29 June 2011.

Published byPaulina Flynn Modified over 8 years ago

Similar presentations

Presentation on theme: "AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC 28-29 June 2011."— Presentation transcript:

1 AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC 28-29 June 2011

2 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 2 Outline Accomplishments Data Support Activities at NSIDC Metrics  AMSR-E  AMSR-E Validation Sea ice derived from the AMSR-E 89 GHz Tbs. Image courtesy of NASA/GSFC Visualization Studio

3 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 3 Accomplishments Release of Sea Ice Drift Version 1 product (24 June 2011)  Documentation & metadata creation  End-to-end ingest testing with the SIPS  Comprehensive distribution testing o Enabled spatial and parameter subsetting via WIST/Reverb Improved product latency  Level-2 product latency reduced from 5 days to 20 hours!!!  Level-3 daily product latency reduced from 5 days to 4 days AMSR-E Data Versions: http://nsidc.org/data/amsre/versions.html

4 Accomplishments LANCE: SIPS-NSIDC collaboration  Close coordination to ensure  Preliminary data from the SIPS phased out in lieu of LANCE  Joint poster presented at A-Train meeting and AGU Google Earth Animations using LANCE data  12 km Sea Ice & Daily Soil Moisture  nsidc.org/data/virtual_globes/index.html nsidc.org/data/virtual_globes/index.html Upgrade to EOSDIS Core System (ECS) Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 4

5 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 5 Data Support: Data Access Data Pool On-line access to entire archivensidc.org/data/data_pool/nsidc.org/data/data_pool/ Subsetting, reformatting, reprojection Warehouse Inventory Search Tool (WIST) Search/order from ECHO wist.echo.nasa.govwist.echo.nasa.gov Subsetting Subscriptions Automatic delivery of new datansidc.org/opendap/nsidc.org/opendap/ through FTP push or pull http://nsidc.org/data/amsre/order_data.html

6 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 6 New Data Support: New Data Access REVERB WIST replacementreverb.echo.nasa.gov/reverb/reverb.echo.nasa.gov/reverb/ Improved user interface and search/order workflow OpenDAP Provides simple access to remotensidc.org/opendap/nsidc.org/opendap/ data Currently limited use and not publicized Data Casting (RSS Feed) Automatic delivery of new data nsidc.org/feeds/data/AE_Ocean.xml nsidc.org/feeds/data/AE_Ocean.xml through an RSS feed Currently available for L2 Ocean only http://nsidc.org/data/amsre/order_data.html

7 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 7 Data Support User Services nsidc@nsidc.org nsidc@nsidc.org Provide support of data products, in-house developed tools, and proprietary software Documentation nsidc.org/data/amsre/data_summaries/ nsidc.org/data/amsre/data_summaries/ Comprehensive product documentation Algorithm version information nsidc.org/data/amsre/versions.html nsidc.org/data/amsre/versions.html Tools nsidc.org/data/amsre/data_summaries/ nsidc.org/data/amsre/data_summaries/ General HDF and specific data set tools NewNew Data Viewer - interactive tool for viewing satellite passive microwave data sets Published Research nsidc.org/data/amsre/research.html nsidc.org/data/amsre/research.html

8 NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 8 Digital Object Identifiers (DOIs) & Versioning Develop process for implementation of DOIs Recommendations for NSIDC Major.Minor version schema (AMSR-E Version 2, V10 = 2.10) Each major version of a data set gets a separate DOI Recommendation for AMSR-E data management  Increment the ESDT (major) version number when a change to an algorithm warrants reprocessing the entire time series  Currently archiving both Version 1 & 2. Will need to discuss version retention policy moving forward. HDF4 content maps Collaborative study between NASA Earth Science Data Centers & The HDF Group focused on ensuring long term readability of HDF4 data XML file containing a “map” to the contents of the HDF4 file  Enables reading of the data without HDF4 libraries ECS 8.1 will generate, archive, and distribute the HDF4 content maps

9 NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 9 Metadata Project Provide overall improvements to NSIDC’s metadata acquisition, creation, management, and dissemination Replace or enhance existing metadata infrastructure NOAA Sea Ice Concentration CDR – W. Meier Funded by the NOAA Climate Data Record grant Integrates current SSM/I-SSMIS algorithms (NASA Team and Bootstrap) distributed by NSIDC into one combined product NetCDF4 file will include data quality fields, metadata, & provenance Green Data Center $525,000 NSF research instrumentation grant Data center will transition power consumption from 100kw (42kw load for data center equipment, 58kw for cooling) to ~45-50kw (cooling reduced by 95%)

10 NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 10 Four Phase project: 1.Machine room consolidation 2.Server Virtualization (60% reduction in servers) 3.High efficiency cooling system 4.Solar photo-voltaic power supplementation system with battery array Coolerado Units http://news.nationalgeographic.com/news/news/energy/2010/11/101227-national-snow-and-ice-data-center-makeover National Geographic Online Article

11 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 11 Archive Metrics: Volume 1 June 2002 – 1 June 2011 Stats from EMS Version 2 Archive Volume Total Archive: 20 TBs Total Version 2 Archive: 11 TB Product Volume (GB) AE_5DSNO1.28 AE_DYOCN44.04 AE_DYSNO6.49 AE_L2A4795.08 AE_LAND65.48 AE_LAND3195.56 AE_MOOCN1.46 AE_MOSNO0.22 AE_OCEAN1119.35 AE_RAIN1001.46 AE_RNGD0.02 AE_SI12187.50 AE_SI2561.79 AE_SI6139.93 AE_WKOCN6.32 AMSREL1A3456.87

12 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 12 Distribution Metrics: Total 1 June 2002 – 1 June 2011 Stats from EMS Total Distribution: 454 TBs 13.8 million files Data TypeFilesVolume (TB) AE_5DSNO543310.09 AE_DYOCN722240.80 AE_DYSNO3601280.63 AE_L2A6444515330.61 AE_LAND12465480.75 AE_LAND389730043.06 AE_MOOCN27170.03 AE_MOSNO115170.02 AE_OCEAN133060114.39 AE_RAIN218869018.56 AE_RNGD39800.00 AE_SI1243576720.62 AE_SI251799772.95 AE_SI61681526.25 AE_WKOCN70860.08 AMSREL1A44811215.12 Total13851645453.97

13 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 13 Distribution Metrics: Files 2003 - 2011 File Distribution Stats from EMS

14 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 14 Distribution Metrics: Volume 2003 – 2011 Volume Distribution Stats from EMS 100 TB 50 TB

15 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 15 Distribution Metrics: Data Access Method Stats from EMS 2003 – 2011 Data access method based on data volume Overall Average:Past 3 Year Average: ECHO/EDG orders = 52 %ECHO = 28% DataPool = 43%DataPool= 70% Subscriptions = 5% Subscriptions = 2%

16 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 16 Distribution Metrics: Users 1 June 2002 – 1 June 2011 Stats from EMS & USO TRAK Database 2192 Distinct Users ProductDistinct Users AE_5DSNO167 AE_DYOCN102 AE_DYSNO305 AE_L2A712 AE_LAND305 AE_LAND3719 AE_MOOCN47 AE_MOSNO124 AE_OCEAN166 AE_RAIN189 AE_RNGD71 AE_SI12339 AE_SI25165 AE_SI6120 AE_WKOCN25 AMSREL1A97 User TypeDistinct Users FOREIGN COMMERCIAL28 FOREIGN GOVERNMENT117 FOREIGN OTHER647 FOREIGN UNIVERSITY461 ECS OTHER128 NASA140 NOAA29 US COMMERCIAL35 US FEDERAL GOVERNMENT27 US GENERAL PUBLIC8 US GOVERNMENT14 US OTHER89 US STATE/LOCAL GOVERNMENT11 US UNIVERSITY455 WDC2 U.S. Users - 43% Foreign Uses - 57%

17 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 28-29 June 2011 17 Distribution Metrics: Users Stats from USO TRAK Database 2003 – 2011 Total Active Distinct Users per Year

18 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 18 AMSR-E Validation: Distribution Metrics No new AMSR-E Validation data sets delivered to NSIDC Published last data set in March 2010

19 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 19 Distribution Metrics: Archive volume Archive volume (GB) through 1 June 2011 Total Archive Volume = 575 GB

20 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 20 Distribution Metrics: Users Distinct users through 1 June 2011. Total Distinct Users = 4,952 33% increase from last year Statistics from our University FTP logs

21 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 21 AMSR-E Validation: Metrics Files distributed through 1 June 2011 Total Files Distributed = 772,364 23% increase from last year Statistics from our University FTP logs

22 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 22 Metrics: Volume Volume (GB) distributed through 1 June 2011 Total Volume Distributed = 2 TB 25% increase from last year Statistics from FTP logs

23 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June 2011 23 AMSR-E Team at NSIDC Thanks to the AMSR-E Teams at NSIDC! AMSR-E Molly Thomas – Operations Karla LeFevre – Technical Writer Lisa Booker – User Services Sean Mallory – Programmer Siri Jodha Khalsa – ECS Science Coordinator Walt Meier – Scientist Doug Fowler – Test Engineer Cathy Fowler – Database Administrator AMSR-E Validation Molly Thomas – Operations Karla LaFevre – Technical Writer Dan Webster – Technical Writer Lisa Booker – User Services Sean Mallory – Programmer

24 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC2-3 June 2010 24

Download ppt "AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC 28-29 June 2011."

Similar presentations

BEDI -Big Earth Data Initiative

BEDI -Big Earth Data Initiative
MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January 17-18 2007.

MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January
Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.
AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.

AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.

System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.

Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
U.S. Department of the Interior U.S. Geological Survey Land Processes DAAC Update MODIS-VIIRS Science Team Meeting January 26-28, 2010 Dave Meyer LP DAAC.

U.S. Department of the Interior U.S. Geological Survey Land Processes DAAC Update MODIS-VIIRS Science Team Meeting January 26-28, 2010 Dave Meyer LP DAAC.
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.

September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
PODAG.28 October 14-15, 2009 Ron Weaver NSIDC DAAC Manager California fire smoke enhances a Colorado.

PODAG.28 October 14-15, 2009 Ron Weaver NSIDC DAAC Manager California fire smoke enhances a Colorado.
Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.

Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.
Promising data analytics technologies Tiffany Mathews.

Promising data analytics technologies Tiffany Mathews.
, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.

, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.
, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September 20141.

Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
1PoDAG XXX: IceBridge October 12, 2011 PoDAG XXX: IceBridge Marilyn Kaminski IceBridge Project Manager October 12, 2011.

1PoDAG XXX: IceBridge October 12, 2011 PoDAG XXX: IceBridge Marilyn Kaminski IceBridge Project Manager October 12, 2011.
Status of AMSR-E and AMSR-E Validation Data at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Telluride, Colorado 14-16 July 2008.

Status of AMSR-E and AMSR-E Validation Data at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Telluride, Colorado July 2008.
Presented at the LANCE User Working Group Meeting April 29, 2015 LANCE AMSR2 UPDATE Sherry Harrison

Presented at the LANCE User Working Group Meeting April 29, 2015 LANCE AMSR2 UPDATE Sherry Harrison
Global Imagery Browse Services Overview AMSR Science Team Meeting Matt Cechini, GIBS Lead Helen Conover, AMSR-E SIPS.

Global Imagery Browse Services Overview AMSR Science Team Meeting Matt Cechini, GIBS Lead Helen Conover, AMSR-E SIPS.
Status of AMSR-E and ICESat/GLAS at NSIDC Melinda Marquis NSIDC Product Team Lead, AMSR-E, AMSR-E Validation and GLAS June 3, 2004.

Status of AMSR-E and ICESat/GLAS at NSIDC Melinda Marquis NSIDC Product Team Lead, AMSR-E, AMSR-E Validation and GLAS June 3, 2004.
September 4 -5, 2013Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Leader Science Computing Facility Current Science Software.

September 4 -5, 2013Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Leader Science Computing Facility Current Science Software.

Similar presentations

Ads by Google