AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint Science Team Meeting June 25-26, 2009 Rosslyn, VA www.itsc.uah.edu

AMSR-E SIPS Personnel AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, NASA MSFC: H. Michael Goodman, PI UAH ITSC (Staff shared with GHRC and ITSC): Management: Dr. Sara Graves, Director, ITSC Development: Helen Conover, Lead Bruce Beaumont Lamar Hawkins Mary Nair Matt Smith Engineering: Kathryn Regner Sandra Harper Data Management: Steve Jones Sherry Harrison Systems Administration: Will Ellett, Lead Michele Garrett

Outline Data Flow Review System Configuration –Hardware –Software Architecture Accomplishments Reprocessing Summary AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009

AMSR-E Data Flow TLSCF Science Software I&T SIPS-GHCC PO.DAAC JAXA-EOC L1A Product Generation SIPS-RSS L2A Product Generation L2B and L3 Product Generation (science, metadata, qa, ph, subsets, browse) L2 and L3 algorithms L2A algorithm NSIDC DAAC Data Archive and Distribution Level-1 Level-2 and Level-3 Level-1 NASA EDOS RBD & PDS Ground Stations L2B and L3 Algorithms Level-0 Product Delivery Record Server (PDRS) Algorithm Teams OceanSea Ice Rain Land Snow Data NASA FDS GBAD

AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, SIPS-GHCC Hardware Operational Configuration 8 TB Dell EMC CX300 Storage Area Network Array 2 GB/sec Fibre Channel Switch Dell PowerEdge x 3.4 GHz Processors 4 GB RAM, RHEL 5 AMSR 1-4 Near line storage of all Level-2A and most recent Level-2B & Level-3 Restricted FTP Server Multiple processing environments across four machines results in much greater flexibility for processing and reprocessing. Sun Storage 7310 With J4400 Disk Array 8TB NAS Private Network (1 GB/sec) Forward Processing Reprocessing Dev, Integration & Test Storage Buildout In Procurement

AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, Software Architecture (Routine Processing ) Level-2A Brightness Temperatures (with Metadata and QA files) L2B Ocean (1/2-orbit) L2B Land (1/2-orbit) L2B Rain (1/2-orbit) L3 Ocean (Daily) L3 Land (Daily) L3 Snow (Daily) L3 Sea Ice (Daily, 3 Res) L3 Snow (Pentad) L3 Ocean (Weekly) L3 Ocean (Monthly) L3 Rain (Monthly) L3 Snow (Monthly) Once per day Once every five days Once per week Once per month Product Generation Scheduling ~ 29 times per day Level-2A Brightness Temperatures Near Real Time Ingest from RSS

Accomplishments September 2008 –First AMSR-E reprocessing completed; all products ESDT Version 2 –Completed migration of software, data, and science team users from the IRIX platform to the LINUX platform October 2008 –Engineered a new processing environment and automation scripts for the Adeos II/Midori AMSR data set –Ingested the AMSR Level-2A TB’s data from RSS AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,

Accomplishments (2) November 2008 –SIPS at Remote Sensing Systems identified a source of RFI in the descending AMSR-E 18.7 GHz vertically and horizontally polarized channels. –Formulated a solution and scheduled work for early December 2008 –Integration tested and put into production three new algorithms, making all AMSR-E algorithms validated. –Provided inputs to the Aqua end of prime mission review held at NASA HQ AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,

Accomplishments (3) January 2009 –SIPS and NSIDC completed updates and corrections to the Operations Agreement. February 2009 –Completed processing the Midori/Adeos-II AMSR dataset and staging for ingest at the NSIDC DAAC. March 2009 –Remote Sensing Systems implemented an RFI quality flag in the L2A brightness temperature data and reprocessed affected data (July 2007 and forward). AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,

Accomplishments (4) April 2009 –GHRC began ingesting the reprocessed Level-2A from RSS and began forward processing and reprocessing with Version V10 May 2009 –GHRC completed local modifications to send secure FTP log data daily (rather than monthly) to the ESDIS Metrics System (EMS). AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,

Accomplishments (5) June 2009 –GHRC completed all Level-2B reprocessing (Ocean, Land, Rain) for the entire mission period. –Began Level-3 reprocessing –Specified and procured another increment of storage for the Level-2A products. AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,

Reprocessing Summary All higher level products are based upon the V10 L2A TBs that include populated RFI flag. –All US products are validated –All Level-2B products have been reprocessed –Each product is at the same version number from beginning of mission to present day. –Level-3 products are being generated at the rate of 1 month per day (anticipate completion toward the end of July). AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,

Field Campaign Support AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, GHRC provided Near Real Time AMSR-E data to assist with flight planning during three field campaigns in 2008 –Snow depth product for ARCTAS (Arctic Research of the Composition of the Troposphere from Aircraft and Satellites) spring and summer –working with sea ice team to supply data in support of an Arctic experiment in August. “The near real-time AMSR-E data helped us immensely with our flight planning during our last field campaign in 2006.” - Don Cavalieri Real Time Mission Monitor - interactive field experiment asset management and data visualization tool

Near Future Activities New Storage Device –Configuration and integration –Data migration (no downtime) Integration of new and updated algorithms –Sea Ice Drift product; Level-3 Ocean and Level-3 Rain –Reprocessing those datasets Evaluate reprocessing Level-2A based upon new Level-1A. AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26,