1. AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint Science Team Meeting June 25-26, 2009 Rosslyn, VA kregner@itsc.uah.edukregner@itsc.uah.edu www.itsc.uah.edu http://ghrc.msfc.nasa.gov 256.961.7791www.itsc.uah.edu http://ghrc.msfc.nasa.gov

2. AMSR-E SIPS Personnel AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 2 NASA MSFC: H. Michael Goodman, PI UAH ITSC (Staff shared with GHRC and ITSC): Management: Dr. Sara Graves, Director, ITSC Development: Helen Conover, Lead Bruce Beaumont Lamar Hawkins Mary Nair Matt Smith Engineering: Kathryn Regner Sandra Harper Data Management: Steve Jones Sherry Harrison Systems Administration: Will Ellett, Lead Michele Garrett

3. Outline Data Flow Review System Configuration –Hardware –Software Architecture Accomplishments Reprocessing Summary AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009

4. AMSR-E Data Flow TLSCF Science Software I&T SIPS-GHCC PO.DAAC JAXA-EOC L1A Product Generation SIPS-RSS L2A Product Generation L2B and L3 Product Generation (science, metadata, qa, ph, subsets, browse) L2 and L3 algorithms L2A algorithm NSIDC DAAC Data Archive and Distribution Level-1 Level-2 and Level-3 Level-1 NASA EDOS RBD & PDS Ground Stations L2B and L3 Algorithms Level-0 Product Delivery Record Server (PDRS) Algorithm Teams OceanSea Ice Rain Land Snow Data NASA FDS GBAD

5. AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 5 SIPS-GHCC Hardware Operational Configuration 8 TB Dell EMC CX300 Storage Area Network Array 2 GB/sec Fibre Channel Switch Dell PowerEdge 2850 2 x 3.4 GHz Processors 4 GB RAM, RHEL 5 AMSR 1-4 Near line storage of all Level-2A and most recent Level-2B & Level-3 Restricted FTP Server Multiple processing environments across four machines results in much greater flexibility for processing and reprocessing. Sun Storage 7310 With J4400 Disk Array 8TB NAS Private Network (1 GB/sec) Forward Processing Reprocessing Dev, Integration & Test Storage Buildout In Procurement

6. AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 6 Software Architecture (Routine Processing ) Level-2A Brightness Temperatures (with Metadata and QA files) L2B Ocean (1/2-orbit) L2B Land (1/2-orbit) L2B Rain (1/2-orbit) L3 Ocean (Daily) L3 Land (Daily) L3 Snow (Daily) L3 Sea Ice (Daily, 3 Res) L3 Snow (Pentad) L3 Ocean (Weekly) L3 Ocean (Monthly) L3 Rain (Monthly) L3 Snow (Monthly) Once per day Once every five days Once per week Once per month Product Generation Scheduling ------------- ~ 29 times per day Level-2A Brightness Temperatures Near Real Time Ingest from RSS

7. Accomplishments September 2008 –First AMSR-E reprocessing completed; all products ESDT Version 2 –Completed migration of software, data, and science team users from the IRIX platform to the LINUX platform October 2008 –Engineered a new processing environment and automation scripts for the Adeos II/Midori AMSR data set –Ingested the AMSR Level-2A TB’s data from RSS AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 7

8. Accomplishments (2) November 2008 –SIPS at Remote Sensing Systems identified a source of RFI in the descending AMSR-E 18.7 GHz vertically and horizontally polarized channels. –Formulated a solution and scheduled work for early 2009. December 2008 –Integration tested and put into production three new algorithms, making all AMSR-E algorithms validated. –Provided inputs to the Aqua end of prime mission review held at NASA HQ AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 8

9. Accomplishments (3) January 2009 –SIPS and NSIDC completed updates and corrections to the Operations Agreement. February 2009 –Completed processing the Midori/Adeos-II AMSR dataset and staging for ingest at the NSIDC DAAC. March 2009 –Remote Sensing Systems implemented an RFI quality flag in the L2A brightness temperature data and reprocessed affected data (July 2007 and forward). AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 9

10. Accomplishments (4) April 2009 –GHRC began ingesting the reprocessed Level-2A from RSS and began forward processing and reprocessing with Version V10 May 2009 –GHRC completed local modifications to send secure FTP log data daily (rather than monthly) to the ESDIS Metrics System (EMS). AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 10

11. Accomplishments (5) June 2009 –GHRC completed all Level-2B reprocessing (Ocean, Land, Rain) for the entire mission period. –Began Level-3 reprocessing –Specified and procured another increment of storage for the Level-2A products. AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 11

12. Reprocessing Summary All higher level products are based upon the V10 L2A TBs that include populated RFI flag. –All US products are validated –All Level-2B products have been reprocessed –Each product is at the same version number from beginning of mission to present day. –Level-3 products are being generated at the rate of 1 month per day (anticipate completion toward the end of July). AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 12

13. Field Campaign Support AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 13 GHRC provided Near Real Time AMSR-E data to assist with flight planning during three field campaigns in 2008 –Snow depth product for ARCTAS (Arctic Research of the Composition of the Troposphere from Aircraft and Satellites) spring and summer http://www.espo.nasa.gov/arctas/ http://www.espo.nasa.gov/arctas/ –working with sea ice team to supply data in support of an Arctic experiment in August. “The near real-time AMSR-E data helped us immensely with our flight planning during our last field campaign in 2006.” - Don Cavalieri Real Time Mission Monitor - interactive field experiment asset management and data visualization tool http://rtmm.nsstc.nasa.gov/

14. Near Future Activities New Storage Device –Configuration and integration –Data migration (no downtime) Integration of new and updated algorithms –Sea Ice Drift product; Level-3 Ocean and Level-3 Rain –Reprocessing those datasets Evaluate reprocessing Level-2A based upon new Level-1A. AMSR-E Joint Science Team Meeting Rosslyn, VA June 25-26, 2009 14