NDE NOAA NDECOPC Meeting Offutt AFB November 13, 20081 Title Page NDE NPOESS Data Exploitation – NESDIS James G. (Jim) Yoe, NESDIS/OSD NDE Integration.

Slides:



Advertisements
Similar presentations
NOAA’s NPOESS Data Exploitation (NDE) System Jim Yoe 1, Geof Goodrum 1, Jim Silva 1, Tom Schott 1 1. NOAA/NESDIS Office of Systems Development.
Advertisements

Status of Operational Implementation of MIRS V2.0 at OSDPD Limin Zhao, Aiwu Li and Jiang Zhao April 18, 2008.
VIIRS Land PEATE Masuoka, Wolfe, Isaacman and Devadiga.
1 GOES Users’ Conference October 1, 2002 GOES Users’ Conference October 1, 2002 John (Jack) J. Kelly, Jr. National Weather Service Infusion of Satellite.
Reginald Lawrence Office of Systems Development
NDE Title Page NDE Briefing for JAG/ODAA NPP Data Exploitation September 13, 2011.
Development of NWS Satellite User Readiness Mike Johnson NWS/OST November 4, 2009.
Suomi National Polar-orbiting Partnership (SNPP) Data Access NOAA Satellite Conference April 8-12, 2013 Kevin Berberich NESDIS/OSD NDE Project Photographs.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Joint Polar Satellite System Harry Cikanek Director, Joint Polar Satellite System March 18, Science Week.
Environmental Satellite Product and Distribution System (ESPDS) GOES-R Access Subsystem (GAS) John Linn ESPDS System Engineering 7 October 2009.
1 Status of Polar Satellite Systems and NWS Satellite Initiatives.
2013 GOES-R AWG 2 nd Validation Workshop January 2014 Status of Activities and Plans for the GOES-R Core Ground System 1 Satya Kalluri Ph.D. GOES-R.
1 NOAA’s Environmental Modeling Plan Stephen Lord Ants Leetmaa November 2004.
H-8 Project Update COPC May 27, H-8 Project Update JMA planning for full H-8 operations in July 2015 – Commissioning progressing well Data quality.
NOAA NPOESS PREPARATION ACTIVITIES Gene Legg Office of Satellite Data Processing And Distribution Asia Pacific Satellite Data Exchange and Utilization.
Applications and Limitations of Satellite Data Professor Ming-Dah Chou January 3, 2005 Department of Atmospheric Sciences National Taiwan University.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 STAR and NPOESS Presented.
1 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview.
NPOESS Data Quality Monitoring (DQM) Interface Functionality at DoD Centrals Jim Vermeulen 28 May 2008.
September 4 -5, 2013Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Leader Science Computing Facility Current Science Software.
Reginald Lawrence, NOAA/NESDIS/OSD NOAA Direct Readout Conference
1 NAVOCEANO’S NPOESS DATA EXPLOITATION SYSTEM FALL COPC Meeting Nov 08 George M. Mason.
1 SPSRB Decision Brief on Declaring a Product Operational Instructions / Guidance This template will be used by NESDIS personnel to recommend to the SPSRB.
NOAA Satellite Proving Ground/User Readiness Meeting
Month day, year Comments from NWSHQ Perspective Need to produce table showing 68 baseline & option products vs products that PG is working on What is link.
User Input from past GOES Users’ Conferences Jim Gurka Steve Goodman NOAA/NESDIS GOES-R Program Office Tim Schmit NOAA/NESDIS/ STAR 7 th GOES Users’ Conference.
JAG/ODAA Fall 2008 James Vermeulen & Jon Whiteside JAG-ODAA Co-Chairs Recommend NCEP's Bradley Ballish replace Jon Whiteside (term completed)
NDE Title Page NDE NPOESS Data Exploitation Jim Yoe, Implementation Coordinator NPOESS Data Exploitation (NDE) Project NESDIS Office of Systems Development.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Current Status  Framework is in place and algorithms are being integrated.
Mission: Transition unique NASA and NOAA observations and research capabilities to the operational weather community to improve short-term weather forecasts.
DRAFT POES-GOES-GPS Blended TPW Products July ??, 2008 Preliminary Design Review.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 POES Microwave Products Presented.
Mitch Goldberg National Oceanic & Atmospheric Administration | NOAA JPSS Program Scientist Ingrid Guch and Bill Sjoberg.
HDF-EOS at NOAA/NESDIS NOAA / NESDIS / ORA orbit-net.nesdis.noaa.gov/arad2/MSPPS Huan Meng, Doug Moore, Limin Zhao, Ralph Ferraro NOAA / NESDIS.
BACKUP XDRs and NDE PRODUCTS Fall 2010 COPC Meeting (AFWA – Offutt AFB) Jim Vermuelen FNMOC - Data Ingest Team Supervisor WG-CSAB Member JAG/ODAA Co-Chair.
COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, NDE Operational Status.
CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)
1 Validated Stage 1 Science Maturity Review for VIIRS Cloud Base, Nighttime Optical Properties and Cloud Cover Layers Products Andrew Heidinger September.
NDE May 28, FNMOCNDE Informational Update to the COPC1 Title Page NDE NOAA NPOESS Data Exploitation Update James Yoe NDE Systems Integration Coordinator.
Diane E. Wickland NPP Program Scientist NPP Science: HQ Perspective on VIIRS May 18, 2011.
1 Hyperspectral IR Working Group (JCSDA-IRWG) Report John Derber and Chris Barnet JCSDA 7 th workshop on Satellite Data Assimilation May 12, 2009.
Use Of NPP Data In The Joint Center For Satellite Data Assimilation Lars Peter Riishojgaard, JCSDA Director IGARSS July
January 7, 2015 Walter Wolf, Jaime Daniels, and Lihang Zhou NOAA/NESDIS, Center for Satellite Applications and Research (STAR) Shanna Sampson, Tom King,
GOES-R Recommendations from past GOES Users’ Conference: Jim Gurka Tim Schmit Tom Renkevens NOAA/ NESDIS Tony Mostek NOAA/ NWS Dick Reynolds Short and.
PoDAG XXI: SEEDS SEED: NSIDC Potential Interactions NSIDC DAAC should prepare an evaluation of their desired future roles in "core activities" and in mission.
NDE 1 Title Page NDE Jim Silva, NDE Project Manager July 12, 2006 NPOESS Data Exploitation Project Mission Overview 2006 Southern Region.
NPOESS Science Advisory Team Gregory W. Withee Assistant Administrator for Satellite and Information Services July 16,2003 A Proposal to the NOAA Science.
NPP/Follow-On Phase months after NPP Launch JPSS contractor delivered xDRs  xDRs with To Be Confirmed (TBC) are products not currently provided.
WG-CSAB Updates Spring 2013 COPC Meeting (FNMOC, Monterey, California) November 20-21, 2013 Dave McCarren WG-CSAB Chair.
Page 1 IDPS Dec 2004 NP-IDPS-042 HARDCOPY UNCONTROLLED NPP Deliverable Products Sizing Estimates Tyler Hall March 30th, 2006.
Page 1 Land PEATE support for CERES processing Ed Masuoka Gang Ye August 26, 2008 CERES Delta Design Review.
Early Results from AIRS and Risk Reduction Benefits for other Advanced Infrared Sounders Mitchell D. Goldberg NOAA/NESDIS Center for Satellite Applications.
ATS Information Technology AAWS June 8-10, 2004 EXCELLENCE THROUGH TEAMWORK NPOESS Schedule and Processes.
Blended Sea Surface Temperature EnhancementsPolar Winds Blended Hydrometeorological Products Blended Total Ozone Products are derived by tracking cloud.
NDE 14 November 2007Briefing to NCEP1 Title Page NDE Project Overview Information Briefing to COPC James Silva NPOESS Data Exploitation Project Manager.
NOAA’s NPOESS Data Exploitation (NDE) System Jim Yoe 1, Geof Goodrum 1, Jim Silva 1, Tom Schott 1, Maurice McHugh 2, Gary Roth 3, Peter MacHarrie 3 1.
DOD NPOESS Data Exploitation COPC Action Item ,11 Jim Vermeulen 21 October 2008.
ESPC CIP Update November 7, COPC Action Item  NESDIS is currently in the process of reviewing and planning upgrades for the critical infrastructure.
N A T I O N A L O C E A N I C A N D A T M O S P H E R I C A D M I N I S T R A T I O N NPP DATA ACCESS Mitch Goldberg JPSS Program Scientist June 21, 2012.
March 2004 At A Glance The AutoFDS provides a web- based interface to acquire, generate, and distribute products, using the GMSEC Reference Architecture.
NDE NPOESS Data Exploitation NPOESS Data Exploitation (NDE) George Serafino NOAA Environmental Satellite Processing Center (ESPC) Jim Silva NDE Project.
Microwave Integrated Retrieval System System provides data products from microwave instruments in all weather and all surface conditions. Products will.
NOAA, May 2014 Coordination Group for Meteorological Satellites - CGMS NOAA Activities toward Transitioning Mature R&D Missions to an Operational Status.
Transition of Science Algorithms into Enterprise Product Generation Operations 2016 AMS Annual Meeting Dylan Powell, Ph.D. Lockheed Martin ESPDS Science.
21 st Operational-MIRS Meeting October 3 rd 2008.
NOAA NPOESS PREPARATION ACTIVITIES Gene Legg Office of Satellite Data Processing And Distribution Asia Pacific Satellite Data Exchange and Utilization.
Band 14 (11um) Winds Low-Level >700 mb Mid-Level mb High-Level mb   NPP VIIRS Polar Winds Products The GOES-R AWG Derived Motion Winds.
GOES-R AIT: Updating the Data Processing System with data from the Himawari-8 Geostationary Satellite Jonathan Wrotny1, A. Li1, A. Ken1, H. Xie1, M. Fan1,
CIOSS Executive Board Al Powell Acting Director 30 August 2005
Presentation transcript:

NDE NOAA NDECOPC Meeting Offutt AFB November 13, Title Page NDE NPOESS Data Exploitation – NESDIS James G. (Jim) Yoe, NESDIS/OSD NDE Integration Coordinator

NDE NOAA NDECOPC Meeting Offutt AFB November 13, Overview NESDIS NDE Review/Overview COPC Action Item –Response and Recommendation NDE Project Status Summary – Issues

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Mission and Objectives Deliver NPOESS data products and assist NOAA and other civilian operational users to realize the potential of NPOESS observations Disseminate NPOESS Data Records to real-time civilian users Generate and disseminate tailored NPOESS Data Records Generate and disseminate NOAA-unique products (enhanced data products constructed from NPOESS Data Records) Deliver NOAA-unique products, product processing elements, and associated metadata to CLASS for long-term archiving Provide services to customers, including NDE product training, product enhancement, and implementation support across NOAA Provide software for NPOESS Data Record format translation and other data manipulations

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NPOESS & NDE NPOESS Data Exploitation SafetyNet NPOESS Ground Systems Command and Control Operational User Community Archive and Access NPP NPOESS C1 NDE Enhanced Products Quality Control Near Real-time Delivery Generic NPOESS Data NOAA Science Center (operated in ESPC) Process Ingest NDE will be a critical link to achieve return on the NPOESS investment – beginning with NPP

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Management Team AWIPS Design Partners NDE Product Development Teams (STAR & Others) NDE Product Development Teams (STAR & Others) ESPC Infrastructure Acquisition, Operations (OSDPD) NDE Project Manager Jim Silva NDE Project Manager Jim Silva Data Centers CLASS STAR NDE System Architect Geof Goodrum NDE System Architect Geof Goodrum NOAA System Integration Teams (NCEP, CoastWatch, AWIPS & Others) NOAA System Integration Teams (NCEP, CoastWatch, AWIPS & Others) System Development Team (OSDPD) NDE Systems Integration Coordinator Jim Yoe NDE Systems Integration Coordinator Jim Yoe NDE Product Development Manager Tom Schott NDE Product Development Manager Tom Schott

NDE NOAA NDECOPC Meeting Offutt AFB November 13, COPC Action Item The prioritization of NESDIS NDE Initiatives as it relates to the time phasing of the NPP/NDE, requires further coordination. The NESDIS should work more closely with DoD partners and the JCSDA to ensure coordination of priorities. NESDIS should provide a review of these initiatives at the next COPC meeting. –AI arose from COPC reaction to the NPP Product Development phasing efforts (see next slides).

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Product Development NDE supporting 3 major NOAA-Unique Product (NUPs) development lines –CrIS/ATMS Thinned Radiance –Microwave Integrated Retrieval System (MIRS) –Sea Surface Temperature (SST) Phased Approach for NPP –Phase I to provide legacy products for NOAA mission continuity –Phase II to provide other legacy products

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NPP Phase 1 CrIS Thinned RadiancesSST AnalysisSea Surface Temperature (SST) CrIS Cloud Cleared RadiancesBlended SSTNadir Profile Ozone Total Precipitable Water (ATMS)SST AnomaliesOzone Total Column Snow Cover (ATMS)Coral Reef Degree HeatingSnow Cover and Depth Precipitation Type/Rate (ATMS)Coral Reef BleachingImagery Surface Emissivity (ATMS)Total Ozone (CrIS)Ocean Color/Chlorophyll Cloud Liquid Water (ATMS)Trace Gases (Carbon)Vegetation Index Sea Ice Cover/Concentration (ATMS)SST (AVHRR-like)Active Fires Snow Water Equivalent (ATMS)Aerosol (AVHRR-like)Atmospheric Temperature Profile Ice Water Path (ATMS)ATMS RadiancesAtmospheric Moisture Profile Land Surface Temperature (ATMS)CrIS RadiancesAerosol Optical Thickness Temperature Profiles (ATMS)VIIRS RadiancesLand Surface Type Moisture Profiles (ATMS)OMPS RadiancesSurface Albedo Rain Water Path/Profile (ATMS)Cloud MaskCloud Cover/Layers Y NUPs B xDRs Phase 1 (3-20 months after NPP Launch): Legacy mission continuity replacement products comprised of currently funded NOAA Unique Products (NUPs) and xDRs

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NPP Phase 2 Polar Winds (VIIRS)Fire PotentialCloud Top Height (VIIRS) Limb Profile OzoneNear Coast Ocean ColorIce Surface Temperature Blended Snow CoverIntegrated xDRs at CrIS ResolutionNet Heat Flux Harmful Algal Blooms (VIIRS)Cloud Liquid Water Path (VIIRS)Sea Ice Characterization (VIIRS) Blended OzoneCloud Ice Water Path (VIIRS)Suspended Matter Blended Total Precipitable WaterCloud Top Temperature (VIIRS)Atmospheric Pressure Profile Tropical Rainfall PotentialAerosol Particle SizeQuarterly Surface Type Gridded Clear Sky Radiances (VIIRS)Cloud Top TemperatureSoil Moisture Vegetation HealthCloud Top Pressure Vegetation MoistureLand Surface Temperature (VIIRS) Drought IndicesCloud Base Height Vegetation Thermal ConditionsCloud Effective Particle Size Leaf Area IndexCloud Optical Thickness Phase 2 (20 months after NPP Launch to 1 month prior to C1 launch): Additional legacy products and enhanced products comprised of NUPs and xDRs not linked to mission continuity YNUPs BxDRs

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Response to AI JCSDA Director presented NDE’s NPP product phasing to Executive Team (DoD, NASA, & NOAA) –With understanding that ability to re-prioritize NUP development sharply limited by need to support NWP, funding availability, and time JCSDA partners most interested in obtaining –CrIS/ATMS radiances –VIIRS Atmospheric Motion Vectors (AMV winds) Note that NOAA is supporting development of AVHRR AMVs w/o water vapor channel; if successful will apply to VIIRS NOAA NDE also has identified additional “internal NUPs” which may be made available to DoD –CrIS/ATMS Principal Components from radiances - USN

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Response to AI JCSDA ranks NPP preparation as highest priority –Prior to NPP launch, JCSDA will Ingest simulated datasets to ensure that file formats and processing chain including CRTM (Community-based radiative transfer Model) are ready –Immediately after launch, JCSDA will Start monitoring data quality of CrIS and ATMS against background and analysis fields; diagnostics will be made available to NPP team but not to the general public –Excerpted from L.P. Riishojgaard’s presentation to Sounding OAT Recommendation: Close the Action Item

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Project Status SYSTEM DEVELOPMENT : Subsystem Builds

NDE NOAA NDECOPC Meeting Offutt AFB November 13, Testing w/NPOESS Ground System –System Interface Tests ahead ICT 14 (C3S): ~20 Jan 2009 ICT 10 (IDPS): ~9 Mar 2009 ICT 13 (Ancillary Data): ~May 2009 NCT 3 (EtE): ~15 June 2009 –COTS Software Requirement for Java API Borland Visibroker licensing IT Security –Identify NIST SP Security Controls Common and NDE System Specific Due 31 Oct 2008 NDE Architecture Status 13

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Architecture Status IDPS Face to Face (8-9 Oct) –Performance improvements (4 copy at NESDIS) –Prototyping software for NPOESS –Evaluating hardware for NPOESS Shared Architecture –Presented NDE to GAS IPT as notional architecture for ESPC (16 Oct) –Update and present at ESPC Evolution meeting (19 Dec) 14

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Implementation Progress –Data Handling System Development; Successful Ingest Demonstration at the September 26 th NDE Quality Review Completed NDE Tailoring Tool Evaluation and Analysis –IDPS to NDE testing support; Continued support of IDPS interface testing Integrated, configured, and tested SAN disks with previously received 9222i Cisco switches Received two Dell servers to support StorNext Meta Data Control (MDC) Estimate shipment of MDC RAID from LSI on October 29 th –Created the NDE Subsystem Boundary Diagram for security documentation

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Implementation Plans –Continue work with IDPS on interface testing; Continue to receive and configure network, disk storage, and metadata servers hardware, and StorNext software –Test Readiness Review for the Ingest Subsystem scheduled for November –Begin development of the HDF to Net CDF Data Reader Prototype in November –Define the NDE Security Controls by the end of November

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE Systems Integration Interface Development NDE-ESPC ICD –Signature version delivered 11/7/2008 –Goal: signed ICD by 2/3/2009 NDE-CLASS ICD –Signature version delivered for review 10/24/2008 –Goal: signed ICD by 2/3/2009 NDE-STAR/CE ICD –First Draft being prepared based on input from 7/7/2008 NDE-NWS/TOC ICD – NDE-SIC met with new TOC Director 10/6/2008 Joint NDE-TOC team to outline way forward Need to determine what document(s) needed between TOC-AWIPS Technology Infusion, and NDE-AWIPS-TI

NDE NOAA NDECOPC Meeting Offutt AFB November 13, System Integration - Users AWIPS Technology Infusion Project –Coordinate schedules, architectures, smart push-pull for data –Work with NWS HQ to identify product requirements Collaboration with Hydrometeor Testbed –HMT gets enhanced data to support forecasts/warning –NDE gets data/expertise to validate precipitation products Outreach and Training –Identify new applications and new users –Develop/support training modules for products –Exploit existing resources COMET, NWS Training Division, VISIT, SHYMET

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NDE -COPC Issues Distribution of NPP NUPS to COPC Partners –Determine detailed requirements – formats, volumes, etc. –Establish interim methodology & protocol NDE Distribution Build will not be complete until 2011 –Adequacy of Network Encourage co-development by NDE and the DoD Centrals –For data product development NDE and NOAA CoastWatch users would like VIIRS proxy data –For tools and system elements NDE data tailoring tools may be of interest to AFWA –For (user) training Back-up options for ingest data, processing, and distribution in the NPOESS era

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NPP Status VIIRS status –Senior Government Manager on site at Raytheon, appointed as COTR –EMI testing regression ongoing –April 2009 delivery to NPP doubtful NASA maintains LRD 14 months after VIIRS delivery Tri-agency Team established to evaluate several NPP options –NDE prepared to evaluate impacts on current baseline and identify its resource requirements for each option

NDE NOAA NDECOPC Meeting Offutt AFB November 13, Back-Up Slides

NDE NOAA NDECOPC Meeting Offutt AFB November 13, NPP Reformatting to Support JCSDA Prioritized ProductBUFRGRIB2Comments ATMS RadiancesX BUFR Table expected end Nov 2008 CrIS RadiancesX BUFR Table expected end Oct 2008 Nadir Profile Ozone (OMPS) and OMPS (NP) Radiances X VIIRS RadiancesX Snow Cover X Vegetation Index X Aerosol Optical ThicknessX Sea Surface TemperatureX