COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, NDE Operational Status.

Slides:

Advertisements

Similar presentations

Community Satellite Processing Package NOAA Satellite Conference, 8-12 April 2013 Liam Gumley CIMSS/SSEC, UW-Madison Hurricane Sandy 2012/10/28 06:25 UTC.

Advertisements

NOAA’s NPOESS Data Exploitation (NDE) System Jim Yoe 1, Geof Goodrum 1, Jim Silva 1, Tom Schott 1 1. NOAA/NESDIS Office of Systems Development.

NPOESS Status Andrew Heidinger, VIIRS OAT co-chair and Jeff Key NOAA/NESDIS/Office of Research and Applications Madison, Wisconsin July 27, 2006.

2. Description of MIIDAPS 1. Introduction A Generalized Approach to Microwave Satellite Data Assimilation Quality Control and Preprocessing Here, we present.

DSCOVR Overview Mike Simpson and Doug Biesecker COPC November 4, 2014.

Reginald Lawrence Office of Systems Development

ESDA Discussion Spring 2015 COPC Meeting (NCEP, College Park, MD) May 27-28, 2015 Lamar Russell WG-CSAB Chair.

Himawari-8 Project Plans and Status. Background 2 NESDIS is implementing a capability to ingest Advanced Himawari Imager data from JMA, process and generate.

NDE Title Page NDE Briefing for JAG/ODAA NPP Data Exploitation September 13, 2011.

1 JPSS Proving Ground and Risk Reduction Mitch Goldberg, JPSS Program Scientist (NOAA) John Furgerson, JPSS User Liaison (NOAA) Ingrid Guch, STAR JPSS.

Recent Progress on High Impact Weather Forecast with GOES ‐ R and Advanced IR Soundings Jun Li 1, Jinlong Li 1, Jing Zheng 1, Tim Schmit 2, and Hui Liu.

Suomi National Polar-orbiting Partnership (SNPP) Data Access NOAA Satellite Conference April 8-12, 2013 Kevin Berberich NESDIS/OSD NDE Project Photographs.

Near Real-Time Data Access - PDA

Joint Polar Satellite System Harry Cikanek Director, Joint Polar Satellite System March 18, Science Week.

Environmental Satellite Product and Distribution System (ESPDS) GOES-R Access Subsystem (GAS) John Linn ESPDS System Engineering 7 October 2009.

2013 GOES-R AWG 2 nd Validation Workshop January 2014 Status of Activities and Plans for the GOES-R Core Ground System 1 Satya Kalluri Ph.D. GOES-R.

H-8 Project Update COPC May 27, H-8 Project Update JMA planning for full H-8 operations in July 2015 – Commissioning progressing well Data quality.

NOAA Satellite Conference April 8-12, 2013 Mary Kicza Assistant Administrator for Satellite & Information Services.

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 STAR and NPOESS Presented.

AWIPS-II Data Delivery Project Overview December 2013.

1 JPSS Engineering Review Board (ERB) Sea Surface Temperature (SST) Product Configuration Change Request (CCR) Evaluation 9 May 2014.

Reginald Lawrence, NOAA/NESDIS/OSD NOAA Direct Readout Conference

6.4 N2/N6E Project Review 06 Oct 2011 Project: Preparing Tactical Ocean Optical Products for Future Polar- Orbiting Sensors

NOAA Satellite Proving Ground/User Readiness Meeting

1 CIMSS Participation in the Development of a GOES-R Proving Ground Timothy J. Schmit NOAA/NESDIS/Satellite Applications and Research Advanced Satellite.

1 Requirements Gathering, Validation, and Concept Studies GOES Users’ Conference Boulder, CO October 1-3, 2002.

JAG/ODAA Fall 2008 James Vermeulen & Jon Whiteside JAG-ODAA Co-Chairs Recommend NCEP's Bradley Ballish replace Jon Whiteside (term completed)

NDE Title Page NDE NPOESS Data Exploitation Jim Yoe, Implementation Coordinator NPOESS Data Exploitation (NDE) Project NESDIS Office of Systems Development.

1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 POES Microwave Products Presented.

Mitch Goldberg National Oceanic & Atmospheric Administration | NOAA JPSS Program Scientist Ingrid Guch and Bill Sjoberg.

BACKUP XDRs and NDE PRODUCTS Fall 2010 COPC Meeting (AFWA – Offutt AFB) Jim Vermuelen FNMOC - Data Ingest Team Supervisor WG-CSAB Member JAG/ODAA Co-Chair.

Proving Ground All-Hands Meeting March 4 th, 2013 Presented by Eric Stevens March 4th, 2013Geographic Information Network of Alaska.

NDE May 28, FNMOCNDE Informational Update to the COPC1 Title Page NDE NOAA NPOESS Data Exploitation Update James Yoe NDE Systems Integration Coordinator.

Diane E. Wickland NPP Program Scientist NPP Science: HQ Perspective on VIIRS May 18, 2011.

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 Infrared Temperature and.

Use Of NPP Data In The Joint Center For Satellite Data Assimilation Lars Peter Riishojgaard, JCSDA Director IGARSS July

GOES-R Recommendations from past GOES Users’ Conference: Jim Gurka Tim Schmit Tom Renkevens NOAA/ NESDIS Tony Mostek NOAA/ NWS Dick Reynolds Short and.

NPP/Follow-On Phase months after NPP Launch JPSS contractor delivered xDRs  xDRs with To Be Confirmed (TBC) are products not currently provided.

10-OSPO/PDA Discussion COPC November 4, 2015 NESDIS/OSPO.

System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.

WG-CSAB Updates Spring 2013 COPC Meeting (FNMOC, Monterey, California) November 20-21, 2013 Dave McCarren WG-CSAB Chair.

Action Item NCEP Central Operations 4-5 November 2015 COPC – Fall 2015.

NOAA Satellite Proving Ground/User Readiness Meeting Ming Ji Director, Science & Technology Integration National Weather Service June 15,

Early Results from AIRS and Risk Reduction Benefits for other Advanced Infrared Sounders Mitchell D. Goldberg NOAA/NESDIS Center for Satellite Applications.

NDE NOAA NDECOPC Meeting Offutt AFB November 13, Title Page NDE NPOESS Data Exploitation – NESDIS James G. (Jim) Yoe, NESDIS/OSD NDE Integration.

Blended Sea Surface Temperature EnhancementsPolar Winds Blended Hydrometeorological Products Blended Total Ozone Products are derived by tracking cloud.

Joint Polar Satellite System (JPSS) John Furgerson, NOAA User Liaison Joint Polar Satellite System.

NDE 14 November 2007Briefing to NCEP1 Title Page NDE Project Overview Information Briefing to COPC James Silva NPOESS Data Exploitation Project Manager.

1 FY14 JPSS Annual Review For Satellite Product Development NCWCP (College Park) Room June 2013 Conference Number: Pass Code:

Session 2 Conclusion: Future Product Development Activities Science Advisory Committee Meeting 26 – 28 August, 2014 National Space Science and Technology.

DOD NPOESS Data Exploitation COPC Action Item ,11 Jim Vermeulen 21 October 2008.

ESPC CIP Update November 7, COPC Action Item  NESDIS is currently in the process of reviewing and planning upgrades for the critical infrastructure.

N A T I O N A L O C E A N I C A N D A T M O S P H E R I C A D M I N I S T R A T I O N NPP DATA ACCESS Mitch Goldberg JPSS Program Scientist June 21, 2012.

Ocean Color Research Team Meeting May 1, 2008 NPOESS Preparatory Project (NPP) Status Jim Gleason NPP Project Scientist.

NDE NPOESS Data Exploitation NPOESS Data Exploitation (NDE) George Serafino NOAA Environmental Satellite Processing Center (ESPC) Jim Silva NDE Project.

CGMS-43-NOAA-WP-03 Coordination Group for Meteorological Satellites - CGMS PDA Product Distribution & Acquisition by NOAA Presented to CGMS-43 Plenary.

2016 Satellite Proving Ground/User-Readiness Meeting (May 9-13, 2016) Chris Sisko Mission Operations: ESPC Enterprise Product.

Microwave Integrated Retrieval System System provides data products from microwave instruments in all weather and all surface conditions. Products will.

NOAA, May 2015 Coordination Group for Meteorological Satellites - CGMS Add CGMS agency logo here (in the slide master) Coordination Group for Meteorological.

Suomi NPP Sounding EDR Validation and Evaluation Zhenglong Li #, Jun Li #, Yue Li #, Timothy J. and Christopher D. # Cooperative Institute.

1 NWS Expectations Satellite Data CONOPS Mike Johnson.

NOAA, May 2014 Coordination Group for Meteorological Satellites - CGMS NOAA Activities toward Transitioning Mature R&D Missions to an Operational Status.

Overview of JPSS and GOES-R Data Assimilation in Global Numerical Weather Prediction Models Presented by Jim Yoe NWS National Centers for Environmental.

Transition of Science Algorithms into Enterprise Product Generation Operations 2016 AMS Annual Meeting Dylan Powell, Ph.D. Lockheed Martin ESPDS Science.

NOAA NPOESS PREPARATION ACTIVITIES Gene Legg Office of Satellite Data Processing And Distribution Asia Pacific Satellite Data Exchange and Utilization.

Band 14 (11um) Winds Low-Level >700 mb Mid-Level mb High-Level mb   NPP VIIRS Polar Winds Products The GOES-R AWG Derived Motion Winds.

Satellite Information Flow

SNPP Regional Retransmission Service: Plans and Status of Implementation Presented to CGMS-43 Working Group 1 session, agenda item 6.

SNPP VIIRS Aerosol Product Latencies

Presentation transcript:

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, NDE Operational Status PDA Update Presented by: Keith Amburgey Prepared by: Chris Sisko NESDIS/OSPO Telephone:

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, Presentation Outline NPP Data Exploitation (NDE) System Latest Status Operational Products PDA Status PDA Overview PDA / DAPE Note on schedule Operational Prioritization Final notes 2

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, NDE (Current Ops System) Status 3

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, NDE Operational Status NDE Operational System (PE1) is functioning as intended. NDE Operational System (PE1) is the largest single distribution system within ESPC – SNPP daily data volumes are 100 times larger than all our other supported missions combined. NDE I&T system (PE2) is highly utilized and fully supports numerous activities: ground system maintenance releases, algorithm changes, bug fixes, production rule updates, tailoring functions, improvements to data handling and database updates/optimization. 4 Sep 2013 (initial operations) Today Number of users (subscriptions)3 (12)29 (310) Average Data Ingest*~70 TB~130 TB Production Success*> 99.9% Distribution Success*> 99.5%> 99.9% Average Data Distributed*~10 TB~40 TB

NDE Operational Products 5 Application Short Name Application NameProduct NameFormatSatellite ACSPO SST Advanced Clear Sky Processor for Oceans (NDE) - SST SST, Clear Sky MasknetCDFSNPP AOTAerosol Optical ThicknessVIIRS Aerosol Optical Thickness (NDE)BUFRSNPP ATMS-SDRATMS SDR radiancesATMS SDR radiances 22 channels (NDE)[BUFR]SNPP CRIS-SDR-399CrIS SDR radiances 399 CrIS IR sounder SDR radiances 399 channels for NWP data assimilation (NDE) [BUFR]SNPP CRIS-SDR-1305CrIS SDR radiances 1305 CrIS IR sounder SDR radiances 1305 channels for NWP data assimilation (NDE) BUFRSNPP NUCAPS Level 2 NOAA Unique CrIS ATMS product System Level 2 CrIS/ATMS Atmos Temp Profile CrIS/ATMS Atmospheric Moisture Profile [netCDF]SNPP MIRS ATMS Microwave Integrated Retrieval System (NDE) - ATMS MIRS ATMS image products MIRS ATMS SND products [netCDF]SNPP OMPS-NPOMPS nadir profileOzone nadir profile (NDE)BUFRSNPP OMPS-TCOMPS total columnOzone total column (NDE)BUFRSNPP VIIRS-EDRVIIRS EDRVIIRS EDR (NDE)netCDFSNPP VIIRS-SDRVIIRS SDRVIIRS SDR (NDE)netCDFSNPP VIIRS Binary Snow Cover VIIRS Binary Snow MapnetCDFSNPP VPWVIIRS Polar Winds [BUFR], netCDF SNPP Products for DoD currently sent from the NDE system to DAPE Products in the queue for DoD; will eventually be sent from the NDE system to DAPE Upcoming Operational Products (SPSRB schedule) Vegetation Health (June 2015) GCOM  NDE 1.0 (TBD)

6 Application Short Name Application NameProduct NameFormatSatellite ACSPO SST Advanced Clear Sky Processor for Oceans (NDE) - SST SST, Clear Sky MasknetCDFSNPP AOTAerosol Optical ThicknessVIIRS Aerosol Optical Thickness (NDE)BUFRSNPP ATMS-SDRATMS SDR radiancesATMS SDR radiances 22 channels (NDE)BUFRSNPP CRIS-SDR-399CrIS SDR radiances 399 CrIS IR sounder SDR radiances 399 channels for NWP data assimilation (NDE) BUFRSNPP CRIS-SDR-1305CrIS SDR radiances 1305 CrIS IR sounder SDR radiances 1305 channels for NWP data assimilation (NDE) BUFRSNPP GVF Green Vegetation Fraction – 7 day productGrib2SNPP NUCAPS Level 2 NOAA Unique CrIS ATMS product System Level 2 CrIS/ATMS Atmospheric Temp Profile CrIS/ATMS Atmospheric Moisture Profile netCDFSNPP NTCPTropical Cyclone ProductsATMS Microwave Tropical Cyclone Product ATCF Ascii SNPP MIRS ATMS Microwave Integrated Retrieval System (NDE) - ATMS MIRS ATMS image products MIRS ATMS SND products netCDFSNPP OMPS-NPOMPS nadir profileOzone nadir profile (NDE)BUFRSNPP OMPS-TCOMPS total columnOzone total column (NDE)BUFRSNPP VIIRS-EDRVIIRS EDRVIIRS EDR (NDE)netCDFSNPP VIIRS-SDRVIIRS SDRVIIRS SDR (NDE)netCDFSNPP VIIRS Binary Snow Cover VIIRS Binary Snow MapnetCDFSNPP VPWVIIRS Polar Winds BUFR netCDF SNPP NDE Operational Products Upcoming Operational Products (SPSRB schedule) Vegetation Health (June 2015) GCOM  NDE 1.0 (TBD) Products for DoD currently sent from the NDE system to DAPE Products in the queue for DoD; will eventually be sent from the NDE system to DAPE

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, Final Operational Notes Today, the NDE Operational System (PE1) provides operational products to the DAPE. The 557 th receives data directly from the IDPS (JPSS Ground System). In the future: NDE 2.0 / PDA, will provide new mission data directly to USN and USAF (557th Weather Wind). DAPE will continue to provide legacy mission data as those missions fly out. 7

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, PDA Status 8

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, PDA Overview Product Distribution and Access (PDA) – NESDIS’s enterprise distribution for real-time users. Supports only secure transfer protocols (SFTP, FTP-S and HTTPS – pull only) Provides NESDIS with a scalable SOA based architecture that functions as a high availability and high performance Provides searchable catalog and flexible web interface for users to access the system. Enables users to directly manage their data subscriptions (within their allowed daily data volume limits) while OSPO can focus more efforts on management of the system. Provides users with the ability to tailor products in order to meet their unique mission requirements. PDA has three system strings: I&T, NSOF Ops and CBU Ops strings. PDA increment 2.5 provides full user functionality, including the user interface (recently deployed/integrated). PDA is being deployed into a new ESPC network that will have an initial external capacity of 28 Gbps; scalable to 40 Gbps. PDA at NSOF will support many missions, but PDA at CBU only supports JPSS. 9

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, PDA / DAPE Next PDA enhancement priority: core functions for processing and distributing Himawari-8 data. Access to new datasets will be serviced from PDA while DAPE will maintain data continuity of its existing product suite to DoD. Current NESDIS position regarding DAPE and PDA: - continue supporting/sustaining DAPE in terms of legacy data flow - new data requests will be serviced by PDA This current strategy will eliminate potential disruptions to existing services while the final path forward regarding DAPE functionality is determined; this approach also gives DoD an opportunity to build confidence with PDA distribution. For current NDE operations (now) – ESPC feeds DAPE for DoD’s additional SNPP data needs. For future NDE 2.0/PDA operations (upcoming) - ESPC feeds DoD directly any new mission data they require; legacy product distribution will remain on DAPE. 10

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, PDA Schedule I&I activities and Qualification Site Test Dry Runs are underway. Remaining PDA schedule is aligning with JPSS Block 2.0 schedule activities. Validation period runs from July 20 th, 2015 to October 20 th, Operational Readiness Review (ORR) in the early Dec, 2015 time frame. 11

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, User Operational Prioritization – PDA has the ability to shed lower priority users to ensure data continuity is maintained to mission critical users, unlike systems in use today. DoD users are priority 1. 12

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, Summary NDE system has been operational for well over a year; ~85% of the new NDE (product generation system) will be the same when NDE 2.0 and PDA become operational. PDA utilizes common transfer protocols and the performance of the system is driven by GOES-R requirements to rapidly ingest, process and make available data to meet user’s real-time needs. Continue to support DAPE for DoD’s existing legacy data flow purposes and to move new data requirements to the PDA enterprise system as the least disruptive approach until subject matter experts can analyze the best path forward. Latest scheduled information for PDA ORR is mid-Dec 2015 time frame. 13

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, Questions or Comments? 14