Describe the Process and Prospects for Adding Data Products to the SBN and AWIPS Software Baseline Advanced Weather Interactive Processing System (AWIPS)

Slides:



Advertisements
Similar presentations
Transitioning unique data and research technologies to operations EPDT Experimental Products Development Team Session AWIPS/RGB Part I Matt Smith.
Advertisements

Sustaining National Meteorological Services Dr. Louis W. Uccellini Director, National Weather Service Riverdale, MD June 18, 2013.
Integrated Regional Modeling Geoff DiMego EMC Stan Benjamin GSD Steve Weiss & Israel Jirak SPC Dave Novak & Wallace Hogsett WPC David Bright AWC, Joe Sienkiewicz.
2014 WAF/NWP Conference – January 2014 Precipitation and Temperature Forecast Performance at the Weather Prediction Center David Novak WPC Acting Deputy.
NCEP Production Suite Review NWS Integrated Dissemination Program
NWS Pacific Region “Preparing for GOES-R with Himawari-8” Bill Ward National Weather Service Pacific Region Headquarters Honolulu, Hawaii Wednesday, February.
Regional Ensembles Into 2020: A Possible Vision Geoff DiMego December 3, “Where America’s Climate, Weather, Ocean.
“Where America’s Climate, Weather and Ocean Services Begin” NCEP CONDUIT UPDATE Brent A Gordon NCEP Central Operations January 31, 2006.
Rapid Refresh and RTMA. RUC: AKA-Rapid Refresh A major issue is how to assimilate and use the rapidly increasing array of off-time or continuous observations.
1 GOES Users’ Conference October 1, 2002 GOES Users’ Conference October 1, 2002 John (Jack) J. Kelly, Jr. National Weather Service Infusion of Satellite.
National Weather Service WFO Operations 1979 vs 2014 Steve Zubrick Science and Operations Officer (SOO) Baltimore-Washington Weather Forecast Office “Advances.
Technology Steering Group January 31, 2007 Academic Affairs Technology Steering Group February 13, 2008.
1 Mike Ek, for Hendrik L. Tolman Acting Director, Environmental Modeling Center NOAA/NWS Geoff DiMego, John Derber, Yuejian Zhu, Vijay Tallapragada, Shrinivas.
1 WRF Development Test Center A NOAA Perspective WRF ExOB Meeting U.S. Naval Observatory, Washington, D.C. 28 April 2006 Fred Toepfer NOAA Environmental.
National Blend of Global Models An Overview
Transitioning unique data and research technologies to operations Experimental Products Development Team (EPDT) Jason Burks NASA SPoRT.
NCEP Overview “Where America’s Climate, Weather, Ocean and Space Weather Services Begin” Dr. Louis W. Uccellini National Centers for Environmental Prediction.
Evolution of Advanced Weather Interactive Processing System (AWIPS): AWIPS II Migration and Vision for the Next Decade 30th AMS Conference on Environmental.
1 NOAA’s Environmental Modeling Plan Stephen Lord Ants Leetmaa November 2004.
Evolution of AWIPS Jason Tuell Office of Science and Technology.
1 National Weather Service AWIPS Software Recommendation and Evaluation Committee (SREC) Monthly Status Meeting August 28, 2006 Systems Engineering Center.
NOAA’s Advances in Storm Surge Modeling & Prediction “Weather-Ready Nation: Saving Lives and Livelihoods” Jason P. Tuell, Ph.D National Weather Service.
AWIPS-II Data Delivery Project Overview December 2013.
Providing data services, tools and cyberinfrastructure leadership Unidata Policy Committee May 2011 Organizational Collaboration, Participation,
NOAA Satellite Proving Ground/User Readiness Meeting
Woody Roberts Tom LeFebvre Kevin Manross Paul Schultz Evan Polster Xiangbao Jing ESRL/Global Systems Division Application of RUA/RTMA to AWIPS and the.
Satellite Products Dissemination Brian Gockel NOAA/NWS Office of Observations June 16, Satellite Proving Ground/User-Readiness Meeting.
Collaborating on the Development of Warn-On-Forecast Mike Foster / David Andra WFO Norman OK Feb. 18, 2010 Mike Foster / David Andra WFO Norman OK Feb.
Chawla et al., Dec NCEP production suite review, 1/18 Review of the NCEP production Suite: Recent Changes and Plans Marine Modeling and Analysis.
1 Agenda Topic: National Blend Presented By: Kathryn Gilbert (NWS/NCEP) Team Leads: Dave Myrick, David Ruth (NWS/OSTI/MDL), Dave Novak (NCEP/WPC), Jeff.
Rebecca Cosgrove NCEP/NCO/Production Management Branch March 26, 2015
UMAC data callpage 1 of 16Nearshore Wave Prediction System (NWPS) EMC Operational Models Nearshore Wave Prediction System (NWPS) André van der Westhuysen.
Office of Coast Survey Improving NOAA’s Capacity to Address Coastal Inundation Events Jesse C. Feyen, Ph.D. Storm Surge Roadmap Portfolio Manager Acting.
1 “Where America’s Climate, Weather and Ocean Services Begin” FY16 Production Suite Plans Rebecca Cosgrove Chief, Production Management Branch, NCO August.
Building the Future of the NWS: NCEP Product Suite Review Dr. Louis W. Uccellini Director, National Weather Service College Park, Maryland NOAA Assistant.
TOWR-G Test for Operational Weather Readiness with GOES-R Joe Zajic NWS Office of Science & Technology – Science Plans Branch Integrity Applications Incorporated.
APPLICATION OF NUMERICAL MODELS IN THE FORECAST PROCESS - FROM NATIONAL CENTERS TO THE LOCAL WFO David W. Reynolds National Weather Service WFO San Francisco.
NOAA Hazardous Weather Test Bed (SPC, OUN, NSSL) Objectives – Advance the science of weather forecasting and prediction of severe convective weather –
1 Future NCEP Guidance Support for Surface Transportation Stephen Lord Director, NCEP Environmental Modeling Center 26 July 2007.
NCEP Central Operations March, 2015 NAWIPS Migration to AWIPS II Status Updates 2015 Unidata Users Committee.
Transitioning unique data and research technologies to operations Experimental Products Development Team (EPDT) Jason Burks NASA MSFC SPoRT.
Objectives: Define and implement a website layout that enables users to find key information efficiently Develop a process to ensure the sustainability.
UCACN Model Advisory Committee: Kickoff Meeting Dr. William M. Lapenta Director, National Centers for Environmental Prediction NOAA/National Weather Service.
Predictability of High Impact Weather during the Cool Season over the Eastern U.S: CSTAR Operational Aspects Matthew Sardi and Jeffrey Tongue NOAA/NWS,
Hydrometeorological Prediction Center Preparing for GOES-R at HPC David Novak Science and Operations Officer With contributions from Ed Danaher 2011 GOES-R.
NCEP Suite Review December 2013 Alaska Region Rick Thoman ESSD Climate Science and Services Manager.
1 Aviation Forecasting – Works in Progress NCVF – Ceiling & Visibility CoSPA – Storm Prediction A Joint Effort Among: MIT Lincoln Laboratory NCAR – National.
1 Director’s Update of the National Centers for Environmental Prediction COPC Meeting Offutt Air Force Base May 15-16, 2002 Dr. Louis Uccellini Director,
Software Development Status Update Advanced Weather Interactive Processing System (AWIPS) Program December 9, 2015 Edward Mandel CP/Software/Development.
The Unidata-NCEP Partnership: Transferring Model Output and Software to the University Community Dr. Louis W. Uccellini Director National Centers for Environmental.
Evolving the NCEP Production Suite Dr. William M. Lapenta Director, National Centers for Environmental Prediction NOAA/National Weather Service NCEP Production.
DTC Overview Bill Kuo September 25, Outlines DTC Charter DTC Management Structure DTC Budget DTC AOP 2010 Processes Proposed new tasks for 2010.
Fly - Fight - Win 2 d Weather Group Mr. Evan Kuchera HQ AFWA 2 WXG/WEA Template: 28 Feb 06 Approved for Public Release - Distribution Unlimited AFWA Ensemble.
1 National Weather Service AWIPS Software Recommendation and Evaluation Committee (SREC) Status Meeting June 5, 2006 Systems Engineering Center.
Subcommittee on Hydrology, ACWI New Extreme Storm Work Group Status and Plans.
AWIPS II Update Shannon White. AWIPS I Status Have had monthly AWIPS I builds to address security patches and critical bug fixes A few builds have contained.
AWIPS Governance What are we Governing? –EDEX/CAVE plugins developed for an operational AWIPS system Out of Scope: GFE Smart inits and tools, µengine.
Marine Modeling and Analysis Branch Ocean Waves.
1 National Weather Service AWIPS Software Recommendation and Evaluation Committee (SREC) Status Meeting May 1, 2006 Systems Engineering Center.
1 NWS Expectations Satellite Data CONOPS Mike Johnson.
2nd Annual Technical and Strategic Review of the NCEP Production Suite (NPS) 9-11 August 2016, NOAA Science Center, Silver Spring, MD Project Charter Template.
Ocean Prediction Center
Jason Levit NOAA NextGen Weather Program June, 2013
SNPP Regional Retransmission Service: Plans and Status of Implementation Presented to CGMS-43 Working Group 1 session, agenda item 6.
The Challenge of Data Delivery to Our Field Offices
WRN Workshop NWS Funding Opportunities
NPRS December 7, 2011.
WMO NWP Wokshop: Blending Breakout
Rebecca Cosgrove NCEP/NCO/Production Management Branch April 11, 2011
Presentation transcript:

Describe the Process and Prospects for Adding Data Products to the SBN and AWIPS Software Baseline Advanced Weather Interactive Processing System (AWIPS) Program December 4, 2013 Edward Mandel OST/SEC/Development Branch Chief

2 Challenges Unable to add new functionality until AWIPS migration is completed Lack of SBN bandwidth and NWSTG/NCF limitations Large number of data products desired by field Lack of a documented end to end process with clear roles and responsibilities Doesn’t include elimination of obsolete products Lack of resources to perform key planning functions Software development, Engineering, and Management Questionable quality and lack of visibility of existing plans

3 Challenges Addressed Unable to add new functionality until AWIPS migration is completed AWIPS Migration Status – moving to second group of sites – page 4 Lack of SBN bandwidth and NWSTG/NCF limitations SBN Expansion Status – Page 5 NWSTG Limitations – TG/NCF interface problems resolved, IDP plans include the TG re- architecture (FY16/17) Lack of a documented end to end process with clear roles and responsibilities Process for Adding Data with Roles and Responsibilities – Page 6 o Includes identifying data sets to be retired (obsolete) and removed from the SBN Identified POCs – Page 7 Lack of resources to perform key engineering and management functions Assign a full time Data Manager using AWIPS O&M Redefining R&R to fill gaps in engineering and management Lack of or questionable quality of existing plans Established framework for maintaining an Activation Plan Established early approval of AWIPS release content including commitment of development resources to improve accuracy of release assignments

4 AWIPS Migration Status Activation Plan o Working through WFO sites in groups of 8 Group 1 sites activated on 11/7/13 OAX, BOU, OUN, HGX, HUN, BYZ, BOX, and RNK Group 2 sites begin 30-day test on 12/9/13 ARX, MKX, PQR, DMX, RAH, BOI, SLC, and AFG Group 3 sites begin test period tentatively on 2/3/14 GJT, GID, PUB, OTX, AFC, CTP, MFL, and MRX Group 4 sites – tentatively scheduled to begin 3/28/14 GLD, DDC, HNX, VEF, ILN, TAE, JAX, EKA, and FSD Release Schedule (Dates are Release Available, except where noted) o AWIPS I - OB9.14 OB9.15 – 2/18/2014 OB /21/2014 o AWIPS II - OB * OB – 12/16/2013 OB – 3/31/2014 OB – 5/19/2014 (code check-in - 1/23/2014) OB – 7/14/2014 (code check-in - 3/20/2014 * - groups not upgraded to most recent release during 30 day test

5 SBN Expansion Specifics o Increased from 10Mbps to 30Mbps - Phase 1 (late 2011) o Increase Bandwidth from 30Mbps to 60+ (max of 75Mbps) - Phase II (Dec 2014/Jan 2015) Main drivers for expansion are o GOES-R, Joint Polar Satellite System (JPSS), NCEP/WCOSS and other grid guidance analysis and forecasts Managed by APO and IDP/GRP, execution by Raytheon, and paid for by Sandy Relief Appropriations

Process to Add Data Products 6

7 Data Management Team Data Manager POC: Dave Niver (Raytheon) Data Provider POCs: NCEP (Rebecca Cosgrove), NESDIS (John Paquette), MDL (Kathryn Gilbert), NSSL (TBD), GSD (Woody Roberts), Radar (Mike Istok), regional and local data product providers. Data Advocate POC: Data Provider, OCWWS (Cindy Woods), Region and Site personnel SREC Manager POC: Robert Rood (OST/SEC/Development Branch) Development Manager POC: Ana Rivera (OST/SEC/Development Branch) APO/Baseline Configuration Control Board (BCCB) POC: Steve Schotz (OST/PPD/Program Management Branch OCWWS/TINs, SCNs, PNSs POC: Michael Baker (OCWWS)

Plans – Data Activation and Release Content With challenges addressed, started in November 2013 to aggressively: –Began initial planning of data activations - Page 9 and 10 –Began initial re-planning of AWIPS Release Content to support data products - Page 11 and 12 Goal is to establish Future Data Activations and AWIPS Software Release content plans for FY14/15 –FY14 content - February 2014 –FY15 (2Q) – April

9 Data Activation Plan Planned Data Activations Add 2.5 km WPC Medium Range Grids DRG RC AI DR + AWIPS2_DR_16629 AWIPS I: TBD, AWIPS II: Released in OB Rationale: High priority NCEP Proposed Activation: Nov 11 Add GOES Sounder Derived Product Imagery (DPI) for the Pacific Region DRG RC AWIPS 1 and AWIPS II: Requirements defined Rationale: High priority (PR) Activation: Dec 17, 2013 New Real Time Mesoscale Analysis (RTMA) parameters and Alaska resolution increase DRG RC AWIPS II: Requirements Defined Proposed Activation Jan 28, 2014 Select Grids from Individual Members of the Short Range Ensemble Forecast System (SREF) to support Ensemble River Forecasts DRG RC No AWIPS software changes required Rationale: High Priority ER, supports RFCs Proposed Activation: Feb 18, 2014

10 Data Activation Plan Planned Data Activations Add Gridded Data from the Atlantic and Global Real Time Ocean Forecast System (RTOFS) Model DRG RC AWIPS II: Requirements are TBD Rationale: Supports FY14 Hurricane initiatives Activation: Feb 2014 High Frequency Radar Surface Current Velocity Data DRG RC AWIPS II: Requirements defined Rationale: Support marine-related impact-based decision support services (IDSS) (e.g. Search and Rescue; Deep-water Horizon) Activation: Feb 2014 Extra Tropical Storm Surge Needs for AWIPS II (ESTOFS) DRG RC AWIPS II: Requirements defined Rationale: Supports FY14 Hurricane initiatives Proposed Activation: March 2014 S-NPP NUCAPS Soundings DRG RC Proposed Activation: March 13, 2014 S-NPP Near Constant Contrast (NCC) Proposed Activation: Sept 2014

11 AWIPS Release Content Planned Software Release for Data Products OB – May 19, 2014 (Approved) GLD360 Lightning Data OB – July 14, 2014 (Requires Approval) Total Lightning Data (Product Set #1 - CG point data and Grid of IC and CG) Tropical Storm Surge Data (PHISH, SLOSH, Tide) High Frequency Radar Surface Current Data New Real Time Mesoscale Analysis (RTMA) parameters and Alaska RTMA resolution increase OB – Sept 2014 TBD OB – December 2014 TBD

Future Data Activations and AWIPS Software Release Plan 12 SREC High Priority Data Candidates Extra-tropical Storm Surge Needs for AWIPS II (ESTOFS, ETTS) Gridded Data from the Atlantic and Global Real Time Ocean Forecast System (RTOFS) Model Multi-grid WAVEWATCH III Hurricane Wave Model Hurricane Weather Research and Forecasting Model (HWRF) High Resolution Window – PR, Guam Downscaled NWP Grids (DNG) of Sensible Hydromet Elements (GFS 2.5km) High Resolution Rapid Refresh (HRRR) model Global Forecast System every 3 hours North American Model every 1 hour UKMET grids hrs. UKMET (ECMWF and HIRES) data to display in southern hemisphere Global Ensemble Forecast System (GEFS) Gridded MOS Gridded LAMP EKDMOS S-NPP Near Constant Contrast (NCC) Satellite Precipitation Estimates/Global Hydro-Estimator Current locally ingested data (e.g., NOGAPS, ECMWF-HIRES, COMAPS)

13 Remaining Challenges Still lack of SBN bandwidth and large number of tasks Still need to document, communicate and train an end to end process with clear roles and responsibilities Still lack of resources to perform key development functions Still need to improve visibility of SBN Activation Plans and AWIPS Release Plans

14 Remaining Challenges and Planned Action Still limited bandwidth and large number of tasks. Possible Action: Establish a Data Advisory Board to provide a strategic high level vision and prioritization, and provide advice on best methods to meet the need (e.g. use of Data Delivery). This board would work directly with the SREC. Still need a documented, communicate and train an end to end process with clear roles and responsibilities Action: SEC will prepare a document that describes the process, and roles and responsibilities Action: SEC will establish a charter for the Data Management Team Action: SEC will establish training sessions for Data Providers and Data Advocates Still limited development resources Action: Look for additional resources or FTEs, but still need to rely on volunteers from other development communities including regions and sites. Prospect is low. Still need to improve visibility of plans Action: Establish a Data Management Team led by the Data Manager and made up of Data Providers, Data Advocates, Development Manager, SREC Manager, SBN engineers, TG, and OCWWS to prepare the Activation Plan Action: Data Manager will provide monthly reports to the Data Management Team and report out monthly to the SREC and possibly the Data Advisory Board.