We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byAmelia Powell
Modified over 2 years ago
© Crown copyright Met Office WAFC CAT verification Objective verification of GRIB CAT forecasts Dr Philip G Gill, WAFC Science Meeting, Washington, 20 April 2009
© Crown copyright Met Office Contents This presentation covers the following areas Introduction SIGWX forecast comparison Aircraft data Verification methodology Verification results Summary Further improvements
© Crown copyright Met Office Introduction What – Objective verification of gridded binary (GRIB) and significant weather (SIGWX) Clear Air Turbulence (CAT) forecasts Where – Global verification When – November 2008 to January 2009 Why – To demonstrate the quality of the new GRIB forecasts using objective verification. How – Verification against aircraft observations from the Global Aircraft Data Set (GADS)
© Crown copyright Met Office SIGWX and GRIB CAT forecasts SIGWX chart New GRIB forecast
© Crown copyright Met Office Comparison of SIGWX charts UKUSUK&US
© Crown copyright Met Office SIGWX CAT forecast comparison One month UK-US comparison (January 2009) Average coverage of globe UK ~6%, US ~3% Percentage overlap of all forecasts between UK and US ~20% Areas forecast by both UK and US Areas forecast by UK but not USAreas forecast by US but not UK
© Crown copyright Met Office GRIB forecast comparison produced by HKO
© Crown copyright Met Office Global Aircraft Data Set Archive of aircraft data set up by Joel Tenenbaum (State University of New York) British Airways fleet of Boeing aircraft Global coverage, but flights mainly over northern hemisphere Automated aircraft observations every 4 seconds Indicator of turbulence derived from vertical acceleration, aircraft mass, altitude and airspeed called the derived equivalent vertical gust (DEVG).
© Crown copyright Met Office GADS Data coverage January 2007
© Crown copyright Met Office Verification methodology
© Crown copyright Met Office Forecast assessment Turbulent/non turbulent event defined on 10min aircraft track ~120km - approx grid size Forecast turbulent event – CAT potential >= Threshold Observed turbulent event - DEVG>=2m/s Construct 2x2 contingency tables for each threshold Sum entries in contingency tables over the verification period Produce a Relative Operating Characteristic (ROC) curve by plotting the Hit rate against False alarm rate for each threshold. Turbulence observed No turbulence observed Turbulence forecast HitFalse alarm No turbulence forecast MissCorrect rejection 2x2 contingency table
© Crown copyright Met Office Results UK GRIB and SIGWX ~ events
© Crown copyright Met Office Variation with forecast range ~ events
© Crown copyright Met Office Latitudinal variation UK GRIB 50N to 90N ~ events 50S to 20S ~8 000 events 20N to 50N ~ events 20S to 20N ~ events
© Crown copyright Met Office UK and US Nov 2008 and Jan 2009 ROC curve ~ events
© Crown copyright Met Office UK and US latitudinal variation ~ events
© Crown copyright Met Office UK GRIB and SIGWX ~ events SIGWX Automation (SWAM) - UK automated SIGWX chart production system based on GRIB data
© Crown copyright Met Office Summary of results Both UK and US GRIB products show more skill than the manual SIGWX products. Global UK and US GRIB CAT forecasts score similarly Slight difference in scores as forecast range increases Some differences in scores at individual latitude bands – best performance between 20N and 90N. UK CAT coverage on SIGWX charts greater than the US
© Crown copyright Met Office Further improvements Automate verification process Produce statistics by ICAO and WMO regions Improve consistency of forecasts by analysing verification data and altering production systems. Use verification to test future model upgrades and re- tune algorithms
© Crown copyright Met Office Questions and answers
© Crown copyright Met Office WAFC turbulence and Cb hazard verification Recent results and future plans Dr Philip G Gill WAFSOPSG 7/14, 30 th April 2013.
© Crown copyright Met Office Scientific background and content of new gridded products Bob Lunnon, Aviation Outcomes Manager, Met Office WAFS Workshop.
WAFS Workshop on the Use and Visualization of Gridded SIGWX Forecasts September 2009.
Page 1© Crown copyright Operational Use of ECMWF products at the Met Office: Current practice, Verification and Ideas for the future Tim Hewson 17 th June.
© Crown copyright Met Office GRIB Visualization of data GRIB Web Pages Lauren Reid, Met Office, WAFSOPSG Paris th September 2009.
© Crown copyright Met Office Lightning Detection Systems Roger Carter, Spectrum Manager, UK Met Office ITU/WMO SEMINAR ON USE OF RADIO SPECTRUM FOR METEOROLOGY.
Richard (Rick) Jones SWFDP Training Workshop on Severe Weather Forecasting Bujumbura, Burundi, Nov 11-16, 2013.
© Crown copyright Met Office Use of GRIB hazard forecasts in flight planning Bob Lunnon, Aviation Outcomes Manager, Met Office WAFS Science meeting, Washington,
© Crown copyright 2007 Impact studies with satellite observations at the Met Office John Eyre and Steve English Met Office, UK 4th WMO Workshop on "The.
ECMWF Slide 1Met Op training course – Reading, March 2004 Forecast verification: probabilistic aspects Anna Ghelli, ECMWF.
Clouds and their turbulent environment Robin Hogan, Andrew Barrett, Natalie Harvey Helen Dacre, Richard Forbes (ECMWF) Department of Meteorology, University.
Robin Hogan Ewan OConnor University of Reading, UK What is the half-life of a cloud forecast?
Page 1© Crown copyright 2005 Use of EPS at the Met Office Ken Mylne and Tim Legg.
Page 1© Crown copyright 2004 Presentation to ECMWF Forecast Product User Meeting 16th June 2005.
DTC Verification Workshop - Boulder April Inference Methods Ian Jolliffe Inference Methods Ian Jolliffe.
Environment Canada Meteorological Service of Canada Environnement Canada Service Météorologique du Canada Canadian Aviation Forecast Verification WMO Workshop.
Page 1© Crown copyright Some Strengths and Weaknesses of ECMWF Forecasts for the UK Tim Hewson 15 th June 2006 Contributors include: Eleanor Crompton,
© Crown copyright Met Office Investigating a perturbed physics scheme in a wave ensemble system Ray Bell (Line manager: Francois-Bocquet) Ocean Iced Tea.
Arctic observing system for regional NWP Harald Schyberg (met.no), Frank Thomas Tveter (met.no) Roger Randriamampianina (met.no), Trygve Aspelien (met.no)
Regional Models Lake Victoria Model Prepared by C. Tubbs, P. Davies, Met Office UK Revised, delivered by P. Chen, WMO Secretariat SWFDP-Eastern Africa.
© Crown copyright Met Office E-AMDAR evaluation. Mark Smees & Tim Oakley, Met Office, May 2008.
History of IATA requirements for gridded ICE, TURB and CB Cloud Products.
Robin Hogan Julien Delanoe, Ewan OConnor, Anthony Illingworth, Jonathan Wilkinson University of Reading, UK Quantifying the skill of cloud forecasts from.
Climate Modeling LaboratoryMEASNC State University An Extended Procedure for Implementing the Relative Operating Characteristic Graphical Method Robert.
Topic 2 International Winds Working Group (IWWG) 11 th Workshop -- AMV Impact Studies David Santek and Chris Velden Cooperative Institute for Meteorological.
CP4O Progress meeting 1 - Frascati November WP 5000 – Impact Assessment S. Labroue, T. Moreau, P. Thibaut (CLS) N. Picot, F. Boy (CNES)
A Panel Pilot Study for English Business Survey Presented by Yi Zhang Department for Business, Innovation and Skills.
© Crown copyright Met Office Future Upper-Air Network Development (FUND) WMO ET-UASI, Payerne June 2008, Agenda Item 3.4.
Robin Hogan Ewan OConnor Julien Delanoe Anthony Illingworth Use of ground-based radar and lidar to evaluate model clouds.
Future impacts on sewer systems in England and Wales Overview of a project for Ofwat Presented to the Water Statistics Group Andrew Heather and Adam Grove.
© 2016 SlidePlayer.com Inc. All rights reserved.