We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byHarrison Froom
Modified over 2 years ago
© 2013 IBM Corporation 111 Statistical Forecasting of Rainfall from Radar Reflectivity in Singapore Lloyd Treinish 1, Xiao Liu 2, Vikneswaran Gopal 3 and Reza Hosseini 2 1 IBM T.J. Watson Research Center 2 IBM Research Collaboratory Singapore 3 Department of Applied Probability and Statistics, National University of Singapore 22nd Conference on Probability and Statistics in the Atmospheric Sciences AMS Annual Meeting, Atlanta, 2014 Session: Statistical model development, statistical forecasting approaches, and ensemble forecasting part 1
© 2013 IBM Corporation 2 Agenda Introduction – Background and Objectives – Data Marshall-Palmer relationship Recalibration of the Z-R relationship using least squares Recalibration of the Z-R relationship using quantile regression Optimization of the Z-R relationship for Singapore Conclusions
© 2013 IBM Corporation 3 Background A joint development between IBM Research and the National Environmental Agency (NEA), Singapore Objectives: 1.Recalibrate the Z-R relationship for Singapore 2.Compare different methods that convert radar reflectivity factor (Z) to rainfall intensity (R) 3.Optimize model parameters of the Z-R relationship for Singapore Our research is still on-going, and preliminary findings are presented
© 2013 IBM Corporation 4 About Singapore Singapore is located at the southern tip of the Malay Peninsula and is 137 kilometres (85 mi) north of the equator. Average annual rainfall ~ 2,342mm (92 inches) –Rio de Janeiro ~46 inches –New York: ~50 inches (total precipitation) –Seattle: ~38 inches (total precipitation) The Four Seasons in Singapore –North-East Monsoon Season (Dec to Mar) –Inter-Monsoon Season (Apr and May) –South-West Monsoon Season (Jun and Sep) –Inter-Monsoon Season (Oct and Nov) This study focuses on the relationship between reflectivity factor and rainfall rate (i.e., the Z-R relationship) for Singapore during the two inter- monsoon seasons Singapore
© 2013 IBM Corporation 5 Data Weather radar reflectivity data: –30 heavy rain events in 2010 and 46 heavy rain events in 2011 –Cartesian grid of 480 by 480 pixels –Top left corner: E , N –Lower right: E , N –Spatial resolution: 0.5 by 0.5 kilometres –Sampling frequency: 5min Illustration: (E , N ) (E , N ) dBZ Singapore
© 2013 IBM Corporation 6 Example: A typical inter-monsoon season convective storm Key features: Developed quickly (hard to predict that its coming) Lifetime: within 1 to 3 hours Heavy rainfall See animation in full-screen model
© 2013 IBM Corporation 7 Data Raingauge Data: –Number of stations: 64 –Sampling frequency: 5min Illustration:
© 2013 IBM Corporation 8 Data dBZ-dBG pairs –46 inter-monsoon heavy rains in 2011 –88274 pairs –70008 pairs with zero rainfall dBG is based on hourly rainfall intensity in mm/h
© 2013 IBM Corporation 9 Marshall-Palmer Relationship MP relationship (Marshall-Palmer, 1948) Fitting result: Marshall-Palmer
© 2013 IBM Corporation 10 Performance Assessment of the MP Relationship Marshall-Palmer (tested on 2010 data) POD (20mm/h ~ 30mm/h)32% FAR (20mm/h ~ 30mm/h)69% POD (30mm/h ~ 50mm/h)34% FAR (30mm/h ~ 50mm/h)53% POD (50mm/h ~ 70mm/h)9% FAR (50mm/h ~ 70mm/h)66% POD: Probability of DetectionFAR: False Alarm Rate
© 2013 IBM Corporation 11 Least Squares Recalibrate the Z-R relationship for Singapore Method 1: Least squares (LS) –Advantages: simple and commonly used –Disadvantages: the normality assumption of residuals is violated; sensitive to outliers. Fitting Results: MP LS
© 2013 IBM Corporation 12 Performance Assessment and Comparison Marshall-Palmer (tested on 2010 data ) Least Squares (fitted using 2011 data; tested on 2010 data) POD (20mm/h ~ 30mm/h)32%20% FAR (20mm/h ~ 30mm/h)69%89% POD (30mm/h ~ 50mm/h)34%26% FAR (30mm/h ~ 50mm/h)53%90% POD (50mm/h ~ 70mm/h)9%20% FAR (50mm/h ~ 70mm/h)66%95% Although the LS method minimizes the sum of squared error, it is apparently NOT a good choice if the goal is to estimate the rainfall intensity from reflectivity.
© 2013 IBM Corporation 13 Quantile Regression Recalibrate the Z-R relationship for Singapore Method 2: Quantile Regression (QR) –Advantages: Robust against outliers; Outperforms least squares when the normality assumption is violated Fitting Results: MP LS QR
© 2013 IBM Corporation 14 Performance Assessment and Comparison Marshall- Palmer (tested on 2010 data) Least Squares (fitted using 2011 data; tested on 2010 data) Quantile Regression (fitted using 2011 data; tested on 2010 data) POD (20mm/h ~ 30mm/h)32%20%28% FAR (20mm/h ~ 30mm/h)69%89%79% POD (30mm/h ~ 50mm/h)34%26%41% FAR (30mm/h ~ 50mm/h)53%90%75% POD (50mm/h ~ 70mm/h)9%20%48% FAR (50mm/h ~ 70mm/h)66%95%85% In terms of POD, the Quantile Regression outperforms the other two for heavy rainfall prediction, especially when the intensity is larger than 50mm/h In terms of FAR, the Quantile Regression is not as good as the default MP relationship. In general, considering the significant improvement of POD by the quantile regression, we still think the quantile regression outperforms despite the relatively larger FAR.
© 2013 IBM Corporation 15 Optimize Model Parameters Both POD and FAR are determined by the values of a and b Why not to find the optimum values of a and b that maximize POD subject to the maximum FAR constraint? In this study, we are particularly interested in predicting extremely heavy rainfall events with intensity within 50~70 mm/h. This leads to the following optimization problem. FAR of MP relationship for rainfall intensity within 50~70mm/h POD for rainfall intensity within 50~70mm/h (to be maximized) We are searching for a and b that 1) maximize the POD for rainfall intensity within 50~70mm/h, and 2) with FAR not greater than that of the default MP relationship
© 2013 IBM Corporation 16 Optimize Model Parameters Recalibrate the Z-R relationship for Singapore Method 3: Maximization of POD for Rainfall Intensity within 50-70mm/h Results: MP LS QR Optimized to maximize POD
© 2013 IBM Corporation 17 Performance Assessment and Comparison Marshall-Palmer (tested on 2010 data) Least Squares (fitted using 2011 data; tested on 2010 data) Quantile Regression (fitted using 2011 data; tested on 2010 data) With Optimized a and b (fitted using 2011 data; tested on 2010 data) POD (20~30mm/h)32%20%28%44% FAR (20~30mm/h)69%89%79%70% POD (30~50mm/h)34%26%41%55% FAR (30~50mm/h)53%90%75%59% POD (50~70mm/h)9%20%48%25% FAR (50~70mm/h)66%95%85%59% Conclusions: 1.The Z-R relationship in Singapore can be significantly improved over the default Marshall-Palmer relationship; 2.When the goal is to predict the rainfall intensity from reflectivity, the optimum values of a and b are those that maximize the POD subject to the maximum FAR constraint; 3.It is interesting to see that a good fitting of the dBZ-dBG pairs (such as least squares or quantile regression) does not necessarily imply high accuracy in rainfall prediction based on reflectivity.
1 Before Between After 2 What comes before. _____ 10 _____
Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.
STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
AGVISE Laboratories %Zone or Grid Samples – Northwood laboratory % Grid or Zone Samples Tested Compared To Conventional Whole Field Composite.
CALENDAR NEW CALENDAR
MaK_Full ahead loaded 1 Alarm Page Directory (F11)
×1= 9 4 1×1= 1 5 8×1= 8 6 7×1= 7 7 8×3= 24.
Chapter 12 Static Equilibrium; Elasticity and Fracture Physics for Scientists & Engineers, 3 rd Edition Douglas C. Giancoli © Prentice Hall.
A Fractional Order (Proportional and Derivative) Motion Controller Design for A Class of Second-order Systems Center for Self-Organizing Intelligent Systems.
1 When you see… Find the zeros You think…. 2 To find the zeros...
Trend for Precision Soil Testing % Zone or Grid Samples Tested compared to Total Samples.
I 1. can 2 see 3 A 4 to 5 come 6 my 7 the 8.
1 Budapest University of Technology and Economics, BME, 1872 Budapest University of Technology and Economics, BME, 1872 Happy New Year 2012.
STATISTICS INTERVAL ESTIMATION Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
©2004 by Pearson Education11-1 R.C. Hibbeler Resistência dos Materiais, 5ª ed. 11 – Projetos de Vigas e Eixos.
1 McGill University Department of Civil Engineering and Applied Mechanics Montreal, Quebec, Canada.
Unit I Topic 2-7 MAC Protocols for Ad Hoc Wireless Networks Department of Computer Science and Engineering Kalasalingam University 1 CSE 6007 Mobile Ad.
Algebra Addition and Subtraction Equations Free powerpoints at
The 5S numbers game. 1. This sheet represents our current work place. Our job during a 20 second shift, is to strike out the numbers 1 to 49 in correct.
Subtraction: Adding UP. Category 1 The whole is a multiple of ten.
Simulations The basics for simulations. Simulation is a way to model random events, such that simulated outcomes closely match real-world outcomes. By.
BMU - E I 1 Development of renewable energy sources in Germany in
PP Test Review Sections 6-1 to 6-6 Mrs. Rivas 1. 2.
1 Dr. Scott Schaefer Least Squares Curves, Rational Representations, Splines and Continuity.
Copyright © Action Works 2008 All Rights Reserved - Photos by David D. Kempster 1.
Copyright © 2012, Elsevier Inc. All rights Reserved. 1 Chapter 7 Modeling Structure with Blocks.
Chapter 10 Regression with Panel Data. 2 Regression with Panel Data (SW Chapter 10)
©2004 by Pearson Education13-1 R.C. Hibbeler Resistência dos Materiais, 5ª ed. 13 – Flambagem de Colunas.
BMU – KI III 1 Development of renewable energy sources in Germany in
The Fall Messier Marathon Guide Ed Ting, NHAS, CMP Oct 17 th 2008.
Computer vision: models, learning and inference Chapter 15 Models for transformations.
Worksheets Demo 1 Demo 2 Demo 3 Demo 4.
Numerical Analysis 1 EE, NCKU Tien-Hao Chang (Darby Chang)
famous photographer Ara Guler famous photographer ARA GULER.
P.A.C.E.R. Progressive Aerobic Cardiovascular Endurance Run NJ Core Content Standards: 2.6 Fitness and Physical Activity.
1 INSTALLING "WINDOWS 8.." SO THAT IT CREATES A LOCAL USER ACCOUNT.
Introduction 1 The Cost of Occupational Fraud 2.
Copyright © 2006 Pearson Addison-Wesley. All rights reserved. Lecture 8: Hypothesis Testing (Chapter 7.1–7.2, 7.4) Distribution of Estimators (Chapter.
TCCI Barometer March “Establishing a reliable tool for monitoring the financial, business and social activity in the Prefecture of Thessaloniki”
Break Time Remaining 10:00. Break Time Remaining 9:59.
1 STANDARD 1.3 Converting a Fraction to % Problem 1 Problem 4 Problems 3 Problem 2 Problem 5 END SHOW PRESENTATION CREATED BY SIMON PEREZ. All rights reserved.
Add Governors Discretionary (1G) Grants Chapter 6.
1 Copyright © 2013 Elsevier Inc. All rights reserved. Chapter 3 Sequential Logic Design.
Chapter 13 Fluids Physics for Scientists & Engineers, 3 rd Edition Douglas C. Giancoli © Prentice Hall.
© 2017 SlidePlayer.com Inc. All rights reserved.