State space model of precipitation rate (Tamre Cardoso, PhD UW 2004) Updating wave height forecasts using satellite data (Anders Malmberg, PhD U. Lund.

Slides:



Advertisements
Similar presentations
Statistical Time Series Analysis version 2
Advertisements

1 -Classification: Internal Uncertainty in petroleum reservoirs.
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
State Space Models. Let { x t :t T} and { y t :t T} denote two vector valued time series that satisfy the system of equations: y t = A t x t + v t (The.
Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Probabilistic Reasoning over Time
Empirical Analysis and Statistical Modeling of Errors in Satellite Precipitation Sensors Yudong Tian, Ling Tang, Robert Adler, and Xin Lin University of.
Calibration of GOES-R ABI cloud products and TRMM/GPM observations to ground-based radar rainfall estimates for the MRMS system – Status and future plans.
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
12.4 Notes Weather Analysis
MPO 674 Lecture 15 3/3/15. Bayesian update Jeff Anderson’s Tutorial A | C = Prior based on previous information C A | BC = Posterior based on previous.
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
Gaussian process emulation of multiple outputs Tony O’Hagan, MUCM, Sheffield.
Kalman’s Beautiful Filter (an introduction) George Kantor presented to Sensor Based Planning Lab Carnegie Mellon University December 8, 2000.
Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.
PROVIDING DISTRIBUTED FORECASTS OF PRECIPITATION USING A STATISTICAL NOWCAST SCHEME Neil I. Fox and Chris K. Wikle University of Missouri- Columbia.
Hierarchical models STAT 518 Sp 08. Rainfall measurement Rain gauge (1 hr) High wind, low rain rate (evaporation) Spatially localized, temporally moderate.
Kalman Filter in the Real Time URBIS model Richard Kranenburg Master scriptie June 11, 2010.
CS 547: Sensing and Planning in Robotics Gaurav S. Sukhatme Computer Science Robotic Embedded Systems Laboratory University of Southern California
Statistics, data, and deterministic models NRCSE.
Prepared By: Kevin Meier Alok Desai
Statistics, data, and deterministic models NRCSE.
Kalman Filtering Jur van den Berg. Kalman Filtering (Optimal) estimation of the (hidden) state of a linear dynamic process of which we obtain noisy (partial)
Providing distributed forecasts of precipitation using a Bayesian nowcast scheme Neil I. Fox & Chris K. Wikle University of Missouri - Columbia.
ENSO project El Niño/Southern Oscillation is driven by surface temperature in tropical Pacific Data 2 o x2 o monthly SST anomalies at 2261 locations; zonal.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
© 2003 by Davi GeigerComputer Vision November 2003 L1.1 Tracking We are given a contour   with coordinates   ={x 1, x 2, …, x N } at the initial frame.
Tracking with Linear Dynamic Models. Introduction Tracking is the problem of generating an inference about the motion of an object given a sequence of.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Muhammad Moeen YaqoobPage 1 Moment-Matching Trackers for Difficult Targets Muhammad Moeen Yaqoob Supervisor: Professor Richard Vinter.
Geo479/579: Geostatistics Ch13. Block Kriging. Block Estimate  Requirements An estimate of the average value of a variable within a prescribed local.
Gaussian process modelling
Experiments with the microwave emissivity model concerning the brightness temperature observation error & SSM/I evaluation Henning Wilker, MIUB Matthias.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
Computer Vision - A Modern Approach Set: Tracking Slides by D.A. Forsyth The three main issues in tracking.
STEPS: An empirical treatment of forecast uncertainty Alan Seed BMRC Weather Forecasting Group.
Modern Navigation Thomas Herring
GAUGES – RADAR – SATELLITE COMBINATION Prof. Eng. Ezio TODINI
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
-Arnaud Doucet, Nando de Freitas et al, UAI
Data assimilation, short-term forecast, and forecasting error
Processing Sequential Sensor Data The “John Krumm perspective” Thomas Plötz November 29 th, 2011.
Prediction of Tropical Cyclones Chapter 9. Tropical weather data from traditional sources (surface and radiosonde) is scarce, so remote sensing via other.
An Introduction to Kalman Filtering by Arthur Pece
Dept. E.E./ESAT-STADIUS, KU Leuven
An Introduction to Optimal Estimation Theory Chris O´Dell AT652 Fall 2013.
Unscented Kalman Filter (UKF) CSCE 774 – Guest Lecture Dr. Gabriel Terejanu Fall 2015.
Tracking with dynamics
Nonlinear State Estimation
G. Cowan Computing and Statistical Data Analysis / Stat 9 1 Computing and Statistical Data Analysis Stat 9: Parameter Estimation, Limits London Postgraduate.
COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Simple Kalman filter – a “smoking gun” of shortages.
Cameron Rowe.  Introduction  Purpose  Implementation  Simple Example Problem  Extended Kalman Filters  Conclusion  Real World Examples.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
DSP-CIS Part-III : Optimal & Adaptive Filters Chapter-9 : Kalman Filters Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
Tracking We are given a contour G1 with coordinates G1={x1 , x2 , … , xN} at the initial frame t=1, were the image is It=1 . We are interested in tracking.
Kalman’s Beautiful Filter (an introduction)
Probabilistic Robotics
Modern Spectral Estimation
Kostas M. Andreadis1, Dennis P. Lettenmaier1
2. University of Northern British Columbia, Prince George, Canada
Principles of the Global Positioning System Lecture 13
JFG de Freitas, M Niranjan and AH Gee
Kalman Filter: Bayes Interpretation
Presentation transcript:

State space model of precipitation rate (Tamre Cardoso, PhD UW 2004) Updating wave height forecasts using satellite data (Anders Malmberg, PhD U. Lund 2005) Model emulators (O’Hagan and co- workers )

Rainfall measurement Rain gauge (1 hr) High wind, low rain rate (evaporation) Spatially localized, temporally moderate Radar reflectivity (6 min) Attenuation, not ground measure Spatially integrated, temporally fine Cloud top temp. (satellite, ca 12 hrs) Not directly related to precipitation Spatially integrated, temporally sparse Distrometer (drop sizes, 1 min) Expensive measurement Spatially localized, temporally fine

Radar image

Drop size distribution

Basic relations Rainfall rate: v(D) terminal velocity for drop size D N(t) number of drops at time t f(D) pdf for drop size distribution Gauge data: g(w) gauge type correction factor w(t) meteorological variables such as wind speed

Basic relations, cont. Radar reflectivity: Observed radar reflectivity:

Structure of model Data: [G|N(D),  G ] [Z|N(D),  Z ] Processes: [N|  N,  N ] [D|  t,  D ] log GARCH LN Temporal dynamics: [  N(t) |   ] AR(1) Model parameters: [  G,  Z,  N,  ,  D |  H ] Hyperparameters:  H

MCMC approach

Observed and predicted rain rate

Observed and calculated radar reflectivity

Wave height prediction

Misalignment in time and space

The Kalman filter Gauss (1795) least squares Kolmogorov (1941)-Wiener (1942) dynamic prediction Follin (1955) Swerling (1958) Kalman (1960) recursive formulation prediction depends on how far current state is from average Extensions

A state-space model Write the forecast anomalies as a weighted average of EOFs (computed from the empirical covariance) plus small-scale noise. The average develops as a vector autoregressive model:

EOFs of wind forecasts

Kalman filter forecast emulates forecast model

The effect of satellite data

Model assessment Difference from current forecast of Previous forecast Kalman filter Satellite data assimilated

Statistical analysis of computer code output Often the process model is expensive to run (in time, at least), especially if different runs needed for MCMC Need to develop real-time approximation to process model Kalman filter is a dynamic linear model approximation SACCO is an alternative Bayesian approach

Basic framework An emulator is a random (Gaussian) process  (x) approximating the process model for input x in R m. Prior mean m(x) = h(x) T  Prior covariance Run the model at n input values to get n output values, so

The emulator Integrating out  and  2 we get where q = dim(  ) and where t(x) T = (c(x,x 1 ),…,c(x,x n )) m** is the emulator, and we can also calculate its variance

An example y=7+x+cos(2x) q=1, h T (x)=(1 x) n=5

Conclusions Model assessment constraints: amount of data data quality ease of producing model runs degree of misalignment Ideally the model should have similar first and second order properties to the data similar peaks and troughs to data (or simulations based on the data)