Developing and Testing Mechanistic Models of Terrestrial Carbon Cycling Using Time-Series Data Ed Rastetter The Ecosystems Center Marine Biological Laboratory.

Slides:



Advertisements
Similar presentations
Filtering for High Dimension Spatial Systems Jonathan Briggs Department of Statistics University of Auckland.
Advertisements

Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
Time Series Building 1. Model Identification
Observers and Kalman Filters
Collaboration FST-ULCO 1. Context and objective of the work  Water level : ECEF Localization of the water surface in order to get a referenced water.
Presenter: Yufan Liu November 17th,
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
Curve-Fitting Regression
Mobile Intelligent Systems 2004 Course Responsibility: Ola Bengtsson.
SYSTEMS Identification
Nonlinear and Non-Gaussian Estimation with A Focus on Particle Filters Prasanth Jeevan Mary Knox May 12, 2006.
Discriminative Training of Kalman Filters P. Abbeel, A. Coates, M
Comparative survey on non linear filtering methods : the quantization and the particle filtering approaches Afef SELLAMI Chang Young Kim.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Course AE4-T40 Lecture 5: Control Apllication
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Kalman filter and SLAM problem
Muhammad Moeen YaqoobPage 1 Moment-Matching Trackers for Difficult Targets Muhammad Moeen Yaqoob Supervisor: Professor Richard Vinter.
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Lecture 11: Kalman Filters CS 344R: Robotics Benjamin Kuipers.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Satellite Tracking Example of SNC and DMC ASEN.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Computer vision: models, learning and inference Chapter 19 Temporal models.
PROJECTING U.S. CROP YIELDS FOR COMPREHENSIVE BIOENERGY ASSESSMENTS historical trends, variability, and spatial clustering ABSTRACT The aggregate and distributional.
Computer vision: models, learning and inference Chapter 19 Temporal models.
O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY 1 Vegetation/Ecosystem Modeling and Analysis Project (VEMAP) Lessons Learned or How to Do.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
Probabilistic Robotics Bayes Filter Implementations.
Data and modeling issues in population biology  Alan Hastings (UC Davis) and many colalborators  Acknowledge support from NSF.
Karman filter and attitude estimation Lin Zhong ELEC424, Fall 2010.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Definitions Random Signal Analysis (Review) Discrete Random Signals Random.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
Using data assimilation to improve estimates of C cycling Mathew Williams School of GeoScience, University of Edinburgh.
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
An Introduction to Kalman Filtering by Arthur Pece
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
Speed-Sensorless Estimation for Induction motors using Extended Kalman Filters 教 授: 龔應時 學 生: 楊政達 Murat Barut; Seta Bogosyan; Metin Gokasan; Industrial.
Goal: to understand carbon dynamics in montane forest regions by developing new methods for estimating carbon exchange at local to regional scales. Activities:
Recursive Calibration of Ecosystem Models Using Sequential Data Assimilation Mingshi Chen¹, Shuguang Liu¹, Larry L. Tieszen², and David Y. Hollinger 3.
An Introduction To The Kalman Filter By, Santhosh Kumar.
Parameter estimation of forest carbon dynamics using Kalman Filter methods –Preliminary results Chao Gao, 1 Han Wang, 2 S Lakshmivarahan, 3 Ensheng Weng,
Kalman Filtering And Smoothing
By: Aaron Dyreson Supervising Professor: Dr. Ioannis Schizas
Nonlinear State Estimation
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
Cameron Rowe.  Introduction  Purpose  Implementation  Simple Example Problem  Extended Kalman Filters  Conclusion  Real World Examples.
A Low-Cost and Fail-Safe Inertial Navigation System for Airplanes Robotics 전자공학과 깡돌가
Geogg124: Data assimilation P. Lewis. What is Data Assimilation? Optimal merging of models and data Models Expression of current understanding about process.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
Matrix Models for Population Management & Conservation March 2014 Lecture 10 Uncertainty, Process Variance, and Retrospective Perturbation Analysis.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
Robust Localization Kalman Filter & LADAR Scans
EC 827 Module 2 Forecasting a Single Variable from its own History.
Kalman Filter and Data Streaming Presented By :- Ankur Jain Department of Computer Science 7/21/03.
Probabilistic Robotics Bayes Filter Implementations Gaussian filters.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
Correlation and Regression Q560: Experimental Methods in Cognitive Science Lecture 13.
State Space Modelling For UK LFS Unemployment
ECE 7251: Signal Detection and Estimation
PSG College of Technology
Filtering and State Estimation: Basic Concepts
Kalman Filter فيلتر كالمن در سال 1960 توسط R.E.Kalman در مقاله اي تحت عنوان زير معرفي شد. “A new approach to liner filtering & prediction problem” Transactions.
Bayes and Kalman Filter
Kalman Filtering COS 323.
Principles of the Global Positioning System Lecture 13
CH2 Time series.
Presentation transcript:

Developing and Testing Mechanistic Models of Terrestrial Carbon Cycling Using Time-Series Data Ed Rastetter The Ecosystems Center Marine Biological Laboratory Woods Hole, MA USA Jack Cosby Environmental Sciences University of Virginia Charlottesville, VA USA

I. What should be the focus of model development and testing efforts? II. Using transfer-function estimations to identify important system linkages III. Using the Extended Kalman Filter as a test of model adequacy that yields valuable information on how to improve model structure Topics:

There has been an emphasis on the individual processes within models (e.g., photosynthesis, respiration, transpiration). But are differences among models because of the individual processes? Or is it because of the overall model structure (i.e., how the components are linked together)? Focus of model development and testing

XY PLR F Structure 1: Structure 3: XaXa Y PaPa LaLa R F XbXb PbPb LbLb Structure 2: XYaYa P L R U F YbYb M Is it the overall structure or the component processes that matters? Rastetter 2003

Response to a ramp in F from time 10 to 100 Same model structure, different process equation Rastetter 2003

XY PLR F Structure 1: Structure 3: XaXa Y PaPa LaLa R F XbXb PbPb LbLb Structure 2: XYaYa P L R U F YbYb M Its the structure that matters!!!!!!! (i.e. how the components are linked to one another) Not the detailed process representation!

G F ++ n x r y e y x - input time series y - output time series n - white noise time series e - error time series F - Deterministic transfer function G - Stochastic transfer function y t = b 0 x t + b 1 x t a 1 y t-1 - a 2 y t  0 n t +  1 n t  1 r t-1 -  2 r t e t Young 1984 ARMA Transfer Function Models Testing system linkages

Input Time Series Output Time Series No significant pattern Deterministic function significant Combined model significant but deterministic function not significant Rastetter 1986

Kalman Filter The Kalman Filter is recursive filter that estimates successive states of a dynamic system from a time series of noise-corrupted measurements (Data Assimilation) A linear model is used to project the system state one time step into the future Measurements are made after the time step has elapsed and compared to the model predictions Based on this comparison and a recursively updated assessment of past model performance (estimate covariance matrix) and past measurement error (innovations covariance), the Kalman Filter updates, and hopefully improves, estimates of the modeled variables

Extended Kalman Filter The Extended Kalman Filter (EKF) is essentially the same as the Kalman filter, but with an underlying nonlinear model To accommodate the nonlinearity, the model must be linearized at each time step to estimate the Transition matrix This transition matrix is used to update the estimate covariance

F t = J = ff xx x t-1:t-1,u t F t =exp(J  t) exp(J  t) = I + J  t + (J  t) 2 /2! (J  t) n /n! +... Discrete model x t = f(x t-1, u t, w t ) Continuous model = f(x, u, w) dx dt Nonlinear models Linearized transition matrix

(Continuous) Extended Kalman Filter Predict P t:t-1 = F t P t-1:t-1 F t T + Q t estimate covariance Update S t = H t P t:t-1 H t T + R t innovations covariance K t = P t:t-1 H t T S t -1 Kalman gain x t:t = x t:t-1 + K t y t updated state P t:t = (I - K t H t ) P t:t-1 updated estimate covariance y t = z t - H t x t:t-1 innovations x t:t-1 = x t-1:t-1 + f(x,u,0)dt predicted state t-1 t

Augmented State Vector x * = x1x1 x2x2 x3x3 xnxn 11 22 33 mm Once the Kalman Filter has been extended to incorporate a nonlinear model, it is easy to augment the state vector with some or all of the model parameters That is, to treat some or all of the parameters as if they were state variables This augmented state vector then serves a the basis for a test of model adequacy proposed by Cosby and Hornberger (1984)

EKF Test of Model Adequacy Cosby & Hornberger ) Innovations (deviations) are zero mean, white noise (i.e., no auto-correlation) 2) Parameter estimates (in the augmented state vector) are fixed mean, white noise 3) There is no cross-correlation among parameters or between parameters and state variables or control (driver) variables The model embedded in the EKF is adequate if:

WebbHyperbolic Eight Models Tested by Cosby et al O 2 concentration in a Danish stream note 1 model structure, alternate representation of P S

Cosby et al. 1984

WebbHyperbolic Webb Hyperbolic Webb Hyperbolic both both Cosby et al mean value Maximum rate Initial slope of PI curve

All 8 models failed in the same way; parameter controlling initial slope of PI curve had a diel cycle. Its not the details of process representation that’s crucial, its how the processes are linked to one another. Linear model “wags” as light changes All models have diel hysteresis

The EKF can be used as a severe test of model structure (few models are likely to pass the test) More importantly, it yields a great deal of information on how the model failed that can be used to improve the model structure e.g., the initial-slope parameter in the Cosby model should be replaced with a variable that varies on a 24-hour cycle, like a function of CO 2 depletion in the water, or C-sink saturation in the plants EKF Test of Model Adequacy

Are we getting the right type of data? Time series data are extremely expensive and therefore rare e.g., eddy flux, hydrographs, chemographs, others? Their value to understanding of ecosystem dynamics is definitely worth the expense The key to good time series data is automation to assure consistent, regular sampling There should be a high degree of synchronicity among time series collected on the same system

Time series are far richer in information on system dynamics and system linkages than data derived from more conventional experimental designs (e.g., ANOVA) Time series provide replication through time, which allows for statistical rigor without the replication constraints of more conventional experimental designs The focus of study should be on identifying and testing the linkages among system components (i.e., the system structure) rather than the details of how the individual processes are represented Conclusions:

Transfer-function estimation can be used to identify links among ecosystem components or test the importance of postulated linkages The Extended Kalman Filter can be used as a severe test of model adequacy that yields valuable information on how to improve the model structure Unfortunately, high quality time-series data in ecology are still rare However, new expenditures currently proposed for monitoring the biosphere (e.g., ABACUS, LTER, NEON, CLEANER, CUAHSI, OOI) may provide the support to automate time-series sampling of several important ecosystem properties. Conclusions:

The End