EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download.

Slides:



Advertisements
Similar presentations
1 Uncertainty in rainfall-runoff simulations An introduction and review of different techniques M. Shafii, Dept. Of Hydrology, Feb
Advertisements

Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Monte Carlo Methods and Statistical Physics
This presentation can be downloaded at – This work is carried out within the SWITCH-ON.
Latif Kalin, Ph.D. School of Forestry and Wildlife Sciences, Auburn University Auburn, AL 2007 ALABAMA WATER RESOURCES CONFERENCE and ALABAMA SECTION OF.
Rainfall – runoff modelling
Testing hydrological models as hypotheses: a limits of acceptability approach and the issue of disinformation Keith Beven, Paul Smith and Andy Wood Lancaster.
Cox Model With Intermitten and Error-Prone Covariate Observation Yury Gubman PhD thesis in Statistics Supervisors: Prof. David Zucker, Prof. Orly Manor.
Decision Making: An Introduction 1. 2 Decision Making Decision Making is a process of choosing among two or more alternative courses of action for the.
CHAPTER 16 MARKOV CHAIN MONTE CARLO
Markov processes in a problem of the Caspian sea level forecasting Mikhail V. Bolgov Water Problem Institute of Russian Academy of Sciences.
1 Alberto Montanari University of Bologna Simulation of synthetic series through stochastic processes.
Computational statistics 2009 Sensitivity analysis (SA) - outline 1.Objectives and examples 2.Local and global SA 3.Importance measures involving derivatives.
Visual Recognition Tutorial
This presentation is available for download at the website: Information: OBSERVATIONAL UNCERTAINTIES.
This presentation can be downloaded at XXXII Convegno Nazionale di Idraulica e Costruzioni Idrauliche XXXII Italian Conference.
AGU FALL MEETING San Francisco, December 2010 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available.
This presentation can be downloaded at Water Cycle Projections over Decades to Centuries at River Basin to Regional Scales:
The Simple Linear Regression Model: Specification and Estimation
Pattern Recognition and Machine Learning
UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website:
Maximum likelihood (ML) and likelihood ratio (LR) test
PROVIDING DISTRIBUTED FORECASTS OF PRECIPITATION USING A STATISTICAL NOWCAST SCHEME Neil I. Fox and Chris K. Wikle University of Missouri- Columbia.
Scale Issues in Hydrological Modelling: A Review
Providing distributed forecasts of precipitation using a Bayesian nowcast scheme Neil I. Fox & Chris K. Wikle University of Missouri - Columbia.
Statistics and Probability Theory Prof. Dr. Michael Havbro Faber
Lecture of : the Reynolds equations of turbulent motions JORDANIAN GERMAN WINTER ACCADMEY Prepared by: Eng. Mohammad Hamasha Jordan University of Science.
Bayesian Analysis for Extreme Events Pao-Shin Chu and Xin Zhao Department of Meteorology School of Ocean & Earth Science & Technology University of Hawaii-
Maximum likelihood (ML)
Lecture II-2: Probability Review
Hydrologic Statistics
Development of An ERROR ESTIMATE P M V Subbarao Professor Mechanical Engineering Department A Tolerance to Error Generates New Information….
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
BsysE595 Lecture Basic modeling approaches for engineering systems – Summary and Review Shulin Chen January 10, 2013.
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
Instructor Resource Chapter 5 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
Module 1: Statistical Issues in Micro simulation Paul Sousa.
ENM 503 Lesson 1 – Methods and Models The why’s, how’s, and what’s of mathematical modeling A model is a representation in mathematical terms of some real.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Conceptual Modelling and Hypothesis Formation Research Methods CPE 401 / 6002 / 6003 Professor Will Zimmerman.
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
Gabriele Coccia (1)(2) and Ezio Todini (1)(2) (1) University of Bologna, Bologna, Italy (2) Idrologia e Ambiente s.r.l, Napoli, Italy Probabilistic flood.
17 May 2007RSS Kent Local Group1 Quantifying uncertainty in the UK carbon flux Tony O’Hagan CTCD, Sheffield.
The NOAA Hydrology Program and its requirements for GOES-R Pedro J. Restrepo Senior Scientist Office of Hydrologic Development NOAA’s National Weather.
ECE-7000: Nonlinear Dynamical Systems Overfitting and model costs Overfitting  The more free parameters a model has, the better it can be adapted.
CHAPTER 17 O PTIMAL D ESIGN FOR E XPERIMENTAL I NPUTS Organization of chapter in ISSO –Background Motivation Finite sample and asymptotic (continuous)
Sampling and estimation Petter Mostad
STOCHASTIC HYDROLOGY Stochastic Simulation of Bivariate Distributions Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National.
Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering National Taiwan University 1/45 GEOSTATISTICS INTRODUCTION.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Quantum New way of looking at our world. Classical vs Quantum Typically a student develops an intuition about how the world works using classical mechanics.
Stochastic Hydrology Random Field Simulation Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
TEAM 1 st Topic Presentation, Friday 18 th February 2011 Polytech’Nice - Sophia I NTEREST OF DISTRIBUTED HYDROLOGICAL MODELS ( Mike SHE & HEC-HMS.
Chance Constrained Robust Energy Efficiency in Cognitive Radio Networks with Channel Uncertainty Yongjun Xu and Xiaohui Zhao College of Communication Engineering,
Uncertainty and Reliability Analysis D Nagesh Kumar, IISc Water Resources Planning and Management: M6L2 Stochastic Optimization.
Goal of Stochastic Hydrology Develop analytical tools to systematically deal with uncertainty and spatial variability in hydrologic systems Examples of.
Kevin Stevenson AST 4762/5765. What is MCMC?  Random sampling algorithm  Estimates model parameters and their uncertainty  Only samples regions of.
“ Building Strong “ Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty & Variability Charles Yoe, Ph.D.
Team  Spatially distributed deterministic models  Many hydrological phenomena vary spatially and temporally in accordance with the conservation.
Introduction to emulators Tony O’Hagan University of Sheffield.
Introduction.
Rutgers Intelligent Transportation Systems (RITS) Laboratory
Introduction.
Stochastic Hydrology Random Field Simulation
Overview of Models & Modeling Concepts
Filtering and State Estimation: Basic Concepts
Lecture 2 – Monte Carlo method in finance
Introduction.
Introduction.
Introduction.
Presentation transcript:

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Is deterministic physically-based hydrological modeling a feasible target? Incorporating physical knowledge in stochastic modeling of uncertain systems 2011 EGU General Assembly Vienna, April 2011 Alberto Montanari Faculty of Engineering University of Bologna Demetris Koutsoyiannis National Technical University of Athens Work carried out under the framework of the Research Project DATAERROR ( (Uncertainty estimation for precipitation and river discharge data. Effects on water resources planning and flood risk management) Ministry of Education, University and Research - Italy

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: A premise on terminology Spatially-distributed model: model’s equations are applied at local instead of catchment scale. Spatial discretization is obtained by subdividing the catchment in subunits (subcatchments, regular grids, etc). Deterministic model: model in which outcomes are precisely determined through known relationships among states and events, without any room for random variation. In such model, a given input will always produce the same output Physically-based, spatially-distributed and deterministic are often used as synonyms. This is not correct. Physically-based model: based on the application of the laws of physics. In hydrology, the most used physical laws are the Newton’s law of the gravitation and the laws of conservation of mass, energy and momentum. Sir Isaac Newton (1689, by Godfrey Kneller)

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: A premise on terminology Fluid mechanics obeys the laws of physics. However: Most flows are turbulent and thus can be described only probabilistically (note that the stress tensor in turbulent flows involves covariances of velocities). Even viscous flows are au fond described in statistical thermodynamical terms macroscopically lumping interactions at the molecular level. It follows that: A physically-based model is not necessarily deterministic. A hydrological model should, in addition to be physically-based, also consider chemistry, ecology, etc. In view of the extreme complexity, diversity and heterogeneity of meteorological and hydrological processes (rainfall, soil properties…) physically-based equations are typically applied at local (small spatial) scale. It follows that: A physically-based model often requires a spatially-distributed representation.

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: A premise on terminology In fact, some uncertainty is always present in hydrological modeling. Such uncertainty is not related to limited knowledge (epistemic uncertainty) but is rather unavoidable. It follows that a deterministic representation is not possible in catchment hydrology. The most comprehensive way of dealing with uncertainty is statistics, through the theory of probability. Therefore a stochastic representation is unavoidable in catchment hydrology (sorry for that...  ). The way forward is the stochastic physically-based model, a classical concept that needs to be brought in new light. Figure taken from

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Formulating a physically-based model within a stochastic framework Hydrological model: in a deterministic framework, the hydrological model is usually defined as a single- valued transformation expressed by the general relationship: Q p = S ( , I) where Q p is the model prediction, S expresses the model structure, I is the input data vector and  the parameter vector. In the stochastic framework, the hydrological model is expressed in stochastic terms, namely (Koutsoyiannis, 2010): f Q p (Q p ) = K f , I ( , I) where f indicates the probability density function, and K is a transfer operator that depends on model S.

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Formulating a physically-based model within a stochastic framework Assuming a single-valued (i.e. deterministic) transformation S( , I) as in previous slide, the operator K will be the Frobenius-Perron operator (e.g. Koutsoyiannis, 2010). However, K can be generalized to represent a so-called stochastic operator, which corresponds to one-to-many transformations S. A stochastic operator can be defined using a stochastic kernel k(e, ε, I) (with e intuitively reflecting a deviation from a single-valued transformation; in our case it indicates the model error) having the properties k(e, ε, I) ≥ 0 and ∫ e k(e, ε, I) de = 1

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Formulating a physically-based model within a stochastic framework Specifically, the operator K applying on f ε, I (ε, I) is then defined as (Lasota and Mackey, 1985, p. 101): K f ε, I (ε, I) = ∫ ε ∫ I k(e, ε, I) f ε, I (ε, I) dε dI If the random variables  and I are independent, the model can be written in the form: f Q p (Q p ) = K [f ε (e) f I (I)] f Q p (Q p ) = ∫ ε ∫ I k(e, ε, I) f ε (  ) f I (I) dε dI

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Estimation of prediction uncertainty: Further assumptions: 1) model error is assumed to be independent of input data error and model parameters. 2) Prediction is decomposed in two additive terms, i.e. : Q p = S(ε, I) + e where S represents the deterministic part and the structural error e has density f e (e). 3) Kernel independent of ε, I (depending on e only), i.e.: k(e, ε, I) = f e (e) Formulating a physically-based model within a stochastic framework f Q p (Q p ) = ∫ ε ∫ I f e (Q p - S(ε, I)) f ε (ε) f I (I) dε dI By substituting in the equation derived in the previous slide we obtain:

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Symbols: - Q p true (unknown) value of the hydrological variable to be predicted - S( ,I) Deterministic hydrological model - e Model structural error -  Model parameter vector - I Input data vector From the deterministic formulation: Q p = S(ε, I) to the stochastic simulation: f Q p (Q p ) = ∫ ε ∫ I f e (Q p - S(ε, I)) f ε (ε) f I (I) dε dI Formulating a physically-based model within a stochastic framework

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Formulating a physically-based model within a stochastic framework Pick up a parameter vector  from the model parameter space accordingly to probability f  (  ) Input data vector (certain) Problems: 1)computational demands; 2)estimate f  (  ) and f e (e) An example of application: model is generic and possibly physically-based. Let us assume that input data uncertainty can be neglected, and that probability distributions of model error and parameters are known. Repeat j times Compute model output and add n realisation of model error from probability distribution f e (e) Obtain n j points lying on f Qp (Q p ) and infer the probability distribution p(x)p(x)

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Example: Leo Creek at Fanano (Italy) (Courtesy by: Elena Montosi)

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Estimation of the predictive distribution Rainfall runoff model: AFFDEF – Daily time scale – Conceptual, 7 parameters Parameter distribution: estimated by using DREAM (Vrugt and Robinson, 2007) Generation of random samples of model error: by using the meta – Gaussian approach (Montanari and Brath, 2004; Montanari and Grossi, 2008).

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Research challenges To include a physically-based model within a stochastic framework is in principle easy. Nevertheless, relevant research challenges need to be addressed: numerical integration (e.g. by Monte Carlo method) is computationally intensive and may result prohibitive for spatially-distributed models. There is the need to develop efficient simulation schemes; a relevant issue is the estimation of model structural uncertainty, namely, the estimation of the probability distribution f(e) of the model error. The literature has proposed a variety of different approaches, like the GLUE method (Beven and Binley, 1992), the meta-Gaussian model (Montanari and Brath, 2004; Montanari and Grossi, 2008), Bayesian Model Averaging. For focasting, Krzysztofowicz (2002) proposed the BFS method; estimation of parameter uncertainty is a relevant challenge as well. A possibility is the DREAM algorithm (Vrugt and Robinson, 2007).

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: Concluding remarks A deterministic representation is not possible in hydrological modeling, because uncertainty will never be eliminated. Therefore, physically-based models need to be included within a stochastic framework. The complexity of the modeling scheme increases, but multiple integration can be easily approximated with numerical integration. The computational requirements may become very intensive for spatially-distributed models. How to efficiently assess model structural uncertainty is still a relevant research challenge, especially for ungauged basins. MANY THANKS to: Guenter Bloeschl, Elena Montosi, Siva Sivapalan, Francesco Laio -

EGU GENERAL ASSEMBLY Vienna, 3-8 April 2011 UNIVERSITY OF BOLOGNA Alma Mater Studiorum DATAERROR Research Project This presentation is available for download at the website: Information: References Beven, K.J., Binley, A.M., The future of distributed models: model calibration and uncertainty prediction. Hydrological Processes 6: 279–298, Koutsoyiannis, D., A random walk on water, Hydrology and Earth System Sciences Discussions, 6, 6611–6658, Krzysztofowicz, R., Bayesian system for probabilistic river stage forecasting, Journal of Hydrology, 268, 16–40, Lasota, D.A., Mackey, M.C., Probabilistic properties of deterministic systems, Cambridge Universityy Press, Montanari, A., Brath, A., A stocastic approach for assessing the uncertainty of rainfall-runoff simulations. Water Resources Research, 40, W01106, doi: /2003WR002540, Montanari, A., Grossi, G., Estimating the uncertainty of hydrological forecasts: A statistical approach. Water Resources Research, 44, W00B08, doi: /2008WR006897, Vrugt, J.A and Robinson, B.A., Improved evolutionary optimization from genetically adaptive multimethod search, Proceedings of the National Academy of Sciences of the United States of America, 104, , doi: /pnas ,