Presentation on theme: "Uncertainty Quantification In Geosciences with Computationally Expensive Simulation Models (with last minute modification to Include Sustainability/Energy."— Presentation transcript:
Uncertainty Quantification In Geosciences with Computationally Expensive Simulation Models (with last minute modification to Include Sustainability/Energy analysis. Christine A. Shoemaker School of Civil and Environmental Engineering and School of Operations Research and Information Engineering Cornell University 1
Uncertainty Quantification with Computationally Expensive Simulation Models Many problems in geoscience and environmental engineering are described by computationally expensive simulation models. Probably the main obstacle to doing rigorous statistical analysis of uncertainty for a given data set and model is computational time because: – Simulation models typically need to be run many (e.g. thousands of ) times for uncertainty quantification – Multiple types of uncertainty need to be incorporated including data error, model error, parameter error, randomness in model input (static and dynamic) Im interested in developing new algorithms for this problem. 2
Examples of Static Geoscience Problems Requiring Uncertainty Quantification Examples of Goals: – Determine the spatial distribution of different types of geologic materials in the subsurface – Determine location of oil reservoirs or underground water Data sources: – based on sound waves or radar (many spatial points but not highly accurate). – Based on drilling into the subsurface (more accurate but very few spatial points because because of high cost of drilling each well. 3
Examples of Uncertainty Quantification Needs for Dynamic Geoscience Problems Examples of problems include: – Forecasting man-made changes in fluid flow in geologic formations with effects on floods and contaminant transport – Predicting the impact of Greenhouse gases on climate change over time. – Forecasting dynamic response of multiple fluids in the subsurface to waste disposal (e.g. carbon sequestration) 4
Quantifying Uncertainty from Dynamic Model Predictions with Model Parameters based on Data 5 Calibration Time Periods With Measured Static Input and Dynamic Output (flow, contamination, etc.) Forecasting Time Period Using Estimates of Static Input Data is taken during Calibration time period and it can be used to establish parameter values (as deterministic values or parameters as random variables with pdfs estimated based on data). We then want to forecast model output in the future using a probabilistic representation of model parameters and input. This forecast then has uncertainty including static and dynamic inputs, model error, and parameter error Measured (Weather) Dynamic Input Predicted (Weather) Input-perhaps many scenarios to represent randomness TIME
6 How Do We Protect This Water From Pollution? This is New York City (NYC) water supply. Excess Phosphorous from Watershed would result in cost of $US 8 Billion Water Treatment Plant for NYC!
7 Study Area Cannonsville Reservoir Basin – agricultural basin New York City water supply P restriction impedes economic growth of county Model incorporates over 20,000 data values available for this watershed.
8 Cow Waste (Manure) Is the Primary Source of Phosphorous Transported By Water to Lake Cow Waste (Manure) is Primary Source of Phosphorous Reaching River and Lake
9 SWAT2000: A Spatially Distributed Simulation Model with Subbasins, Land Use and Soil Type in HRUs 43 subbasins 758 HRUs Avg HRU = 1.6 km 2 Using a spatially distributed model helps us evaluate management options. SWAT model developed by USDA and is used worldwide.
Sept 12, Simulation Model Predictions of Annual Phosphorous Contamination: Repeating Climates for 72 years By repeating 12 year blocks of climate, the trends in climate inputs are eliminated P load to reservoir simulated to increase over time! Increase is measured relative to first climate block = ( )/34297*100% = 11.4% increase in P load to reservoir over 72 yrs
Significance of Results on Phosphorous in Watershed The forecast of increase in phosphorous loading to the water (with no increase in human or animal activity) is very serious because: – NY Citys drinking water quality will decline (and there might not be a replacement) – Future cost could be Billions of dollars – Steps should be taken now to stop the increase in phosphorous pollution Hence the rate of increase (11%/72 years) is important and we would like to know the uncertainty associated with it. 11
Sustainability/Energy Issues Development of renewable energy devices –fuel cells, photovoltaics, biofuels, etc. Wind Energy also has some of the same issues as the watershed analysisyou have a calibration period, but the real uncertainty is during the forecast period and is driven by variability in weather inputs (and fear of disasters). My group has started to work on Carbon Sequestration which is important in waste disposal and has some similarity to the problems that arise in nuclear waste disposal.
Carbon Sequestration Another Application where Uncertainty Quantification is Important Carbon sequestration: storage of super critical carbon dioxide in geological formations about 1 kilometer below the surface.
Uncertainty Quantification Importance for Carbon Sequestration The issue is that there are serious public health and environmental risks associated with the unexpected movement of CO2 upward to groundwater or to the surface. We would like to use a model plus monitoring data to generate an estimate of the CO2 plume in the ground to determine if the system is functioning OK and where the plume is going to move in the future. 14
Related Issues How do we eciently quantify tail probabilities/rare events of high-impact? Can we augment the predictive ability by using experiments? How? Can we derive predictive reduced-order models and/or response surfaces? Likelihoods can be multimodal and/or rough. 15
16 Most Nonlinear Simulation Models will Lead to Likelihood Models with Multiple Local Minima Multi-Modal Problems have Multiple local minima F(x) X (parameter value) Local minimum Global minimum
17 Likelihood can be a Rough Surface because of Numerical Simulation Objective (likelihood) Function Versus Parameter Value
Our Approach to Uncertainty Quantification I have been working with statistician David Ruppert and others on quantification of uncertainty for computationally expensive simulation models. My approach has been to imbed both optimization search and response surfaces into the algorithms for uncertainty quantification to significantly reduce computational effort (by orders of magnitude). Our methods are designed to work with multi modal functions and rough surfaces. 18
19 Paper 1 on SOARS Blizniouk, N., D. Ruppert, C.A. Shoemaker, R. G. Regis, S. Wild, P. Mugunthan, Bayesian Calibration of Computationally Expensive Models Using Optimization and Radial Basis Function Approximation. Journal of Computational and Graphical Statistics, July 2008.
20 Notation Y 0 - vector of observed data; η - parameters in the (joint) statistical model [list1|list2] - conditional density of random variables in list1 given list2, e.g. Is the conditional density of η given the data Y 0 η= in this example
21 Kernel estimates of the marginal posterior densities by a) (solid line) exact joint posterior obtained from conventional MCMC.Analysis with 10,000 function evaluations & b) (dashed lines) with our function approximation method with 150 function evaluations. One graph for each parameter.
22 OUTPUT UNCERTAINTY: Again we got excellent agreement between our approach with 150 evaluations and the conventional approach with 10,000 evaluations. Output Comparison
23 SWAT2000: A Spatially Distributed Simulation Model with Subbasins, Land Use and Soil Type in HRUs 43 subbasins 758 HRUs Avg HRU = 1.6 km 2 Using a spatially distributed model helps us evaluate management options. SWAT model developed by USDA and is used worldwide.
24 Marginal posterior Densities of the 5 parameters (β i ) for watershed model This contains all the statistical information. Everything else is computed on the basis of this.
25 Joint Posterior Density of Six Different Model Outputs
26 Quantiles, Means, Standard Dev. These are based on statistically rigorous analysis with transformations to account for non normal data obtained with a small fraction of the number of simulations required by other methods including MCMC and GLUE
Groundwater Simulation Model for Beijing Figure 1. Miyun-Huai-Shun groundwater aquifer with hydraulic head observation wells of the study area. The main aquifer covers 456 km 2 of the basin area. This is primary water supply for Beijing. Upper layers of the Aquifer are contaminated, thereby significantly reducing Beijings water supply. Parameter estimation goal in order to understand effect of extracting water and potential for contamination. Model involves solving PDEs. 28
Groundwater Aquifer is 3-dimensional. Below is a vertical cross section. Cross Hatched areas indicate different conductivities, which need to be estimated as parameters. Simulation model solves a systems of partial differential equations by finite difference method. 29