Chapter 6 Calibration and Application Process

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Running a model's adjoint to obtain derivatives, while more efficient and accurate than other methods, such as the finite difference method, is a computationally.
NWS Calibration Workshop, LMRFC March, 2009 Slide 1 Sacramento Model Derivation of Initial Parameters.
Model calibration using. Pag. 5/3/20152 PEST program.
Incorporation of Magnetic Resonance Sounding data into groundwater models through coupled and joint inversion 8th Annual Meeting of DWRIP 2014 JANUARY.
Aspects of Conditional Simulation and estimation of hydraulic conductivity in coastal aquifers" Luit Jan Slooten.
Final Project I. Calibration II.Drawdown Prediction III.Particle Tracking IV.Presentation of Results.
(Z&B) Steps in Transport Modeling Calibration step (calibrate flow model & transport model) Adjust parameter values.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 10 th Edition.
Uncertainty analysis and Model Validation.
X y ocean 2L L Island Recharge Problem ocean well R= ft/d T= 10,000 ft 2 /day.
Interdisciplinary Modeling of Aquatic Ecosystems Curriculum Development Workshop July 18, 2005 Groundwater Flow and Transport Modeling Greg Pohll Division.
Meta-analysis & psychotherapy outcome research
The Calibration Process
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Quantify prediction uncertainty (Book, p ) Prediction standard deviations (Book, p. 180): A measure of prediction uncertainty Calculated by translating.
Uses of Modeling A model is designed to represent reality in such a way that the modeler can do one of several things: –Quickly estimate certain aspects.
What is UCODE_2005?. Model Calibration Trial and Error Data Model Output Model Design Boundary conditions Geometry Transmissivity Recharge “Intelligent”
Confidence Interval Estimation
Calibration Guidelines 1. Start simple, add complexity carefully 2. Use a broad range of information 3. Be well-posed & be comprehensive 4. Include diverse.
Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.
IV. Sensitivity Analysis for Initial Model 1. Sensitivities and how are they calculated 2. Fit-independent sensitivity-analysis statistics 3. Scaled sensitivities.
Uncertainty Analysis and Model “Validation” or Confidence Building.
The use of a streamflow hydrograph to estimate ground-water recharge and discharge in humid settings By Al Rutledge U.S. Geological Survey Geological Society.
Confidence Interval Estimation
SIMULATION USING CRYSTAL BALL. WHAT CRYSTAL BALL DOES? Crystal ball extends the forecasting capabilities of spreadsheet model and provide the information.
III. Ground-Water Management Problem Used for the Exercises.
Management Application: Volume of Water in Storage (An Ogallala Example with Applicability to All Aquifers in Texas) Judy A. Reeves, Ph.D. Hydrogeologist,
(Zheng and Bennett) Steps in Transport Modeling Calibration step (calibrate flow model & transport model) Adjust parameter values Traditional approach.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
Watershed Hydrology Modeling: What is Considered Calibrated? Presented by: Jeremy Wyss, HIT Tetra Tech Presented by: Jeremy Wyss, HIT Tetra Tech 27 th.
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy’s NNSA U N C L A S S I F I E D Slide 1 Practical Considerations for Analysis.
A More Accurate and Powerful Tool for Managing Groundwater Resources and Predicting Land Subsidence: an application to Las Vegas Valley Zhang, Meijing.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
Calibration Guidelines 1. Start simple, add complexity carefully 2. Use a broad range of information 3. Be well-posed & be comprehensive 4. Include diverse.
General governing equation for steady-state, heterogeneous, anisotropic conditions 2D Laplace Eqn. --Homogeneous and isotropic aquifer without a sink/source.
Experiences in assessing deposition model uncertainty and the consequences for policy application Rognvald I Smith Centre for Ecology and Hydrology, Edinburgh.
IX. Transient Model Nonlinear Regression and Statistical Analysis.
Working With Simple Models to Predict Contaminant Migration Matt Small U.S. EPA, Region 9, Underground Storage Tanks Program Office.
Metrology for Chemical Analysis
Monte-Carlo based Expertise A powerful Tool for System Evaluation & Optimization  Introduction  Features  System Performance.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Colleague Review GW Reports January Colleague Review of Ground-Water Reports n Mapping Reports n Ground-Water Modeling Reports n Geochemistry Reports.
Types of Boundary Conditions 1.Specified head (including constant head) h = f (x,y,z,t) 2.Specified flux (including no flow)  h/  l = -q l /K l 3.Head-dependent.
Calibration & Sensitivity Analysis. Head measured in an observation well is known as a target. Baseflow measurements or other fluxes (e.g., ET) are also.
Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 ( ) Last time: Nonlinear Inversion Solution appraisal.
Using Modelling to Address Problems Scientific Enquiry in Biology and the Environmental Sciences Modelling Session 2.
1 Estimating Empirical Unit Hydrographs (and More) Using AB_OPT LMRFC Calibration Workshop March 10-13, 2009.
Geo597 Geostatistics Ch11 Point Estimation. Point Estimation  In the last chapter, we looked at estimating a mean value over a large area within which.
Goal of Stochastic Hydrology Develop analytical tools to systematically deal with uncertainty and spatial variability in hydrologic systems Examples of.
Building Transient MODFLOW Models
AUTOMATED PARAMETER ESTIMATION Model Parameterization, Inverse Modeling, PEST.
Using General Inverse Theory to Calibrate the Island Recharge Problem in EXCEL.
MECH 373 Instrumentation and Measurements
Groundwater in Hydrologic Cycle
Chapter 7 Confidence Interval Estimation
Two-Sample Hypothesis Testing
The Calibration Process
(Additional materials)
Height and Pressure Test for Improving Spray Application
Materials for Lecture 18 Chapters 3 and 6
Uses of Modeling A model is designed to represent reality in such a way that the modeler can do one of several things: Quickly estimate certain aspects.
Calibration.
Lecture 6 Implementing Spatial Analysis
Multi-modality image registration using mutual information based on gradient vector flow Yujun Guo May 1,2006.
CHAPTER 29: Multiple Regression*
Modelling data and curve fitting
Confidence Interval Estimation
Summary of Results & Conclusions
Presentation transcript:

Chapter 6 Calibration and Application Process

6.1 The Calibration Process Calibration of a flow model refers to a demonstration that the model is capable of producing field-measured heads and flows which are the calibration values. Calibration is accomplished by finding a set of parameters, boundary conditions, and stresses that produce simulated head and fluxes that match filed-measured values within a preestablished range of error.

Finding this set of values amounts to solving what is known as the inverse problem. In an inverse problem the objective is to determine values of the parameters and hydrologic stresses from information about head, whereas in the forward problem system parameters such as hydraulic conductivity, specific storage, and hydrologic stresses such as recharge rate are specified and the model calculates heads.

(1) manual trial-and-error adjustment of parameters; There are basically two ways of finding model parameters to achieve calibration, i.e., of solving the inverse problem: (1) manual trial-and-error adjustment of parameters; (2) automated parameter estimation.

(1) Trial-and-error calibration: Trial-and-error calibration may produce nonunique solutions when different combinations of parameters yield essentially the same head distribution. The trial-and-error process is influenced by the modeler’s expertise and biases.

(2) Automated calibration: Automated inverse modeling is performed using specially developed codes that use either a direct or indirect approach to solve the inverse problem. The indirect approach is similar to performing trial-and-error calibrations in that the forward problem is solved repeatedly.

Automated Calibration: using specially developed codes that use either a direct or indirect approach to solve the inverse problem. In a direct solution, the unknown parameters are treated as dependent variables in the governing equation and heads are treated as independent variables. Problem: unstable of solution

indirect solution: An inverse code automatically checks the head solution and adjusts parameters in a systematic way in order to minimize an objective function. Methods used to minimize objective functions are often based on Gauss-Newton or gradient search methods. to control instability by proper zonation of aquifer parameters

To date, automated inverse models have had limited application To date, automated inverse models have had limited application. They are criticized because of problems with nonuniqueness and instability

6.2 Evaluating the Calibration The results of the calibration should be evaluated both qualitatively and quantitatively.

(1) Traditional measures of calibration: Comparison between contour maps of measured and simulated heads provides a visual, qualitative measure of the similarity between patterns, thereby giving some idea of the spatial distribution of error in the calibration.

A scatterplot of measured against simulated heads is another way of showing the calibrated fit.

A listing of measured and simulated heads together with their differences is a common way of reporting calibration results.

(2) Distribution of error: The distribution of head residuals may be shown in discrete form (Fig. 8.13a) or using contours (Fig. 8.13b).

(3) Sensitivity analysis: The purpose of a sensitivity analysis is to quantify the uncertainty in the calibration model caused by uncertainty in the estimates of aquifer parameters, stresses, and boundary conditions. During a sensitivity analysis, calibrated values of hydraulic conductivity, storage parameters, recharge, and boundary conditions are systematically changed within the previously established plausible range. The magnitude of change in heads from the calibrated solution is a measure of the sensitivity of the solution to that particular parameter.

Sensitivity analysis is typically performed by changing one parameter value at a time.

(4) Model verification: Owing to uncertainties in the calibration, the set of parameter values used in the calibrated model may not accurately represent field values. Model verification will help establish greater confidence in the calibration. Verification is accomplished when the verification targets are matched without changing the calibrated parameter values. A calibrated but unverified model can still be used to make predictions as long as careful sensitivity analyses of both the calibrated model and the predictive model are performed and evaluated.

6.3 Prediction In a predictive simulation, the parameters determined during calibration and verification are used to predict the response of the system to future events. The confidence to be placed in model predictions depends largely on the results of the calibration, sensitivity analyses, and verification tests. Faust et al. (1981) suggest that a predictive simulation not be extended into the future more than twice the period for which calibration data are available.

Two major pitfalls are involved in making predictions: uncertainty in the calibrated model and uncertainty about future hydrologic stresses. Each of these requires a different type of sensitivity analysis.