AN ITERATIVE METHOD FOR MODEL PARAMETER IDENTIFICATION 4. DIFFERENTIAL EQUATION MODELS E.Dimitrova, Chr. Boyadjiev E.Dimitrova, Chr. Boyadjiev BULGARIAN.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Chapter 7 Statistical Data Treatment and Evaluation
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2013 – 12269: Continuous Solution for Boundary Value Problems.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
DIFFUSION MODELS OF A FLUIDIZED BED REACTOR Chr. Bojadjiev Bulgarian Academy of Sciences, Institute of Chemical Engineering, “Acad. G.Bontchev” str.,
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
N.D.GagunashviliUniversity of Akureyri, Iceland Pearson´s χ 2 Test Modifications for Comparison of Unweighted and Weighted Histograms and Two Weighted.
Markov processes in a problem of the Caspian sea level forecasting Mikhail V. Bolgov Water Problem Institute of Russian Academy of Sciences.
Curve Fitting and Interpolation: Lecture (IV)
Simultaneous Equations Models
WFM 5201: Data Management and Statistical Analysis
Development of Empirical Models From Process Data
Linear Programming Applications
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
5-3 Inference on the Means of Two Populations, Variances Unknown
Nonlinear Stochastic Programming by the Monte-Carlo method Lecture 4 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO.
Interval-based Inverse Problems with Uncertainties Francesco Fedele 1,2 and Rafi L. Muhanna 1 1 School of Civil and Environmental Engineering 2 School.
Least-Squares Regression
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Ch 8.1 Numerical Methods: The Euler or Tangent Line Method
QNT 531 Advanced Problems in Statistics and Research Methods
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
CORRELATION & REGRESSION
Additional Topics in Differential Equations
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
Accuracy Based Generation of Thermodynamic Properties for Light Water in RELAP5-3D 2010 IRUG Meeting Cliff Davis.
Introduction 1. Similarity 1.1. Mechanism and mathematical description 1.2. Generalized variables 1.3. Qualitative analysis 1.4. Generalized individual.
1 Tests of Significance In this section we deal with two tests used for comparing two analytical methods, one is a new or proposed method and the other.
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
An Efficient Sequential Design for Sensitivity Experiments Yubin Tian School of Science, Beijing Institute of Technology.
SOME THEORETICAL PROBLEMS IN CHEMICAL ENGINEERING Chr. Bojadjiev Bulgarian Academy of Sciences, Institute of Chemical Engineering, “Acad. G.Bontchev”
Xianwu Ling Russell Keanini Harish Cherukuri Department of Mechanical Engineering University of North Carolina at Charlotte Presented at the 2003 IPES.
VI. Regression Analysis A. Simple Linear Regression 1. Scatter Plots Regression analysis is best taught via an example. Pencil lead is a ceramic material.
Numerical Methods.
Silesian University of Technology in Gliwice Inverse approach for identification of the shrinkage gap thermal resistance in continuous casting of metals.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Mean, Variance, Moments and.
INTRODUCTION Many heat and mass transfer processes in column apparatuses may be described by the convection – diffusion equation with a volume reaction.
Copyright © Cengage Learning. All rights reserved. 12 Analysis of Variance.
Correlation & Regression Analysis
Point Estimation of Parameters and Sampling Distributions Outlines:  Sampling Distributions and the central limit theorem  Point estimation  Methods.
ON THE MODELING OF AN AIRLIFT PHOTOBIOREACTOR Christo Boyadjiev, Jose Merchuk Introduction Mathematical model Average concentration model Hierarchical.
ChE 452 Lecture 07 Statistical Tests Of Rate Equations 1.
Statistics Sampling Distributions and Point Estimation of Parameters Contents, figures, and exercises come from the textbook: Applied Statistics and Probability.
CHAPTER 2.3 PROBABILITY DISTRIBUTIONS. 2.3 GAUSSIAN OR NORMAL ERROR DISTRIBUTION  The Gaussian distribution is an approximation to the binomial distribution.
Fourier Approximation Related Matters Concerning Fourier Series.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University.
Linear Systems Numerical Methods. 2 Jacobi Iterative Method Choose an initial guess (i.e. all zeros) and Iterate until the equality is satisfied. No guarantee.
Counter-current flows in liquid-liquid boundary layers II. Mass transfer kinetics E. Horvath 1, E. Nagy 1, Chr. Boyadjiev 2, J. Gyenis 1 1 University.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
1 Nonparametric Statistical Techniques Chapter 18.
Chapter Outline EMPIRICAL MODELS 11-2 SIMPLE LINEAR REGRESSION 11-3 PROPERTIES OF THE LEAST SQUARES ESTIMATORS 11-4 SOME COMMENTS ON USES OF REGRESSION.
Virtual University of Pakistan
Virtual University of Pakistan
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
ОСНОВИ НА МОДЕЛИРАНЕТО И СИМУЛИРАНЕТО
Bulgarian Academy of Sciences
Chapter 5 STATISTICS (PART 4).
Rutgers Intelligent Transportation Systems (RITS) Laboratory
Error rate due to noise In this section, an expression for the probability of error will be derived The analysis technique, will be demonstrated on a binary.
Unfolding Problem: A Machine Learning Approach
Solution of Equations by Iteration
Virtual University of Pakistan
Product moment correlation
Unfolding with system identification
Further Topics on Random Variables: Derived Distributions
Further Topics on Random Variables: Derived Distributions
Copyright © Cengage Learning. All rights reserved.
MATH 1910 Chapter 3 Section 8 Newton’s Method.
Further Topics on Random Variables: Derived Distributions
Presentation transcript:

AN ITERATIVE METHOD FOR MODEL PARAMETER IDENTIFICATION 4. DIFFERENTIAL EQUATION MODELS E.Dimitrova, Chr. Boyadjiev E.Dimitrova, Chr. Boyadjiev BULGARIAN ACADEMY OF SCIENCES INSTITUTE OF CHEMICAL ENGINEERING 9 TH Workshop on “Transport Phenomena in Two-Phase Flow”

INTRODUCTION Mathematical modeling relevant to heat and mass transfer operation is based on development of adequate mathematical structures (differential equations) employing corresponding physical mechanisms. The model build-up requires values of coefficients that can be obtained through processing of experimental data. Such processing is based on solution of inverse problems and especially inverse identification problems. Very often this problem is incorrect (ill-posed) that implies a solution sensibility due to errors of the experimental data used. An iterative method for inverse problem solution was used for model parameter identification of different models. In this paper the method will be applied for differential equations models. 9 TH Workshop on “Transport Phenomena in Two-Phase Flow”

PROBLEM FORMULATION Let’s consider two-parameter differential equation model where and are the exact values of the parameter. The parameter identification problem will be solved by help of artificial experimental data provided by a random number generator: where A n are random numbers within the interval [0, 1]. 9 TH Workshop on “Transport Phenomena in Two-Phase Flow”

Fig.1 Mathematical model and “experimental” data [] - - “experimental” data with a maximal relative error  5% [──] - - model for b 1 =1 ; b 2 =5. x The values of objective function y n are obtained from the model when x changes in the interval [0;1] ( x=0.01n (n=0,…,99)). The maximal relative errors of these “experimental” data are  5%. The mathematical model and “experimental” data are shown on Fig. 1. These plots show that when 0<x<0.3 the inverse identification problem is correct, while in the case of 0.31<x<0.65 it is incorrect. The problem becomes essentially incorrect when 0.66<x<1. The parameters in the model can be determined through processing of N experimental values of the objective function ( n=1,…,N ). This requires a least square function to be used: 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” PROBLEM FORMULATION Model:

Every method for solving of incorrect problems should solve also correct ones. Therefore, the first solution of the inverse problem considered here corresponds to the interval 0<x<0.3. Let’s consider two-parameter differential equation model. Figure 2 shows models for exact parameter values ( ), calculated parameter values ( ) and “experimental” data. x Fig.2 Model and “experimental” data [  ] - - “experimental” data with a maximal relative error  5% [──] - - model for [-----] - - model for 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” CORRECT PROBLEM SOLUTION Model:

The results of the identification problem solution are summarized in Table 1, where and are calculated values of the parameters, i – iteration number, γ - regularization parameter. 5 Table 1. Correct problem solution (0<x<0.3, γ=1.5 ) 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” CORRECT PROBLEM SOLUTION

The efficiency of every iterative method for function minimization depends on the initial approximation. Parameter values obtained under conditions imposed by different initial approximations are summarized in Table 2. Table 2. Effect of the initial approximation (0<x<0.3, γ=1.5) 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” CORRECT PROBLEM SOLUTION

The iteration number depends on the regularization parameter value γ and the efficiency of the minimization increases when the value of γ is increased. This effect is demonstrated through data summarized on Table Table 3. Effect of γ 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” CORRECT PROBLEM SOLUTION

As commented before, if “experimental” data are obtained under conditions (regimes), corresponding to the interval 0.31<x<0.65, the parameter identification problem will be ill-posed. The problem incorrectness is due to solution sensibility with respect to “experimental” errors of the objective function. Let’s consider a solution of the parameter identification problem through minimization of the least square function, when the inverse identification problem is incorrect (with x=0.01n, n=31,…,65, i.e. 0.31<x<0.65. The solution ( ) ) is shown in Table 4. INCORRECT PROBLEM SOLUTION Table 4. Incorrect problem solution (0.31<x<0.65, γ=0.5 ) 5 TH Workshop on “Transport Phenomena in Two-Phase Flow”

Comparisons between obtained model, exact model, and “experimental” data in the case of correct and incorrect problem are illustrated by plots on Fig.2 and Fig.3. These plots indicate very small differences between obtained model and the exact model. x Fig.2 Model and “experimental” data (0<x<0.3, γ=1.5 ) [  ] - - “experimental” data with a maximal relative error  5% [──] - - model for [-----] - - model for x Fig.3 Model and “experimental” data (0.31<x<0.65, γ=0.5 ) [  ] - - “experimental” data with a maximal relative error  5% [──] - - model for [-----] - - model for 9 TH Workshop on “Transport Phenomena in Two-Phase Flow”

The iteration numbers depend on the initial approximations of the iterative procedure. The results for 0.31<x<0.65 are summarized in Table 5. Table 5. Effect of the initial approximation (0.31<x<0.65, γ=0.5) TH Workshop on “Transport Phenomena in Two-Phase Flow” INCORRECT PROBLEM SOLUTION

The effect of the regularization parameter γ on the iteration numbers are summarized in Table 6. When the regularization parameter increase, then the iteration number is decrease Table 6. Effect of γ 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” INCORRECT PROBLEM SOLUTION

The results presented on Fig. 3 demonstrate that the differences between the exact model and the models derived through parameter identifications are very small. On the other hand, the results in Table 5 show that the differences between the exact and the obtained values of the parameters are significant. The correctness of the parameter identification will be tested below through a criterion of model adequacy. x Fig.3 Model and “experimental” data (0.31<x<0.65, γ=0.5 ) [  ] - - “experimental” data with a maximal relative error  5% [──] - - model for [-----] - - model for Table 5. Effect of the initial approximation

The result of the parameter identification of the two-parameter model with initial approximations and where the inverse problem is essentially incorrect is shown in the Table 7. ESSENTIALLY INCORRECT PROBLEM SOLUTION Table 7. Essentially incorrect problem solution (0.65<x<1, γ=5 ) 5 TH Workshop on “Transport Phenomena in Two-Phase Flow”

The comparison with “experimental” data is shown on Fig. 4. Both the data in Table 7 and plots on Fig. 4 indicate that the differences between obtained and exact parameter values are very large. On the other hand, the differences between obtained and exact models exhibit just the opposite behavior. x Fig.4 Model and “experimental” data (0.31<x<0.65, γ=0.5 ) [  ] - - “experimental” data with a maximal relative error  5% [──] - - model for [-----] - - model for Table 7. Essentially incorrect problem solution (0.65<x<1, γ=5 ) 5 TH Workshop on “Transport Phenomena in Two-Phase Flow”

The effects of the initial approximation and the number of regularization parameter γ also were investigated. The results are summarized in the Tables 8 and 9. Table 8. Effect of the initial approximation Table 9. Effect of γ (0.65<x<1, γ=5) 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” ESSENTIALLY INCORRECT PROBLEM SOLUTION Model adequacy test as a criterion for correctness of results of parameter identification is applied below.

Statistical Analysis of Model Adequacy The model adequacy is defined by the variance ratio: where S and S ε are model and experimental error variance. The value of F is compared to the tabulated values ( F J ) of the Fisher’s distribution. The condition of the model adequacy is where ν=N - J, ν ε =K – 1,  = TH Workshop on “Transport Phenomena in Two-Phase Flow”

The statistical analysis of the model adequacy was performed when the inverse problem is correct, incorrect and essentially incorrect and the results are presented in Table 10. The results confirm the adequacy of the model. When the inverse problem is incorrect the model is adequate despite the large differences between the calculated and the exact values of the model parameters. In case of essential incorrectness of the inverse problem the model employed in this paper is adequate irrespective of the large differences between calculated and exact values of model parameters. 9 TH Workshop on “Transport Phenomena in Two-Phase Flow” Statistical Analysis of Model Adequacy 5 5 5 Table 10. Statistical analysis of the model adequacy

Conclusions An iterative method and algorithm for differential equations model parameters identification in cases of incorrect inverse problems are proposed. Solutions of model parameters identification problems through least square function minimizations show large differences between exact and calculated parameter values. This difference cannot be explained by experimental data size only, but they come also from the inverse problem incorrectness that is mainly due to parameter sensibility with respect to the experimental data errors. Thus, a minimization of least square function cannot be assumed as a solution of parameter identification problem. Additional condition for inverse problem regularization is introduced in the procedure proposed. This condition permits the least square function minimization to be employed for solutions of model parameter identification problem. The model adequacy was tested through a statistical analysis. The latter can be assumed as a criterion of applicability of the iterative method proposed. The solution procedure of the essential incorrect inverse problem for model parameter identification shows, that the iterative procedure convergences when the parameter values are very sensible with respect to the errors of the experimental data. 9 TH Workshop on “Transport Phenomena in Two-Phase Flow”