F. Fairag, H Tawfiq and M. Al-Shahrani Department of Math & Stat Department of Mathematics and Statistics, KFUPM. Nov 6, 2013 Preconditioning Technique.

Slides:



Advertisements
Similar presentations
5.1 Real Vector Spaces.
Advertisements

General Linear Model With correlated error terms  =  2 V ≠  2 I.
Point-wise Discretization Errors in Boundary Element Method for Elasticity Problem Bart F. Zalewski Case Western Reserve University Robert L. Mullen Case.
03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou.
Applied Linear Algebra - in honor of Hans SchneiderMay 25, 2010 A Look-Back Technique of Restart for the GMRES(m) Method Akira IMAKURA † Tomohiro SOGABE.
Modern iterative methods For basic iterative methods, converge linearly Modern iterative methods, converge faster –Krylov subspace method Steepest descent.
1.2 Row Reduction and Echelon Forms
Linear Equations in Linear Algebra
Signal , Weight Vector Spaces and Linear Transformations
Signal , Weight Vector Spaces and Linear Transformations
Linear Transformations
6 6.1 © 2012 Pearson Education, Inc. Orthogonality and Least Squares INNER PRODUCT, LENGTH, AND ORTHOGONALITY.
Homogenization and porous media Heike Gramberg, CASA Seminar Wednesday 23 February 2005 by Ulrich Hornung Chapter 1: Introduction.
Computational Solutions of Helmholtz Equation Yau Shu Wong Department of Mathematical & Statistical Sciences University of Alberta Edmonton, Alberta, Canada.
1 L-BFGS and Delayed Dynamical Systems Approach for Unconstrained Optimization Xiaohui XIE Supervisor: Dr. Hon Wah TAM.
Chapter 5 Orthogonality
A posteriori Error Estimate - Adaptive method Consider the boundary value problem Weak form Discrete Equation Error bounds ( priori error )
Ch 7.9: Nonhomogeneous Linear Systems
Chapter 3 Determinants and Matrices
6 1 Linear Transformations. 6 2 Hopfield Network Questions.
Iterative Solvers for Coupled Fluid-Solid Scattering Jan Mandel Work presentation Center for Aerospace Structures University of Colorado at Boulder October.
Tutorial 10 Iterative Methods and Matrix Norms. 2 In an iterative process, the k+1 step is defined via: Iterative processes Eigenvector decomposition.
Boyce/DiPrima 9th ed, Ch 11.2: Sturm-Liouville Boundary Value Problems Elementary Differential Equations and Boundary Value Problems, 9th edition, by.
Subdivision Analysis via JSR We already know the z-transform formulation of schemes: To check if the scheme generates a continuous limit curve ( the scheme.
1) CG is a numerical method to solve a linear system of equations 2) CG is used when A is Symmetric and Positive definite matrix (SPD) 3) CG of Hestenes.
Introduction Information in science, business, and mathematics is often organized into rows and columns to form rectangular arrays called “matrices” (plural.
GROUPS & THEIR REPRESENTATIONS: a card shuffling approach Wayne Lawton Department of Mathematics National University of Singapore S ,
Numerical Computations in Linear Algebra. Mathematically posed problems that are to be solved, or whose solution is to be confirmed on a digital computer.
MATH 250 Linear Equations and Matrices
CHAPTER FIVE Orthogonality Why orthogonal? Least square problem Accuracy of Numerical computation.
Algorithms for a large sparse nonlinear eigenvalue problem Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
Gram-Schmidt Orthogonalization
1 Part II: Linear Algebra Chapter 8 Systems of Linear Algebraic Equations; Gauss Elimination 8.1 Introduction There are many applications in science and.
Multivariate Statistics Matrix Algebra II W. M. van der Veld University of Amsterdam.
Linear Algebra (Aljabar Linier) Week 10 Universitas Multimedia Nusantara Serpong, Tangerang Dr. Ananda Kusuma
Chapter 3 Solution of Algebraic Equations 1 ChE 401: Computational Techniques for Chemical Engineers Fall 2009/2010 DRAFT SLIDES.
Discontinuous Galerkin Methods Li, Yang FerienAkademie 2008.
Chapter 5 Eigenvalues and Eigenvectors 大葉大學 資訊工程系 黃鈴玲 Linear Algebra.
Mathematical foundationsModern Seismology – Data processing and inversion 1 Some basic maths for seismic data processing and inverse problems (Refreshement.
Vector Norms and the related Matrix Norms. Properties of a Vector Norm: Euclidean Vector Norm: Riemannian metric:
Elementary Linear Algebra Anton & Rorres, 9th Edition
The swiss-carpet preconditioner: a simple parallel preconditioner of Dirichlet-Neumann type A. Quarteroni (Lausanne and Milan) M. Sala (Lausanne) A. Valli.
DE Weak Form Linear System
E - BOOK FOR COLLEGE ALGEBRA King Fahd University of Petroleum & Minerals B.1 E - BOOK FOR COLLEGE ALGEBRA King Fahd University of Petroleum & Minerals.
Chapter 24 Sturm-Liouville problem Speaker: Lung-Sheng Chien Reference: [1] Veerle Ledoux, Study of Special Algorithms for solving Sturm-Liouville and.
HEAT TRANSFER FINITE ELEMENT FORMULATION
Generalized Finite Element Methods
Arab Open University Faculty of Computer Studies M132: Linear Algebra
Partial Derivatives Example: Find If solution: Partial Derivatives Example: Find If solution: gradient grad(u) = gradient.
STATIC ANALYSIS OF UNCERTAIN STRUCTURES USING INTERVAL EIGENVALUE DECOMPOSITION Mehdi Modares Tufts University Robert L. Mullen Case Western Reserve University.
Consider Preconditioning – Basic Principles Basic Idea: is to use Krylov subspace method (CG, GMRES, MINRES …) on a modified system such as The matrix.
Krylov-Subspace Methods - I Lecture 6 Alessandra Nardi Thanks to Prof. Jacob White, Deepak Ramaswamy, Michal Rewienski, and Karen Veroy.
Finite Element Method. History Application Consider the two point boundary value problem.
Programming assignment # 3 Numerical Methods for PDEs Spring 2007 Jim E. Jones.
1 1.2 Linear Equations in Linear Algebra Row Reduction and Echelon Forms © 2016 Pearson Education, Ltd.
Matrices, Vectors, Determinants.
1) CG is a numerical method to solve a linear system of equations 2) CG is used when A is Symmetric and Positive definite matrix (SPD) 3) CG of Hestenes.
Lecture XXVII. Orthonormal Bases and Projections Suppose that a set of vectors {x 1,…,x r } for a basis for some space S in R m space such that r  m.
Boundary Element Analysis of Systems Using Interval Methods
Solving Linear Systems Ax=b
GROUPS & THEIR REPRESENTATIONS: a card shuffling approach
Linear Equations in Linear Algebra
Lial/Hungerford/Holcomb/Mullins: Mathematics with Applications 11e Finite Mathematics with Applications 11e Copyright ©2015 Pearson Education, Inc. All.
Objective Numerical methods Finite volume.
Maths for Signals and Systems Linear Algebra in Engineering Lecture 6, Friday 21st October 2016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL.
Ph.D. Thesis Numerical Solution of PDEs and Their Object-oriented Parallel Implementations Xing Cai October 26, 1998.
Eigenvalues and Eigenvectors
Chapter 3 Modeling in the Time Domain
Linear Equations in Linear Algebra
1st semester a.y. 2018/2019 – November 22, 2018
Presentation transcript:

F. Fairag, H Tawfiq and M. Al-Shahrani Department of Math & Stat Department of Mathematics and Statistics, KFUPM. Nov 6, 2013 Preconditioning Technique for Darcys Law in Porous Media King Fahd University of Petroleum & Minerals Dhahran, Saudi Arabia

Main Idea Sparse indefinite ill-conditioned We begin with Matrices A and B are generated from specific problem In this talk, we will present a preconditioner for this linear system. Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Main Idea the first interval is of small size The preconditioned matrix is nonsymmetric Powell-Silvester [2003]Bramble-Pasiak [1988] The eigenvalues of the preconditioned matrix discrete represent It is self-adjoint in the inner product H and + PCG based on this inner product can be applied P-MINRES can be applied Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Outline 1)Definition ( all matrices A,B,D,N ) 2)self-adjointness (H-symm) 3)Clustering (eigenvalues) 4)Positive definiteness 5)Numerical Examples 1)Definition ( all matrices A,B,D,N ) 2)self-adjointness (H-symm) 3)Clustering (eigenvalues) 4)Positive definiteness 5)Numerical Examples Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Matrices Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

We consider the solution of system of linear algebraic equations which is obtained from Raviart-Thomas mixed finite element formulation of Darcys equations. We begin with the mixed formulation of Darcy flow with some suitable boundary conditions u is the velocity p is the pressure K represents the permeability. Main Idea Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Saddle Point Problem We begin with the mixed formulation of Darcy flow We define the two subspaces Velocity and pressure space there exist positive constants Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Saddle Point Problem We begin with the mixed formulation of Darcy flow Multiplying by test functions, integrating the first equation by parts and imposing essential boundary conditions yield the variational problem, Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Saddle Point Problem Department of Mathematics and Statistics, KFUPM. Nov 6, 2013 Two Hilbert spaces Two binlinear forms Consider the following problem we assume that (*) has a unique solution. Thm:Babuska(1971) (Brezzi 1974) Abstract Mixed Formulation

Discrete Form We restrict our discussion to the lowest order Raviart-Thomas space On rectangles Department of Mathematics and Statistics, KFUPM. Nov 6, 2013 We start by dividing the domain into triangles or rectangles

Saddle Point Problem discrete velocity space discrete pressure space give the problem Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Saddle Point Problem the velocity divergence matrix the pressure mass matrix Department of Mathematics and Statistics, KFUPM. Nov 6, 2013 A+D is the matrix representation of the div-norm N is the matrix representation of the 0-norm

Self-adjoint Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Self-Adjoint Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

 Meyer and Steidten (2001).  Benzi and Simoncini (2006).  Liesen and Parlett (2006).  Stoll and Wathen (2008). (excellent survey) Extensions to the classical BramblePasciak case: Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Self-Adjoint Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Positive Definiteness Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Positive Definite Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

congruence transformation Positive Definite = Sylvester's law of inertia ifpositive ifpositive Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Lemma 1 There exist two positive numbers and such that Lemma 2 There exist two positive numbers and such that For some positive numbers and for all Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Eigenvalues Clustering Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

We study the generalized eigenvalue problem We get Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013 We want to compute all eigenvalues

Assume that Hence, eigenvalues (multiplicity n). Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

If, then we have So that the remaining m eigenvalues satisfy This equation leads to four cases. Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Spectral Properties Theorem 4.3: If is a quasi-uniform mesh, the n+m eigenvalue of the generalized eigenvalue problem, where lie on the intervals, where is the minimum eigenvalue of the Schur complement and c is a constant independent of h. Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Example 4.1 is an eigenvalue of multiplicity n the remaining m positive eigenvalues Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Theorem 4.4: If is a quasi-uniform mesh, the n+m eigenvalue of the generalized eigenvalue problem, wherelie on the union of the intervals, where is the minimum eigenvalue of the Schur complement is the area of the smallest element in and c is a constant independent of h. Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Example 4.2 is an eigenvalue of multiplicity n the remaining m positive eigenvalues Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Theorem 4.5: If is a quasi-uniform mesh, the n+m eigenvalue of the generalized eigenvalue problem, where lie on the union of the intervals, Spectral Properties where is the minimum eigenvalue of the Schur complement is the area of the smallest element in and c is a constant independent of h.

Theorem 4.6: If is a quasi-uniform mesh, the n+m eigenvalue of the generalized eigenvalue problem, where lie on the union of the intervals, Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Example 4.4 Then the eigenvalue of the preconditioned matrix lie on the union of the following intervals Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

We study the problem on with uniform mesh The observed eigenvalues of the preconditioned matrix system are listed in the following table Our goal is to verify that the bounds (obtained) agree with the computed bounds. Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

The last four columns confirm that the bounds in Theorem (4.3) and Theorem (4.5) are tight. left bound Right bound Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

The last four columns confirm that the bounds in Theorem (4.3) and Theorem (4.5) are tight. left bound Right bound Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

In this example, we consider the same problem in Example (1) and we compute the eigenvalues of the original matrix and the preconditioned matrix. The Figure shows the eigenvalues clustering for the original matrix in (TOP) and the preconditioned matrix using preconditioner from case2 with (BOTTOM) Spectral Properties Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Numerical Experiments Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

We solve the resulting linear system in three different ways. 1) without a preconditioner. 2-3) using GMRES method with two different set of parameters The Table shows GMRES iterations for these different ways. Without preconditioner Preconditioner with GMRES Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

 In this example, we apply H-CG with two different sets of parameters. These two sets ensures that the matrices H and are symmetric positive definite. These choices of parameters make the preconditioned matrix self-adjoint and positive definite with respect to the inner product H·, The first set of parameters is (γ1, γ2, α) = (0.001, 0.5, 0.002).  Theorem (4.5) implies that the eigenvalues of the preconditioned matrix lie on the union of the intervals, [1.0009, ) ∪ [1000]. The second set of parameters is (γ1, γ2, α) = (0.0001, , ).  Theorem (4.3) implies that the eigenvalues of the preconditioned matrix lie on the union of the intervals, [0.9525, ) ∪ [10000].  We carried out computations with various mesh sizes.  For our numerical computations we have chosen TOL = 10−3 and the initial guess x0 to be the zero vector.  Iteration counts are reported in Table (6.4). This table shows that the number of iterations is insensitive to the linear system size. PCG based on H inner product Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

MeshSysSizeset1set2 8x x x x x x PCG based on H inner product Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

The following experiment report on P-H_MINRES convergence with different parameters. We apply P-H-MINRES (Algorithm 2) to the system with a stopping tolerance of 10^-6 on the residual norm with respect to H. If the number of iterations is more than 1,000, we use the symbol *. Example 6.5 We consider the same problem in Example 6.1 and we solve it using both the classical MINRES on the unpreconditioned system and the H- MINRES on the preconditioned system with a stopping tolerance of 10^-6. We choose the parameters These values are chosen such that H is symmetric positive definite. The number of iterations are reported in the following Table. P-MINRES based on H inner prod

h Unpreconditioned system Preconditioned system *3 P-MINRES based on H inner prod Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

Example 6.6: We test, in this example, the performance of the preconditioner in the presence of discontinuous coefficients. Let with Iteration counts are in the Table. * * * * * *3* Department of Mathematics and Statistics, KFUPM. Nov 6, 2013

 We present a preconditioner so that PCG based on H-inner product can be applied.  Several numerical tests confirm that the computational bounds agree with the theoretical bounds.  Numerical experiments illustrate good convergence properties.  The k-th error can be written as  We study the eigenvalues of the matrix instead of Lemma 1 [Pestana and Wathen 2013].  We found the parameters experimentally (with no relations). Conclusions and Remarks

Questions or comments