ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.

Slides:



Advertisements
Similar presentations
Numerical Solution of Linear Equations
Advertisements

ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Chapter 2 Solutions of Systems of Linear Equations / Matrix Inversion
Chapter: 3c System of Linear Equations
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
Algebraic, transcendental (i.e., involving trigonometric and exponential functions), ordinary differential equations, or partial differential equations...
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 28: Orthogonal Transformations.
Least Squares example There are 3 mountains u,y,z that from one site have been measured as 2474 ft., 3882 ft., and 4834 ft.. But from u, y looks 1422 ft.
MATH 685/ CSI 700/ OR 682 Lecture Notes
Solving Linear Systems (Numerical Recipes, Chap 2)
1.5 Elementary Matrices and a Method for Finding
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
CISE301_Topic3KFUPM1 SE301: Numerical Methods Topic 3: Solution of Systems of Linear Equations Lectures 12-17: KFUPM Read Chapter 9 of the textbook.
Numerical Algorithms Matrix multiplication
ECE 333 Renewable Energy Systems Lecture 14: Power Flow Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
1cs542g-term Notes  r 2 log r is technically not defined at r=0 but can be smoothly continued to =0 there  Question (not required in assignment):
Ordinary least squares regression (OLS)
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Parallel Programming in C with MPI and OpenMP Michael J. Quinn.
Monica Garika Chandana Guduru. METHODS TO SOLVE LINEAR SYSTEMS Direct methods Gaussian elimination method LU method for factorization Simplex method of.
ECE 333 Renewable Energy Systems Lecture 13: Per Unit, Power Flow Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois.
Linear Least Squares QR Factorization. Systems of linear equations Problem to solve: M x = b Given M x = b : Is there a solution? Is the solution unique?
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
Table of Contents Solving Systems of Linear Equations - Gaussian Elimination The method of solving a linear system of equations by Gaussian Elimination.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
MATH 250 Linear Equations and Matrices
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
CHAPTER 2 MATRIX. CHAPTER OUTLINE 2.1 Introduction 2.2 Types of Matrices 2.3 Determinants 2.4 The Inverse of a Square Matrix 2.5 Types of Solutions to.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
D. van Alphen1 ECE 455 – Lecture 12 Orthogonal Matrices Singular Value Decomposition (SVD) SVD for Image Compression Recall: If vectors a and b have the.
Matrix. REVIEW LAST LECTURE Keyword Parametric form Augmented Matrix Elementary Operation Gaussian Elimination Row Echelon form Reduced Row Echelon form.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Progress in identification of damping: Energy-based method with incomplete and noisy data Marco Prandina University of Liverpool.
Chapter 5 MATRIX ALGEBRA: DETEMINANT, REVERSE, EIGENVALUES.
Scientific Computing Singular Value Decomposition SVD.
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 4. Least squares.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 476 Power System Analysis Lecture 11: Ybus, Power Flow Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 576 – Power System Dynamics and Stability Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 476 Power System Analysis Lecture 12: Power Flow Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
Ridge Regression: Biased Estimation for Nonorthogonal Problems by A.E. Hoerl and R.W. Kennard Regression Shrinkage and Selection via the Lasso by Robert.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Searching a Linear Subspace Lecture VI. Deriving Subspaces There are several ways to derive the nullspace matrix (or kernel matrix). ◦ The methodology.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Matrices. Variety of engineering problems lead to the need to solve systems of linear equations matrixcolumn vectors.
Lecture 9 Numerical Analysis. Solution of Linear System of Equations Chapter 3.
Numerical Computation Lecture 6: Linear Systems – part II United International College.
Hao Zhu Dept. of Electrical & Computer Engineering University of Illinois, Urbana-Champaign ECE 498HZ: Power Distribution System Analysis.
Chapter: 3c System of Linear Equations
Matrices and Matrix Solutions
Linear Equations.
ECE 333 Green Electric Energy
Numerical Analysis Lecture 16.
Numerical Analysis Lecture14.
Numerical Analysis Lecture10.
ECEN 615 Methods of Electric Power Systems Analysis
ECEN 615 Methods of Electric Power Systems Analysis
ECEN 615 Methods of Electric Power Systems Analysis
Presentation transcript:

ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign 11/16/ Lecture 21: State Estimation; QR Decomposition

State Estimation (SE) The goal of SE is to find the ML estimator for states x with given measurements and their noise levels Noise level  i weighs each measurement according to the ML principle (maximizing the likelihood function) Measurement noise is assumed Gaussian We can still use WLS if noise is not Gaussian – but sacrificing the statistical optimality For example, outliers (bad measurements) often motivate the least absolute-value (LAV) estimation 2

SE Iterative Solution Algorithm Sequential linearization based on the gradient of J(x) Use Newton's method to solve for x for which the gradient is zero 3 This is exactly the least-squares form developed earlier with H T R -1 H an n by n matrix. This could be solved with Gaussian elimination, but this isn't preferred because of the numerical issues

Example: Two Bus Case Assume a two bus case with a generator supplying a load through a single line with x=0.1 pu. Assume measurements of the p/q flow on both ends of the line (into line positive), and the voltage magnitude at both the generator and the load end. So B 12 = B 21 = We need to assume a reference angle unless directly measuring 

Example: Two Bus Case Let 5 We assume an angle reference of   

Example: Two Bus Case With a flat start guess we get 6

Example: Two Bus Case 7

QR Factorization We will introduce another factorization/ decomposition technique for non-square (sparse) matrices First, let us normalize the measurement matrix by splitting the R -1 matrix as QR factorization for the m by n matrix H' is with Q an m by m orthonormal matrix and U an upper triangular matrix (most books use Q R but we use U to avoid confusion with the previous R) 8

QR Factorization We then have But since Q is an orthonormal matrix, Hence we have And 9

QR Factorization Next issue we discuss the QR factorization algorithm to factor any matrix A into an m by m orthonormal matrix Q and an m by n upper triangular matrix U (usually R) Several methods are available including the Householder method and the Givens method Givens is preferred when dealing with sparse matrices An excellent reference is Gene H. Golub and Charles F. Van Loan, Matrix Computations, second edition, Johns Hopkins University Press,

Givens Algorithm The Givens algorithm works by pre-multiplying the desired matrix (A here) by a series of matrices and their transposes, starting with G 1 G 1 T – G k is the identity matrix modified to have two non-ones on the diagonals c = cos(  ), and two non-zero off diagonal elements, one set to -s = -sin(  ), and one to s = sin(  – Each G k is an orthonormal matrix, so pre-multiplying by G k G k T = I ensures the final product is equal to A – G k values are chosen to zero out particular elements in the lower triangle of A 11

Givens Algorithm Algorithm proceeds column by column, sequentially zeroing out elements in the lower triangle of A, starting at the bottom of each column 12

Givens Algorithm 13

Givens G Matrix 14 i j

Small Givens Example Let First we zero out A[2,1], a=1, b=2 giving s= 0.894, c=

Small Givens Example Next zero out A[3,2] with a=1.7889, b=1, giving c= , s= Final solution is 16

Givens Method for SE Example Starting with the H matrix we get To zero out H'[5,1]=1 we have b=100, a=-1000, giving c=0.995, s=

Start of Givens for SE Example Which gives The next rotation would be to zero out element H'[4,1], continuing until all the elements in the lower triangle have been reduced 18

Givens Comments For a full matrix, Givens is O(mn 2 ) since each element in the lower triangle needs to be zeroed O(nm), and each operation is O(n) Computation can be drastically reduced for a sparse matrix since we only need to zero out the elements that are initially non-zero, and any that become non-zero (i.e., the fills) – Also, for each multiply we only need to deal with the nonzeros in the impacted row Givens rotation is commonly used to solve the SE 19