Perturbation analysis of TBR model reduction in application to trajectory-piecewise linear algorithm for MEMS structures. Dmitry Vasilyev, Michał Rewieński,

Slides:



Advertisements
Similar presentations
3D Geometry for Computer Graphics
Advertisements

PROCESS MODELLING AND MODEL ANALYSIS © CAPE Centre, The University of Queensland Hungarian Academy of Sciences Analysis of Dynamic Process Models C13.
Modified Newton Methods Lecture 9 Alessandra Nardi Thanks to Prof. Jacob White, Jaime Peraire, Michal Rewienski, and Karen Veroy.
Dimensionality Reduction PCA -- SVD
Properties of State Variables
PCA + SVD.
Ch. 4: Radial Basis Functions Stephen Marsland, Machine Learning: An Algorithmic Perspective. CRC 2009 based on slides from many Internet sources Longin.
Lecture 17 Introduction to Eigenvalue Problems
A Constraint Generation Approach to Learning Stable Linear Dynamical Systems Sajid M. Siddiqi Byron Boots Geoffrey J. Gordon Carnegie Mellon University.
Slides by Olga Sorkine, Tel Aviv University. 2 The plan today Singular Value Decomposition  Basic intuition  Formal definition  Applications.
1cs542g-term High Dimensional Data  So far we’ve considered scalar data values f i (or interpolated/approximated each component of vector values.
Dimensionality reduction. Outline From distances to points : – MultiDimensional Scaling (MDS) – FastMap Dimensionality Reductions or data projections.
CSE245: Computer-Aided Circuit Simulation and Verification Lecture Note 3 Model Order Reduction (1) Spring 2008 Prof. Chung-Kuan Cheng.
Similarity transformations  Suppose that we are given a ss model as in (1).  Now define state vector v(t) that is the same order of x(t), such that the.
3D Geometry for Computer Graphics
POWER SYSTEM DYNAMIC SECURITY ASSESSMENT – A.H.M.A.Rahim, S.K.Chakravarthy Department of Electrical Engineering K.F. University of Petroleum and Minerals.
Curve-Fitting Regression
1 EE 616 Computer Aided Analysis of Electronic Networks Lecture 7 Instructor: Dr. J. A. Starzyk, Professor School of EECS Ohio University Athens, OH,
Linearisation about point equilibrium n-dimensional autonomous a constant / point equilibrium solution of the dynamics a ‘neighbouring’ solution first-order.
Dynamical Systems Analysis II: Evaluating Stability, Eigenvalues By Peter Woolf University of Michigan Michigan Chemical Process Dynamics.
Computing Sketches of Matrices Efficiently & (Privacy Preserving) Data Mining Petros Drineas Rensselaer Polytechnic Institute (joint.
The Implicit Mapping into Feature Space. In order to learn non-linear relations with a linear machine, we need to select a set of non- linear features.
A Constraint Generation Approach to Learning Stable Linear Dynamical Systems Sajid M. Siddiqi Byron Boots Geoffrey J. Gordon Carnegie Mellon University.
1 EE 616 Computer Aided Analysis of Electronic Networks Lecture 5 Instructor: Dr. J. A. Starzyk, Professor School of EECS Ohio University Athens, OH,
Ordinary least squares regression (OLS)
12 1 Variations on Backpropagation Variations Heuristic Modifications –Momentum –Variable Learning Rate Standard Numerical Optimization –Conjugate.
1 Systems of Linear Equations Error Analysis and System Condition.
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 6. Eigenvalue problems.
Ordinary Differential Equations (ODEs) 1Daniel Baur / Numerical Methods for Chemical Engineers / Explicit ODE Solvers Daniel Baur ETH Zurich, Institut.
Chapter 12 Fast Fourier Transform. 1.Metropolis algorithm for Monte Carlo 2.Simplex method for linear programming 3.Krylov subspace iteration (CG) 4.Decomposition.
1 Introduction to Model Order Reduction Luca Daniel Massachusetts Institute of Technology
Approximation Metrics for Discrete and Continuous Systems Antoine Girard and George J. Pappas VERIMAG Workshop.
NUS CS5247 A dimensionality reduction approach to modeling protein flexibility By, By Miguel L. Teodoro, George N. Phillips J* and Lydia E. Kavraki Rice.
Chapter 2 Dimensionality Reduction. Linear Methods
EXAMPLES: Example 1: Consider the system Calculate the equilibrium points for the system. Plot the phase portrait of the system. Solution: The equilibrium.
Dynamical Systems 2 Topological classification
1 Introduction to Model Order Reduction Luca Daniel Massachusetts Institute of Technology
Introduction to the Hankel -based model order reduction for linear systems D.Vasilyev Massachusetts Institute of Technology, 2004.
SVD: Singular Value Decomposition
MAE 555 Non-equilibrium Gas Dynamics Guest lecturer Harvey S. H. Lam November 16, 2010 On Computational Singular Perturbation.
A more reliable reduction algorithm for behavioral model extraction Dmitry Vasilyev, Jacob White Massachusetts Institute of Technology.
Population Dynamics Application of Eigenvalues & Eigenvectors.
§ Linear Operators Christopher Crawford PHY
On the Use of Sparse Direct Solver in a Projection Method for Generalized Eigenvalue Problems Using Numerical Integration Takamitsu Watanabe and Yusaku.
Serge Andrianov Theory of Symplectic Formalism for Spin-Orbit Tracking Institute for Nuclear Physics Forschungszentrum Juelich Saint-Petersburg State University,
Professor Walter W. Olson Department of Mechanical, Industrial and Manufacturing Engineering University of Toledo System Solutions y(t) t +++++… 11 22.
Diagonalization and Similar Matrices In Section 4.2 we showed how to compute eigenpairs (,p) of a matrix A by determining the roots of the characteristic.
A TBR-based Trajectory Piecewise-Linear Algorithm for Generating Accurate Low-order Models for Nonlinear Analog Circuits and MEMS Dmitry Vasilyev, Michał.
What is the determinant of What is the determinant of
AUTOMATIC CONTROL THEORY II Slovak University of Technology Faculty of Material Science and Technology in Trnava.
BART VANLUYTEN, JAN C. WILLEMS, BART DE MOOR 44 th IEEE Conference on Decision and Control December 2005 Model Reduction of Systems with Symmetries.
State Observer (Estimator)
Chapter 2 Interconnect Analysis Prof. Lei He Electrical Engineering Department University of California, Los Angeles URL: eda.ee.ucla.edu
Variations on Backpropagation.
1 Espen Åkervik 7 th ERCOFTAC SIG33 WORKSHOP Low dimensional model for control of the Blasius boundary layer by balanced truncation Espen Åkervik in collaboration.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
1. Systems of Linear Equations and Matrices (8 Lectures) 1.1 Introduction to Systems of Linear Equations 1.2 Gaussian Elimination 1.3 Matrices and Matrix.
ECE 576 – Power System Dynamics and Stability Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
2D-LDA: A statistical linear discriminant analysis for image matrix
Krylov-Subspace Methods - I Lecture 6 Alessandra Nardi Thanks to Prof. Jacob White, Deepak Ramaswamy, Michal Rewienski, and Karen Veroy.
Guaranteed Stable Projection-Based Model Reduction for Indefinite and Unstable Linear Systems Brad Bond Luca Daniel MIT Speaker: Tuck, Fang Gong.
Nonlinear balanced model residualization via neural networks Juergen Hahn.
Computational Physics (Lecture 7) PHY4061. Eigen Value Problems.
Chair Electric Power Networks and Renewable Energy Sources October 2006, Roskilde 1 Aggregation of Wind Farms for Power System Analysis Krzysztof.
Model Reduction Techniques in Neuronal Simulation Richard Hall, Jay Raol and Steven J. Cox Model Reduction Techniques in Neuronal Simulation Richard Hall,
Dmitry Vasilyev Thesis supervisor: Jacob K White
Lecture 13: Singular Value Decomposition (SVD)
Relative Perturbations for s.d.d. Matrices with applications
EXAMPLES: Example 1: Consider the system
Presentation transcript:

Perturbation analysis of TBR model reduction in application to trajectory-piecewise linear algorithm for MEMS structures. Dmitry Vasilyev, Michał Rewieński, Jacob White Massachusetts Institute of Technology

Outline Background Trajectory-piecewise linear (TPWL) framework for model order reduction TBR-based reduction procedure for TPWL model reduction Numerical example: MEMS switch Perturbation analysis of TBR-generated models Conclusions

Model reduction problem Requirements for reduced model Want q << n (cost of simulation is q 3 ) Want y r (t) to be close to y(t) Original complex model: Reduced model:

Projection basis approach to reduction Pick biorthogonal projection matrices W and V Projection basis are columns of V and W Yields inefficient representation for f r Evaluating W T f(Vx r ) requires order n operations: Vx r =x x n x xrxr V q f r =W T f f xrxr Vx r f(Vx r ) W T f(Vx r )

1.Compute A 1 2.Obtain W 1 and V 1 using linear reduction for A 1 3.Simulate training input, collect and reduce linearizations A i r = W 1 T A i V 1 f r (x i )=W 1 T f(x i ) TPWL approximation of f( ). Extraction algorithm Non-reduced state space Initial system position Training trajectory x1x1 x2x2 x3x3 xnxn …

Obtaining projection basis Krylov-subspace methods Fast Don’t guarantee accuracy Balanced-truncation methods Expensive (~n 3 ) Guarantee accuracy For example, V=W= colspan(A -1 B, A -2 B, …, A -q B) We are using this algorithm

Our Approach: x1x1 x1x1 x2x2 xnxn … W1TA1V1W1TA1V1 W1TA2V1W1TA2V1 W1TA3V1W1TA3V1 W1TAnV1W1TAnV1 We used single linear reduction for obtaining projection basis. There are more options: we can perform several reductions and then aggregate bases.

Use TPWL to handle nonlinearity Before we used Krylov-subspace linear reduction (less accurate) Here we use TBR for projection matrices W and V Our Approach: x0x0 x1x1 x2x2 xnxn …

TBR reduction LTI SYSTEM X (state) t u t y Hankel operator Past input Future output P (controllability) Which states are easier to reach? Q (observability) Which states produces more output? TBR algorithm includes into projection basis most controllable and most observable states

Micromachined device example non-symmetric indefinite Jacobian FD model

TPWL-TBR results – MEMS switch example Errors in transient Order of reduced system || y r – y || 2 Odd order models unstable! Even order models beat Krylov Why??? Unstable!

Hankel singular values, MEMS beam example # of the Hankel singular value This is the key to the problem. Singular values are arranged in pairs!

Outline Background Trajectory-piecewise linear (TPWL) framework for model order reduction TBR-based reduction procedure for TPWL model reduction Numerical example: MEMS switch Perturbation analysis of TBR-generated models Conclusions

Problem statement Consider two LTI systems: Initial: ( ) Perturbed: ( A, B, C ) TBR reduction Projection basis V Define our problem: How perturbation in the initial system affects TBR projection basis? ~ ~ ~ ~

TBR reduction algorithm Our goal: How perturbation in the initial system affects balancing transformation T ? 1)Compute Controllability and observability gramians P and Q 2)Compute Cholesky factor of P : P = R T R 3)Compute SVD of RQR T : UΣ 2 U T = RQR T 4)Projection basis V is first q columns of the matrix T = R T U Σ -1/2

Step 1 - Gramians 1) Compute Controllability and observability gramians P and Q AP + PA T = -BB T Lyapunov equation for P Perturbation (assumed small) Ã=A + δA AδP + δPA T = -(δAP +P(δA) T ) (Keeping 1 st order terms) Small δA result in small δP (same for Q)

Step 2 – Cholesky factors 2) Compute Cholesky factor of P : P = R T R P= UDU T, R = UD 1/2 U T How we compute R (SPD) Perturbations (assumed small) P + δP => R + δR RδR + δRR T = δP (Always solvable for δR if the initial system is controllable) Small δP result in small δR

Step 3 – balancing SVD 3) Compute SVD of RQR T : UΣ 2 U T = RQR T Perturbation behavior of TBR projection is dictated by: Symmetric eigenvalue problem for RQR T

Perturbation theory for symmetric eigenvalue problem Eigenvectors of RQR T : Eigenvectors of RQR T + Δ : Mixing of eigenvectors (assuming small perturbations): c i k large when λ i 0 ≈ λ k 0

Results of the analysis The closer Hankel singular values lie to each other, the more corresponding eigenvectors of V tend to intermix! Analysis implies simple recipe for using TBR Pick reduced order to insure Remaining Hankel singular values are small enough The last kept and first removed Hankel Singular Values are well separated Helps insure that all linearizations stably reduced

TPWL-TBR results – MEMS switch example Errors in transient Order of reduced system || y r – y || 2 Odd order models unstable! Even order models beat Krylov Why??? Unstable!

Hankel singular values, MEMS beam example # of the Hankel singular value This is the key to the problem. We violate our recipe by picking odd-order models!

Eigenvalue behavior of linearized models Eigenvalues of reduced Jacobians, q=7 Eigenvalues of reduced Jacobians, q=8 Another view on the even-odd effect: TBR is adding complex-conjugate pair

Conclusions In this work we used TBR-based linear reduction procedure to generate TPWL reduced models We performed an analysis of TBR algorithm with respect to perturbation in the system, and suggested a simple recipe for using TBR as a linear reduction algorithm in TPWL framework Our observations shows that our derivations are correct.